Calculate the delta of this iteration.
Calculate the delta of this iteration. The input of the layer in forward phase can be restored from ActivationStack. It returns the delta of input layer of this layer and the delta of coefficient and intercept parameter.
The delta tuple of the layer while back propagation. First is passed previous layer, the second and third is the delta of Weight and Bias parameter of the layer.
Calculate the output corresponding given input.
Calculate the output corresponding given input. Input is given as a top of ActivationStack.
The output tuple of the layer. First value of the tuple represents the raw output, the second is applied activation function of the layer.
Sigmoid function layer