Calculate the delta of this iteration.
Calculate the delta of this iteration. The input of the layer in forward phase can be restored from ActivationStack. It returns the delta of input layer of this layer and the delta of coefficient and intercept parameter.
The delta tuple of the layer while back propagation. First is passed previous layer, the second and third is the delta of Weight and Bias parameter of the layer.
Returns the form for creating tmp model used while pretraining
Decode the value in hidden layer toward visible layer
Decode the value in hidden layer toward visible layer
The value of visible layer
Encode the input toward hidden layer
Encode the input toward hidden layer
The value of hidden layer
Calculate the output corresponding given input.
Calculate the output corresponding given input. Input is given as a top of ActivationStack.
The output tuple of the layer.
Pretraining with input data to the layer.
Pretraining with input data to the layer. We can assume AutoEncoder can inherit this class. It returns the gradient of weight and bias of the layer.
(dWeight1, dBias1): Hidden Layer Gradient (dWeight2, dBias2): Visible Layer Gradient (Hidden Layer Gradient, Visible Layer Gradient)