Implementation of the NoisyLinear layer class. More...
Public Member Functions | |
NoisyLinear () | |
Create the NoisyLinear object. More... | |
NoisyLinear (const size_t inSize, const size_t outSize) | |
Create the NoisyLinear layer object using the specified number of units. More... | |
NoisyLinear (const NoisyLinear &) | |
Copy constructor. More... | |
NoisyLinear (NoisyLinear &&) | |
Move constructor. More... | |
template < typename eT > | |
void | Backward (const arma::Mat< eT > &, const arma::Mat< eT > &gy, arma::Mat< eT > &g) |
Ordinary feed backward pass of a neural network, calculating the function f(x) by propagating x backwards trough f. More... | |
arma::mat & | Bias () |
Modify the bias weights of the layer. More... | |
OutputDataType const & | Delta () const |
Get the delta. More... | |
OutputDataType & | Delta () |
Modify the delta. More... | |
template < typename eT > | |
void | Forward (const arma::Mat< eT > &input, arma::Mat< eT > &output) |
Ordinary feed forward pass of a neural network, evaluating the function f(x) by propagating the activity forward through f. More... | |
template < typename eT > | |
void | Gradient (const arma::Mat< eT > &input, const arma::Mat< eT > &error, arma::Mat< eT > &gradient) |
OutputDataType const & | Gradient () const |
Get the gradient. More... | |
OutputDataType & | Gradient () |
Modify the gradient. More... | |
InputDataType const & | InputParameter () const |
Get the input parameter. More... | |
InputDataType & | InputParameter () |
Modify the input parameter. More... | |
size_t | InputShape () const |
Get the shape of the input. More... | |
size_t | InputSize () const |
Get the input size. More... | |
NoisyLinear & | operator= (const NoisyLinear &layer) |
Operator= copy constructor. More... | |
NoisyLinear & | operator= (NoisyLinear &&layer) |
Operator= move constructor. More... | |
OutputDataType const & | OutputParameter () const |
Get the output parameter. More... | |
OutputDataType & | OutputParameter () |
Modify the output parameter. More... | |
size_t | OutputSize () const |
Get the output size. More... | |
OutputDataType const & | Parameters () const |
Get the parameters. More... | |
OutputDataType & | Parameters () |
Modify the parameters. More... | |
void | Reset () |
void | ResetNoise () |
void | ResetParameters () |
template < typename Archive > | |
void | serialize (Archive &ar, const uint32_t) |
Serialize the layer. More... | |
size_t | WeightSize () const |
Get size of weights. More... | |
Implementation of the NoisyLinear layer class.
It represents a single layer of a neural network, with parametric noise added to its weights.
InputDataType | Type of the input data (arma::colvec, arma::mat, arma::sp_mat or arma::cube). |
OutputDataType | Type of the output data (arma::colvec, arma::mat, arma::sp_mat or arma::cube). |
Definition at line 109 of file layer_types.hpp.
NoisyLinear | ( | ) |
Create the NoisyLinear object.
NoisyLinear | ( | const size_t | inSize, |
const size_t | outSize | ||
) |
Create the NoisyLinear layer object using the specified number of units.
inSize | The number of input units. |
outSize | The number of output units. |
NoisyLinear | ( | const NoisyLinear< InputDataType, OutputDataType > & | ) |
Copy constructor.
NoisyLinear | ( | NoisyLinear< InputDataType, OutputDataType > && | ) |
Move constructor.
void Backward | ( | const arma::Mat< eT > & | , |
const arma::Mat< eT > & | gy, | ||
arma::Mat< eT > & | g | ||
) |
Ordinary feed backward pass of a neural network, calculating the function f(x) by propagating x backwards trough f.
Using the results from the feed forward pass.
* | (input) The propagated input activation. |
gy | The backpropagated error. |
g | The calculated gradient. |
|
inline |
Modify the bias weights of the layer.
Definition at line 149 of file noisylinear.hpp.
|
inline |
Get the delta.
Definition at line 127 of file noisylinear.hpp.
|
inline |
Modify the delta.
Definition at line 129 of file noisylinear.hpp.
void Forward | ( | const arma::Mat< eT > & | input, |
arma::Mat< eT > & | output | ||
) |
Ordinary feed forward pass of a neural network, evaluating the function f(x) by propagating the activity forward through f.
input | Input data used for evaluating the specified function. |
output | Resulting output activation. |
void Gradient | ( | const arma::Mat< eT > & | input, |
const arma::Mat< eT > & | error, | ||
arma::Mat< eT > & | gradient | ||
) |
|
inline |
Get the gradient.
Definition at line 138 of file noisylinear.hpp.
|
inline |
Modify the gradient.
Definition at line 140 of file noisylinear.hpp.
|
inline |
Get the input parameter.
Definition at line 117 of file noisylinear.hpp.
|
inline |
Modify the input parameter.
Definition at line 119 of file noisylinear.hpp.
|
inline |
Get the shape of the input.
Definition at line 143 of file noisylinear.hpp.
|
inline |
Get the input size.
Definition at line 132 of file noisylinear.hpp.
NoisyLinear& operator= | ( | const NoisyLinear< InputDataType, OutputDataType > & | layer | ) |
Operator= copy constructor.
NoisyLinear& operator= | ( | NoisyLinear< InputDataType, OutputDataType > && | layer | ) |
Operator= move constructor.
|
inline |
Get the output parameter.
Definition at line 122 of file noisylinear.hpp.
|
inline |
Modify the output parameter.
Definition at line 124 of file noisylinear.hpp.
|
inline |
Get the output size.
Definition at line 135 of file noisylinear.hpp.
|
inline |
Get the parameters.
Definition at line 112 of file noisylinear.hpp.
|
inline |
Modify the parameters.
Definition at line 114 of file noisylinear.hpp.
void Reset | ( | ) |
void ResetNoise | ( | ) |
void ResetParameters | ( | ) |
void serialize | ( | Archive & | ar, |
const uint32_t | |||
) |
Serialize the layer.
Referenced by NoisyLinear< InputDataType, OutputDataType >::WeightSize().
|
inline |
Get size of weights.
Definition at line 152 of file noisylinear.hpp.
References NoisyLinear< InputDataType, OutputDataType >::serialize().