Implementation of the RecurrentLayer class. More...
Public Member Functions | |
Recurrent () | |
Default constructor—this will create a Recurrent object that can't be used, so be careful! Make sure to set all the parameters before use. More... | |
Recurrent (const Recurrent &) | |
Copy constructor. More... | |
template < typename StartModuleType , typename InputModuleType , typename FeedbackModuleType , typename TransferModuleType > | |
Recurrent (const StartModuleType &start, const InputModuleType &input, const FeedbackModuleType &feedback, const TransferModuleType &transfer, const size_t rho) | |
Create the Recurrent object using the specified modules. More... | |
template < typename eT > | |
void | Backward (const arma::Mat< eT > &, const arma::Mat< eT > &gy, arma::Mat< eT > &g) |
Ordinary feed backward pass of a neural network, calculating the function f(x) by propagating x backwards trough f. More... | |
OutputDataType const & | Delta () const |
Get the delta. More... | |
OutputDataType & | Delta () |
Modify the delta. More... | |
bool | Deterministic () const |
The value of the deterministic parameter. More... | |
bool & | Deterministic () |
Modify the value of the deterministic parameter. More... | |
template < typename eT > | |
void | Forward (const arma::Mat< eT > &input, arma::Mat< eT > &output) |
Ordinary feed forward pass of a neural network, evaluating the function f(x) by propagating the activity forward through f. More... | |
template < typename eT > | |
void | Gradient (const arma::Mat< eT > &input, const arma::Mat< eT > &error, arma::Mat< eT > &) |
OutputDataType const & | Gradient () const |
Get the gradient. More... | |
OutputDataType & | Gradient () |
Modify the gradient. More... | |
size_t | InputShape () const |
Get the shape of the input. More... | |
std::vector< LayerTypes< CustomLayers... > > & | Model () |
Get the model modules. More... | |
OutputDataType const & | OutputParameter () const |
Get the output parameter. More... | |
OutputDataType & | OutputParameter () |
Modify the output parameter. More... | |
OutputDataType const & | Parameters () const |
Get the parameters. More... | |
OutputDataType & | Parameters () |
Modify the parameters. More... | |
size_t const & | Rho () const |
Get the number of steps to backpropagate through time. More... | |
template < typename Archive > | |
void | serialize (Archive &ar, const uint32_t) |
Serialize the layer. More... | |
Implementation of the RecurrentLayer class.
Recurrent layers can be used similarly to feed-forward layers.
InputDataType | Type of the input data (arma::colvec, arma::mat, arma::sp_mat or arma::cube). |
OutputDataType | Type of the output data (arma::colvec, arma::mat, arma::sp_mat or arma::cube). |
Definition at line 159 of file layer_types.hpp.
Recurrent | ( | ) |
Default constructor—this will create a Recurrent object that can't be used, so be careful! Make sure to set all the parameters before use.
Recurrent | ( | const StartModuleType & | start, |
const InputModuleType & | input, | ||
const FeedbackModuleType & | feedback, | ||
const TransferModuleType & | transfer, | ||
const size_t | rho | ||
) |
Create the Recurrent object using the specified modules.
start | The start module. |
input | The input module. |
feedback | The feedback module. |
transfer | The transfer module. |
rho | Maximum number of steps to backpropagate through time (BPTT). |
void Backward | ( | const arma::Mat< eT > & | , |
const arma::Mat< eT > & | gy, | ||
arma::Mat< eT > & | g | ||
) |
Ordinary feed backward pass of a neural network, calculating the function f(x) by propagating x backwards trough f.
Using the results from the feed forward pass.
* | (input) The propagated input activation. |
gy | The backpropagated error. |
g | The calculated gradient. |
|
inline |
Get the delta.
Definition at line 130 of file recurrent.hpp.
|
inline |
Modify the delta.
Definition at line 132 of file recurrent.hpp.
|
inline |
The value of the deterministic parameter.
Definition at line 115 of file recurrent.hpp.
|
inline |
Modify the value of the deterministic parameter.
Definition at line 117 of file recurrent.hpp.
void Forward | ( | const arma::Mat< eT > & | input, |
arma::Mat< eT > & | output | ||
) |
Ordinary feed forward pass of a neural network, evaluating the function f(x) by propagating the activity forward through f.
input | Input data used for evaluating the specified function. |
output | Resulting output activation. |
void Gradient | ( | const arma::Mat< eT > & | input, |
const arma::Mat< eT > & | error, | ||
arma::Mat< eT > & | |||
) |
|
inline |
Get the gradient.
Definition at line 135 of file recurrent.hpp.
|
inline |
Modify the gradient.
Definition at line 137 of file recurrent.hpp.
size_t InputShape | ( | ) | const |
Get the shape of the input.
Referenced by Recurrent< InputDataType, OutputDataType, CustomLayers >::Rho().
|
inline |
Get the model modules.
Definition at line 112 of file recurrent.hpp.
|
inline |
Get the output parameter.
Definition at line 125 of file recurrent.hpp.
|
inline |
Modify the output parameter.
Definition at line 127 of file recurrent.hpp.
|
inline |
Get the parameters.
Definition at line 120 of file recurrent.hpp.
|
inline |
Modify the parameters.
Definition at line 122 of file recurrent.hpp.
|
inline |
Get the number of steps to backpropagate through time.
Definition at line 140 of file recurrent.hpp.
References Recurrent< InputDataType, OutputDataType, CustomLayers >::InputShape(), and Recurrent< InputDataType, OutputDataType, CustomLayers >::serialize().
void serialize | ( | Archive & | ar, |
const uint32_t | |||
) |
Serialize the layer.
Referenced by Recurrent< InputDataType, OutputDataType, CustomLayers >::Rho().