Implementation of the RecurrentLayer class. More...
Public Member Functions | |
| Recurrent () | |
| Default constructor—this will create a Recurrent object that can't be used, so be careful! Make sure to set all the parameters before use. More... | |
| Recurrent (const Recurrent &) | |
| Copy constructor. More... | |
template < typename StartModuleType , typename InputModuleType , typename FeedbackModuleType , typename TransferModuleType > | |
| Recurrent (const StartModuleType &start, const InputModuleType &input, const FeedbackModuleType &feedback, const TransferModuleType &transfer, const size_t rho) | |
| Create the Recurrent object using the specified modules. More... | |
template < typename eT > | |
| void | Backward (const arma::Mat< eT > &, const arma::Mat< eT > &gy, arma::Mat< eT > &g) |
| Ordinary feed backward pass of a neural network, calculating the function f(x) by propagating x backwards trough f. More... | |
| OutputDataType const & | Delta () const |
| Get the delta. More... | |
| OutputDataType & | Delta () |
| Modify the delta. More... | |
| bool | Deterministic () const |
| The value of the deterministic parameter. More... | |
| bool & | Deterministic () |
| Modify the value of the deterministic parameter. More... | |
template < typename eT > | |
| void | Forward (const arma::Mat< eT > &input, arma::Mat< eT > &output) |
| Ordinary feed forward pass of a neural network, evaluating the function f(x) by propagating the activity forward through f. More... | |
template < typename eT > | |
| void | Gradient (const arma::Mat< eT > &input, const arma::Mat< eT > &error, arma::Mat< eT > &) |
| OutputDataType const & | Gradient () const |
| Get the gradient. More... | |
| OutputDataType & | Gradient () |
| Modify the gradient. More... | |
| size_t | InputShape () const |
| Get the shape of the input. More... | |
| std::vector< LayerTypes< CustomLayers... > > & | Model () |
| Get the model modules. More... | |
| OutputDataType const & | OutputParameter () const |
| Get the output parameter. More... | |
| OutputDataType & | OutputParameter () |
| Modify the output parameter. More... | |
| OutputDataType const & | Parameters () const |
| Get the parameters. More... | |
| OutputDataType & | Parameters () |
| Modify the parameters. More... | |
| size_t const & | Rho () const |
| Get the number of steps to backpropagate through time. More... | |
template < typename Archive > | |
| void | serialize (Archive &ar, const uint32_t) |
| Serialize the layer. More... | |
Implementation of the RecurrentLayer class.
Recurrent layers can be used similarly to feed-forward layers.
| InputDataType | Type of the input data (arma::colvec, arma::mat, arma::sp_mat or arma::cube). |
| OutputDataType | Type of the output data (arma::colvec, arma::mat, arma::sp_mat or arma::cube). |
Definition at line 159 of file layer_types.hpp.
| Recurrent | ( | ) |
Default constructor—this will create a Recurrent object that can't be used, so be careful! Make sure to set all the parameters before use.
| Recurrent | ( | const StartModuleType & | start, |
| const InputModuleType & | input, | ||
| const FeedbackModuleType & | feedback, | ||
| const TransferModuleType & | transfer, | ||
| const size_t | rho | ||
| ) |
Create the Recurrent object using the specified modules.
| start | The start module. |
| input | The input module. |
| feedback | The feedback module. |
| transfer | The transfer module. |
| rho | Maximum number of steps to backpropagate through time (BPTT). |
| void Backward | ( | const arma::Mat< eT > & | , |
| const arma::Mat< eT > & | gy, | ||
| arma::Mat< eT > & | g | ||
| ) |
Ordinary feed backward pass of a neural network, calculating the function f(x) by propagating x backwards trough f.
Using the results from the feed forward pass.
| * | (input) The propagated input activation. |
| gy | The backpropagated error. |
| g | The calculated gradient. |
|
inline |
Get the delta.
Definition at line 130 of file recurrent.hpp.
|
inline |
Modify the delta.
Definition at line 132 of file recurrent.hpp.
|
inline |
The value of the deterministic parameter.
Definition at line 115 of file recurrent.hpp.
|
inline |
Modify the value of the deterministic parameter.
Definition at line 117 of file recurrent.hpp.
| void Forward | ( | const arma::Mat< eT > & | input, |
| arma::Mat< eT > & | output | ||
| ) |
Ordinary feed forward pass of a neural network, evaluating the function f(x) by propagating the activity forward through f.
| input | Input data used for evaluating the specified function. |
| output | Resulting output activation. |
| void Gradient | ( | const arma::Mat< eT > & | input, |
| const arma::Mat< eT > & | error, | ||
| arma::Mat< eT > & | |||
| ) |
|
inline |
Get the gradient.
Definition at line 135 of file recurrent.hpp.
|
inline |
Modify the gradient.
Definition at line 137 of file recurrent.hpp.
| size_t InputShape | ( | ) | const |
Get the shape of the input.
Referenced by Recurrent< InputDataType, OutputDataType, CustomLayers >::Rho().
|
inline |
Get the model modules.
Definition at line 112 of file recurrent.hpp.
|
inline |
Get the output parameter.
Definition at line 125 of file recurrent.hpp.
|
inline |
Modify the output parameter.
Definition at line 127 of file recurrent.hpp.
|
inline |
Get the parameters.
Definition at line 120 of file recurrent.hpp.
|
inline |
Modify the parameters.
Definition at line 122 of file recurrent.hpp.
|
inline |
Get the number of steps to backpropagate through time.
Definition at line 140 of file recurrent.hpp.
References Recurrent< InputDataType, OutputDataType, CustomLayers >::InputShape(), and Recurrent< InputDataType, OutputDataType, CustomLayers >::serialize().
| void serialize | ( | Archive & | ar, |
| const uint32_t | |||
| ) |
Serialize the layer.
Referenced by Recurrent< InputDataType, OutputDataType, CustomLayers >::Rho().