The Hard Tanh activation function, defined by. More...
Public Member Functions | |
| HardTanH (const double maxValue=1, const double minValue=-1) | |
| Create the HardTanH object using the specified parameters. More... | |
template < typename DataType > | |
| void | Backward (const DataType &input, const DataType &gy, DataType &g) |
| Ordinary feed backward pass of a neural network, calculating the function f(x) by propagating x backwards through f. More... | |
| OutputDataType const & | Delta () const |
| Get the delta. More... | |
| OutputDataType & | Delta () |
| Modify the delta. More... | |
template < typename InputType , typename OutputType > | |
| void | Forward (const InputType &input, OutputType &output) |
| Ordinary feed forward pass of a neural network, evaluating the function f(x) by propagating the activity forward through f. More... | |
| double const & | MaxValue () const |
| Get the maximum value. More... | |
| double & | MaxValue () |
| Modify the maximum value. More... | |
| double const & | MinValue () const |
| Get the minimum value. More... | |
| double & | MinValue () |
| Modify the minimum value. More... | |
| OutputDataType const & | OutputParameter () const |
| Get the output parameter. More... | |
| OutputDataType & | OutputParameter () |
| Modify the output parameter. More... | |
template < typename Archive > | |
| void | serialize (Archive &ar, const uint32_t) |
| Serialize the layer. More... | |
The Hard Tanh activation function, defined by.
| InputDataType | Type of the input data (arma::colvec, arma::mat, arma::sp_mat or arma::cube). |
| OutputDataType | Type of the output data (arma::colvec, arma::mat, arma::sp_mat or arma::cube). |
Definition at line 49 of file hard_tanh.hpp.
| HardTanH | ( | const double | maxValue = 1, |
| const double | minValue = -1 |
||
| ) |
Create the HardTanH object using the specified parameters.
The range of the linear region can be adjusted by specifying the maxValue and minValue. Default (maxValue = 1, minValue = -1).
| maxValue | Range of the linear region maximum value. |
| minValue | Range of the linear region minimum value. |
| void Backward | ( | const DataType & | input, |
| const DataType & | gy, | ||
| DataType & | g | ||
| ) |
Ordinary feed backward pass of a neural network, calculating the function f(x) by propagating x backwards through f.
Using the results from the feed forward pass.
| input | The propagated input activation. |
| gy | The backpropagated error. |
| g | The calculated gradient. |
|
inline |
Get the delta.
Definition at line 92 of file hard_tanh.hpp.
|
inline |
Modify the delta.
Definition at line 94 of file hard_tanh.hpp.
| void Forward | ( | const InputType & | input, |
| OutputType & | output | ||
| ) |
Ordinary feed forward pass of a neural network, evaluating the function f(x) by propagating the activity forward through f.
| input | Input data used for evaluating the specified function. |
| output | Resulting output activation. |
|
inline |
Get the maximum value.
Definition at line 97 of file hard_tanh.hpp.
|
inline |
Modify the maximum value.
Definition at line 99 of file hard_tanh.hpp.
|
inline |
Get the minimum value.
Definition at line 102 of file hard_tanh.hpp.
|
inline |
Modify the minimum value.
Definition at line 104 of file hard_tanh.hpp.
References HardTanH< InputDataType, OutputDataType >::serialize().
|
inline |
Get the output parameter.
Definition at line 87 of file hard_tanh.hpp.
|
inline |
Modify the output parameter.
Definition at line 89 of file hard_tanh.hpp.
| void serialize | ( | Archive & | ar, |
| const uint32_t | |||
| ) |
Serialize the layer.
Referenced by HardTanH< InputDataType, OutputDataType >::MinValue().