The Hard Tanh activation function, defined by. More...
Public Member Functions | |
HardTanH (const double maxValue=1, const double minValue=-1) | |
Create the HardTanH object using the specified parameters. More... | |
template < typename DataType > | |
void | Backward (const DataType &input, const DataType &gy, DataType &g) |
Ordinary feed backward pass of a neural network, calculating the function f(x) by propagating x backwards through f. More... | |
OutputDataType const & | Delta () const |
Get the delta. More... | |
OutputDataType & | Delta () |
Modify the delta. More... | |
template < typename InputType , typename OutputType > | |
void | Forward (const InputType &input, OutputType &output) |
Ordinary feed forward pass of a neural network, evaluating the function f(x) by propagating the activity forward through f. More... | |
double const & | MaxValue () const |
Get the maximum value. More... | |
double & | MaxValue () |
Modify the maximum value. More... | |
double const & | MinValue () const |
Get the minimum value. More... | |
double & | MinValue () |
Modify the minimum value. More... | |
OutputDataType const & | OutputParameter () const |
Get the output parameter. More... | |
OutputDataType & | OutputParameter () |
Modify the output parameter. More... | |
template < typename Archive > | |
void | serialize (Archive &ar, const uint32_t) |
Serialize the layer. More... | |
The Hard Tanh activation function, defined by.
InputDataType | Type of the input data (arma::colvec, arma::mat, arma::sp_mat or arma::cube). |
OutputDataType | Type of the output data (arma::colvec, arma::mat, arma::sp_mat or arma::cube). |
Definition at line 49 of file hard_tanh.hpp.
HardTanH | ( | const double | maxValue = 1 , |
const double | minValue = -1 |
||
) |
Create the HardTanH object using the specified parameters.
The range of the linear region can be adjusted by specifying the maxValue and minValue. Default (maxValue = 1, minValue = -1).
maxValue | Range of the linear region maximum value. |
minValue | Range of the linear region minimum value. |
void Backward | ( | const DataType & | input, |
const DataType & | gy, | ||
DataType & | g | ||
) |
Ordinary feed backward pass of a neural network, calculating the function f(x) by propagating x backwards through f.
Using the results from the feed forward pass.
input | The propagated input activation. |
gy | The backpropagated error. |
g | The calculated gradient. |
|
inline |
Get the delta.
Definition at line 92 of file hard_tanh.hpp.
|
inline |
Modify the delta.
Definition at line 94 of file hard_tanh.hpp.
void Forward | ( | const InputType & | input, |
OutputType & | output | ||
) |
Ordinary feed forward pass of a neural network, evaluating the function f(x) by propagating the activity forward through f.
input | Input data used for evaluating the specified function. |
output | Resulting output activation. |
|
inline |
Get the maximum value.
Definition at line 97 of file hard_tanh.hpp.
|
inline |
Modify the maximum value.
Definition at line 99 of file hard_tanh.hpp.
|
inline |
Get the minimum value.
Definition at line 102 of file hard_tanh.hpp.
|
inline |
Modify the minimum value.
Definition at line 104 of file hard_tanh.hpp.
References HardTanH< InputDataType, OutputDataType >::serialize().
|
inline |
Get the output parameter.
Definition at line 87 of file hard_tanh.hpp.
|
inline |
Modify the output parameter.
Definition at line 89 of file hard_tanh.hpp.
void serialize | ( | Archive & | ar, |
const uint32_t | |||
) |
Serialize the layer.
Referenced by HardTanH< InputDataType, OutputDataType >::MinValue().