mlpack
Static Public Member Functions | List of all members
SwishFunction Class Reference

The swish function, defined by. More...

Static Public Member Functions

static double Deriv (const double y)
 Computes the first derivative of the swish function. More...

 
template
<
typename
InputVecType
,
typename
OutputVecType
>
static void Deriv (const InputVecType &y, OutputVecType &x)
 Computes the first derivatives of the swish function. More...

 
static double Fn (const double x)
 Computes the swish function. More...

 
template
<
typename
eT
>
static void Fn (const arma::Mat< eT > &x, arma::Mat< eT > &y)
 Computes the swish function using a matrix as input. More...

 
template
<
typename
InputVecType
,
typename
OutputVecType
>
static void Fn (const InputVecType &x, OutputVecType &y)
 Computes the swish function. More...

 

Detailed Description

The swish function, defined by.

\begin{eqnarray*} f(x) &=& x \cdot \sigma(x) \\ f'(x) &=& f(x) + \sigma(x) (1 - f(x)) \\ \sigma(x) &=& frac{1}{1 + e^{-x}} \end{eqnarray*}

Definition at line 30 of file swish_function.hpp.

Member Function Documentation

◆ Deriv() [1/2]

static double Deriv ( const double  y)
inlinestatic

Computes the first derivative of the swish function.

Parameters
yInput data.
Returns
f'(x)

Definition at line 77 of file swish_function.hpp.

◆ Deriv() [2/2]

static void Deriv ( const InputVecType &  y,
OutputVecType &  x 
)
inlinestatic

Computes the first derivatives of the swish function.

Parameters
yInput data.
xThe resulting derivatives.

Definition at line 90 of file swish_function.hpp.

◆ Fn() [1/3]

static double Fn ( const double  x)
inlinestatic

Computes the swish function.

Parameters
xInput data.
Returns
f(x).

Definition at line 39 of file swish_function.hpp.

Referenced by SwishFunction::Fn().

◆ Fn() [2/3]

static void Fn ( const arma::Mat< eT > &  x,
arma::Mat< eT > &  y 
)
inlinestatic

Computes the swish function using a matrix as input.

Parameters
xInput data.
yThe resulting output activation.

Definition at line 51 of file swish_function.hpp.

◆ Fn() [3/3]

static void Fn ( const InputVecType &  x,
OutputVecType &  y 
)
inlinestatic

Computes the swish function.

Parameters
xInput data.
yThe resulting output activation.

Definition at line 63 of file swish_function.hpp.

References SwishFunction::Fn().

The documentation for this class was generated from the following file:
  • /home/ryan/src/mlpack.org/_src/mlpack-git/src/mlpack/methods/ann/activation_functions/swish_function.hpp