isrlu.hpp File Reference
Include dependency graph for isrlu.hpp:
This graph shows which files directly or indirectly include this file:
Go to the source code of this file.
Classes | |
| class | ISRLU< InputDataType, OutputDataType > |
| The ISRLU activation function, defined by. More... | |
Namespaces | |
| mlpack | |
Linear algebra utility functions, generally performed on matrices or vectors. | |
| mlpack::ann | |
Artificial Neural Network. | |
Detailed Description
Definition of the ISRLU activation function as described by Jonathan T. Barron.
For more information, read the following paper.
@article{
author = {Carlile, Brad and Delamarter, Guy and Kinney, Paul and Marti,
Akiko and Whitney, Brian},
title = {Improving deep learning by inverse square root linear units (ISRLUs)},
year = {2017},
url = {https://arxiv.org/pdf/1710.09967.pdf}
}
mlpack is free software; you may redistribute it and/or modify it under the terms of the 3-clause BSD license. You should have received a copy of the 3-clause BSD license along with mlpack. If not, see http://www.opensource.org/licenses/BSD-3-Clause for more information.
Definition in file isrlu.hpp.