multihead_attention.hpp File Reference
Include dependency graph for multihead_attention.hpp:
This graph shows which files directly or indirectly include this file:
Go to the source code of this file.
Classes | |
| class | MultiheadAttention< InputDataType, OutputDataType, RegularizerType > |
| Multihead Attention allows the model to jointly attend to information from different representation subspaces at different positions. More... | |
Namespaces | |
| mlpack | |
Linear algebra utility functions, generally performed on matrices or vectors. | |
| mlpack::ann | |
Artificial Neural Network. | |
Detailed Description
Definition of the MultiheadAttention class.
@article{NIPS'17,
author = {Ashish Vaswani, Llion Jones, Noam Shazeer, Niki Parmar,
Aidan N. Gomez, Jakob Uszkoreit, Łukasz Kaiser,
Illia Polosukhin},
title = {Attention Is All You Need},
year = {2017},
url = {http://arxiv.org/abs/1706.03762v5}
}
mlpack is free software; you may redistribute it and/or modify it under the terms of the 3-clause BSD license. You should have received a copy of the 3-clause BSD license along with mlpack. If not, see http://www.opensource.org/licenses/BSD-3-Clause for more information.
Definition in file multihead_attention.hpp.