Package: attention 0.4.0
attention: Self-Attention Algorithm
Self-Attention algorithm helper functions and demonstration vignettes of increasing depth on how to construct the Self-Attention algorithm, this is based on Vaswani et al. (2017) <doi:10.48550/arXiv.1706.03762>, Dan Jurafsky and James H. Martin (2022, ISBN:978-0131873216) <https://web.stanford.edu/~jurafsky/slp3/> "Speech and Language Processing (3rd ed.)" and Alex Graves (2020) <https://www.youtube.com/watch?v=AIiwuClvH6k> "Attention and Memory in Deep Learning".
Authors:
attention_0.4.0.tar.gz
attention_0.4.0.zip(r-4.7-any)attention_0.4.0.zip(r-4.6-any)attention_0.4.0.zip(r-4.5-any)
attention_0.4.0.tgz(r-4.6-any)attention_0.4.0.tgz(r-4.5-any)
attention_0.4.0.tar.gz(r-4.7-any)attention_0.4.0.tar.gz(r-4.6-any)
attention_0.4.0.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
DESCRIPTION |NEWS
card.svg |card.png
attention/json (API)
| # Install 'attention' in R: |
| install.packages('attention', repos = c('https://bquast.r-universe.dev', 'https://cloud.r-project.org')) |
Bug tracker:https://github.com/bquast/attention/issues
Last updated from:64e8f97e0f. Checks:9 OK. Indexed: yes.
| Target | Result | Time | Files | Syslog |
|---|---|---|---|---|
| linux-devel | OK | 169 | ||
| source / vignettes | OK | 199 | ||
| linux-release | OK | 140 | ||
| macos-release | OK | 99 | ||
| macos-oldrel | OK | 87 | ||
| windows-devel | OK | 72 | ||
| windows-release | OK | 77 | ||
| windows-oldrel | OK | 69 | ||
| wasm-release | OK | 110 |
Exports:attentionComputeWeightsRowMaxSoftMax
Dependencies:
Last update: 2022-06-24
Started: 2022-06-22
Last update: 2022-06-23
Started: 2022-06-23
Readme and manuals
Help Manual
| Help page | Topics |
|---|---|
| Attnention mechanism | attention |
| SoftMax sigmoid function | ComputeWeights |
| Maximum of Matrix Rows | RowMax |
| SoftMax sigmoid function | SoftMax |