Package: attention 0.4.0

attention: Self-Attention Algorithm

Self-Attention algorithm helper functions and demonstration vignettes of increasing depth on how to construct the Self-Attention algorithm, this is based on Vaswani et al. (2017) <doi:10.48550/arXiv.1706.03762>, Dan Jurafsky and James H. Martin (2022, ISBN:978-0131873216) <https://web.stanford.edu/~jurafsky/slp3/> "Speech and Language Processing (3rd ed.)" and Alex Graves (2020) <https://www.youtube.com/watch?v=AIiwuClvH6k> "Attention and Memory in Deep Learning".

Authors:Bastiaan Quast [aut, cre]

attention_0.4.0.tar.gz
attention_0.4.0.zip(r-4.7-any)attention_0.4.0.zip(r-4.6-any)attention_0.4.0.zip(r-4.5-any)
attention_0.4.0.tgz(r-4.6-any)attention_0.4.0.tgz(r-4.5-any)
attention_0.4.0.tar.gz(r-4.7-any)attention_0.4.0.tar.gz(r-4.6-any)
attention_0.4.0.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
DESCRIPTION |NEWS
card.svg |card.png
attention/json (API)

# Install 'attention' in R:
install.packages('attention', repos = c('https://bquast.r-universe.dev', 'https://cloud.r-project.org'))

Bug tracker:https://github.com/bquast/attention/issues

On CRAN:

Conda:

5.26 score 2 stars 3 packages 10 scripts 395 downloads 4 exports 0 dependencies

Last updated from:64e8f97e0f. Checks:9 OK. Indexed: yes.

TargetResultTimeFilesSyslog
linux-develOK169
source / vignettesOK199
linux-releaseOK140
macos-releaseOK99
macos-oldrelOK87
windows-develOK72
windows-releaseOK77
windows-oldrelOK69
wasm-releaseOK110

Exports:attentionComputeWeightsRowMaxSoftMax

Dependencies:

Simple Self-Attention from Scratch

Last update: 2022-06-24
Started: 2022-06-22

Complete Self-Attention from Scratch

Last update: 2022-06-23
Started: 2022-06-23