The story
Etymology from Wiktionary, CC BY-SA 4.0.
self-attention
Today it means: A form of attention (machine learning method) where input sequence is compared with itself, i.e. the keys and queries are the same. Full definition →
Today it means: A form of attention (machine learning method) where input sequence is compared with itself, i.e. the keys and queries are the same. Full definition →
Etymology from Wiktionary, CC BY-SA 4.0.