Meanings
- uncountablemachine learningA form of attention (machine learning method) where input sequence is compared with itself, i.e. the keys and queries are the same.
Antonyms: cross-attention
- uncountablehuman sciencesConscious attention to one's own physiological and emotional state and behavior.
Interest in the consequences of self-attention spread fairly quickly from social to personality psychologists.
2012, C. S. Carver, M. F. Scheier, Attention and Self-Regulation, page 451 more example
According to self-attention theory in general, it can be predicted that heightened self-attention leads to a closer fit between observed behavior and some underlying salient standard.
1986, Ralf Schwarzer, editor, Self-related Cognitions in Anxiety and Motivation, Psychology Press, →ISBN
Synonyms & antonyms
nounA form of attention (machine learning method) where input sequence is compared with itself, i.e. the keys and queries are the same.
Origin
Cite this entry
self-attention. (n.d.). In WatkinsX Dictionary. Retrieved November 3, 2026, from https://dictionary.watkinsx.com/word/self-attention
“self-attention.” WatkinsX Dictionary, https://dictionary.watkinsx.com/word/self-attention. Accessed November 3, 2026.
WatkinsX Dictionary, s.v. “self-attention,” accessed November 3, 2026, https://dictionary.watkinsx.com/word/self-attention.
Source: self-attention on Wiktionary, CC BY-SA 4.0.