cross-attention

noun

A form of attention (machine learning method) where two different input sequences are compared, i.e. the keys and queries differ.

Opposite
self-attention
Ask AI about this wordChatGPTClaudePerplexityGoogle AIGrok

Meanings

nouncross-attention (uncountable)

alternative cross attention

  1. uncountablemachine learningA form of attention (machine learning method) where two different input sequences are compared, i.e. the keys and queries differ.

    The cross attention layer inside each transformer decoder block is in fact a multi-head cross attention layer […]

    2024, Benoit Liquet, Sarat Moka, Yoni Nazarathy, Mathematical Engineering of Deep Learning, CRC Press, page 286

    Antonyms: self-attention

Synonyms & antonyms

nounA form of attention (machine learning method) where two different input sequences are compared, i.e. the keys and queries differ.

Opposite
self-attention

Origin

From cross- + attention.

Full word history & related roots →
Cite this entry
APA

cross-attention. (n.d.). In WatkinsX Dictionary. Retrieved November 3, 2026, from https://dictionary.watkinsx.com/word/cross-attention

MLA

“cross-attention.” WatkinsX Dictionary, https://dictionary.watkinsx.com/word/cross-attention. Accessed November 3, 2026.

Chicago

WatkinsX Dictionary, s.v. “cross-attention,” accessed November 3, 2026, https://dictionary.watkinsx.com/word/cross-attention.

Source: cross-attention on Wiktionary, CC BY-SA 4.0.