Meaning of cross-attention | Babel Free
Definitions
A form of attention (machine learning method) where two different input sequences are compared, i.e. the keys and queries differ.
Examples
“The cross attention layer inside each transformer decoder block⟳ is in fact a multi-head cross attention layer […]”
CEFR level
C2
Mastery
This word is part of the CEFR C2 vocabulary — mastery level.
This word is part of the CEFR C2 vocabulary — mastery level.
Know this word better than we do? Language is a living thing — help us keep it growing. Collaborate with Babel Free