Sign in
Enter the word for search

self-attention

Translations

self-attentionnoun
self-attentions
pl
Too much self-attention can make you feel self-conscious in public.
Слишком большое самовнимание может заставить вас чувствовать себя неуютно на людях.
Synonyms
intra-attention
intra-sequence attention
self-attention mechanism
internal attention
within-sequence attention
self-attentional mechanism
auto-attention
self-referential attention
self-attentionadjective
Used attributively before nouns, especially in machine-learning contexts.
Additional translations
самовнимательныйспециализированное; употребляется преимущественно в терминах типа «самовнимательный слой» в ML-контексте
Synonyms
self-attentive
intra-attentive
intra-attention-based
attention-based
self-focused
self-referential

Definitions

self-attentionnoun
conscious attention directed toward oneself, one’s appearance, thoughts, or feelings
Too much self-attention can make you feel self-conscious in public.
in machine learning, a neural-network mechanism in which different positions within a single input sequence attend to one another to build contextualized representations
Transformers rely on self-attention to capture long-range dependencies in text.
self-attentionadjective
relating to or employing self-attention
The model’s self-attention layer improved accuracy.
OverviewPhrasesExamplesAI ExpertDictionaries