Transformers rely on self-attention to capture long-range dependencies in text.
Les transformers s’appuient sur l’auto-attention pour capturer les dépendances à long terme dans le texte.
Definiciones
conscious attention directed toward oneself, one’s appearance, thoughts, or feelings
Too much self-attention can make you feel self-conscious in public.
in machine learning, a neural-network mechanism in which different positions within a single input sequence attend to one another to build contextualized representations
Transformers rely on self-attention to capture long-range dependencies in text.