Skip to main content
attention

attention

7 7.2
A way a computer model focuses on the most important parts of input
  • noun
  • /əˈtɛnʃən/
  • Specialized
translation icon : mecanismo de atención
  • In machine learning, attention allows the model to increase focus on the most relevant data points.
  • self-attention
  • manipulation of self-attention

And so there's different schools of thought on training attention, for instance.

Examples

  • With attention in neural networks, unimportant details are downplayed while crucial inputs are emphasized.

  • The attention mechanism assigns different weights to input features, highlighting the key information.

  • And Ed did a lot of research on managing human attention and search.

  • But at the moment, of course, all attention is focused on the pandemic.

  • These assign a higher weight or increased attention to words that are more important.

  • The Filter Theory suggests that attention to input is selective because only some messages were able to get through.

    Academic text (2012)
  • Through the World Bank and other mechanisms, we must devote more attention and resources to developing strong social safety nets.

    Academic text (1998)
  • As a result, academics directed their attention toward explaining the mechanisms that Arab states had developed to weather popular dissent.

    Academic text (2011)
  • Whereas Deng's economic reforms attracted worldwide attention, his political reforms deserved more credit than they have received.

    Academic text (1998)
  • His research addresses the development of attention, inhibition, working memory, and comprehension processes, especially among children diagnosed with ADHD.

    Academic text (2011)

Compounds

media attention
  • Literature
37 2.4

Notice or interest from newspapers, TV, and websites

The time someone can focus on one thing without getting distracted

29 3.2

A person or thing people notice most in a group

11 3.6

A condition that makes it hard to pay attention and sometimes makes people very active or act without thinking

A condition often in children causing trouble paying attention, being very active and acting without thinking

Makes people notice it

attention whore
  • Offensive
2 9.9

A person who wants people to notice them too much

Immediate care or action needed because a problem is serious and may get worse

A short loud sound that gets people's attention

A lot of people notice someone or something

Extra medical care needed after first treatment

How Focused

focus
794 3.5
attentiveness
  • Specialized
6.8
attention
  • Specialized
7 7.2

Surface Forms

attention singular
attentions plural

Morphology

attention = attend (semi-transparent) = attend + tion

The connection to 'attend' is clear, but the specific technical meaning in machine learning is specialized and not immediately obvious.

Etymology

Attention comes from Latin parts ad- 'to' and tendere 'to stretch', so it means 'stretching toward'. A useful image for computers is a model that 'stretches' its focus to the most useful words or parts of the input, which is exactly what the machine-learning attention tool does.