🧠 Learning by heart 🤖 Overfitting data

memorization

6.1

A model remembers examples it was trained on too exactly and fails on new data

noun
/ˌmɛmərɪˈzeɪʃən/

Specialized

: memorización

The team struggled with memorization, as their model was too closely fitted to the training examples.

So is it possible that neural network is a giant memorization thing?

Examples

To avoid memorization, researchers used techniques that encouraged generalization beyond the training set.
Overall, these definitions are broad, devoid of context, and rely on the students' existing scientific understanding. As a result, such abstractions may lead to memorization instead of problem solving.

Academic text (2012)
First, in order to circumvent the problem of memorization as a means of selectively attending to test stimuli, separate yet analogous audiotaped scripts were employed.

Academic text (1991)
In machine learning, memorization can result in poor performance on unseen data.

Synonyms

rote

vsmemorization

6 5.5

Learning something by repeating it many times without understanding it

is focused on model memory of specific examples not mere repetition

regurgitation

vsmemorization

1 8.2

Saying or writing facts exactly as learned without understanding them

is a model behaviour of storing idiosyncratic examples not human copying

rote learning

vsmemorization

1 4.4

Remembering facts by repeating them without really understanding

is about storing exact training samples rather than human repetition

overtraining

vsmemorization

Specialized

6.6

Teaching a computer program too much with the same examples that it fails on new data

is a machine tendency to store idiosyncratic training examples and hurt generalization

committal to memory

vsmemorization

4.2

Learning something so you remember it exactly

is about models keeping specific training examples rather than general learning

Antonyms

generalization

2 5.5

Seeing the same pattern in many examples helps form a general rule

How Memorized

overfitting

Specialized

8.1

memorization

Specialized

6.1

generalization

Specialized

1 6.3

Surface Forms

memorization singular

memorizations plural

Morphology

memorization = memorize (transparent) = memorize + ation

Same standard nominalization from 'memorize'; the ML sense is a technical application but the composition is directly the process of 'memorizing'.

Etymology

Memorization in the sense used in machine learning comes from the same root memor 'remember' and is like a student who simply memorizes exact answers. So, it means a model 'remembers' its training examples too closely and then does not do well on new data.