Skip to main content
embedding

embedding

7.6
A list of numbers that represents a word or image for computers
  • noun
  • /ɪmˈbɛdɪŋ/
  • Specialized
translation icon : representación vectorial
  • word embeddings

So what is the fundamental difference between joint embedding architectures and LLMS?

Synonyms

representation
vsembedding
  • Specialized
17 6.0

A list of numbers that stands for data so computers can use it

is a numeric vector for a single discrete item in machine learning
internal representation
vsembedding
  • Specialized
8.0

A computer model's learned pattern that shows important parts of its input used for tasks

is a numeric vector for a single discrete item in machine learning

How Informative

embedding
  • Specialized
7.6
representation
  • Specialized
17 6.0
encoding
  • Specialized
12 4.7
symbol
625 3.5
label
187 1.0

Surface Forms

embedding singular
embeddings plural

Morphology

embedding = embed (semi-transparent) = embed + ing

The ML sense is a metaphorical technical extension of 'embed' (to place within); knowing 'embed' suggests the general idea but not the specifics of vector representations.

Etymology

Embedding comes from the verb embed (from em- 'in' and bed 'place to rest'), so it means 'putting something into a place'. In machine learning, an embedding is a list of numbers that 'places' a word or image inside a continuous space, so thinking of it as putting the item into a numeric 'bed' makes the idea easier to remember.