Skip to main content
entropy

entropy

2 9.0
How hard it is to predict which message will appear in a set
  • noun
  • /ˈɛntrəpi/
  • Specialized
translation icon : entropía
  • The MEEM tracker employs multiple SVM classifiers with different learning rates and uses an entropy measure to fuse all the outputs from multiple classifiers.
  • maximum entropy
  • entropy measure
  • information entropy

That's that's the maximum entropy right in the background distribution.

Autoplay Next

Examples

  • The results obtained indicate a clear difference between the pieces generated with high and low entropy.

    Academic text (2018)
  • Generally, throughput performance of the bilevel-image arithmetic coders decreased as image entropy increased.

    Academic text (1998)
  • Images with more noise contain more entropy and thus more space to store.

    Blog text (22)
  • The entropy thus also provides a measure of the information stored in a system.

    Academic text (2000)
  • But recall that the maximum entropy for a system limits the maximum information that can be stored in it.

    Academic text (2000)
  • Let's try to guess what the entropy of a vibrating string is.

  • And the entropy is in turn the log of the number of of possible microstates.

  • In the Science paper, the team assessed the script using a measure called conditional entropy.

    Academic text (2010)
  • Entropy values of .80, .60, and .40 indicate high, medium, and low class separation.

    Academic text (2018)
  • In information theory, high entropy signifies that the messages are less predictable and contain more information.

Synonyms

information
vsentropy
  • Specialized
79 7.9

How much a message reduces your surprise about an outcome

measures average unpredictability across many possible messages rather than a single outcome

Antonyms

certainty
  • Literature
202 3.4

A strong feeling that something is true or will happen

How much you can know about what will happen next

Compounds

9.6

A measure of how many different shapes a molecule can take

How Uncertain

chaos
438 3.1
entropy
  • Specialized
2 9.0
randomness
19 5.4
uncertainty
296 4.0
certainty
  • Literature
202 3.4

Surface Forms

entropy singular
entropies plural

Etymology

Entropy comes from Greek parts en- 'in' and tropē 'turning'. In information theory, this 'turning' idea helps: entropy measures how uncertain or surprising a message is, so more entropy means more randomness and less predictability.