Skip to main content
information theory

information theory

1 4.9
Study of how to measure, store, and send information with little loss
  • noun
  • /ˌɪnfərˈmeɪʃən ˈθɪəri/
  • Specialized
translation icon : teoría de la información
  • The disciplines of psychology, wildlife biology, and statistics have been in the forefront of this conflict between two qualitatively different inferential paradigms: model-selection methods, based on information theory, and null-hypothesis testing, based on a frequentist approach.
  • apply information theory
  • classical information theory
  • information theory-based

So at this point, Todd was a straight up engineer with deep expertise and control systems and information theory.

Autoplay Next

Examples

  • Sporadic attempts to apply information theory directly to molecular biology continue, but the results are less than exciting.

    Academic text (1996)
  • An important achievement of classical information theory is the ability to transmit classical data reliably through a noisy channel.

    Academic text (1995)
  • All right, this is just basic information theory, all right?

  • So all this information theory, all this entropy stuff.

  • To date, a definitive judgment of the value of information theory in biology is not possible.

    Academic text (1996)
  • Shannon was a new breed of mathematician: a specialist in what's known today as information theory.

    Blog text (14)
  • For instance, cryptography has borrowed "avalanche effect" from engineering, and information theory has borrowed "entropy" from thermodynamics.

    Blog text (7)
  • With tools borrowed from information theory, one can derive more general expressions valid for finite gradients, more complex cell shapes, and non-uniform receptor spacing.

    Academic text (2012)
  • Mehrabian and Russell (1974) used information theory to characterize and interrelate stimuli that elicit the orienting reflex.

    Academic text (1995)
  • The study of information theory is essential for understanding data compression and transmission.

How Theoretical

metamathematics
  • Specialized
9.9
information theory
  • Specialized
1 4.9
information science
  • Specialized
1 3.8
information technology
  • Specialized
25 3.5

Surface Forms

Morphology

information + theory

The meaning is directly compositional: combining 'information' and 'theory' yields 'a theory about information,' which a B1 learner who knows both words can readily infer. While the technical mathematical/CS specifics may be beyond B1 knowledge, the basic concept is transparent and follows a common cross-linguistic noun + noun naming pattern.

Etymology

Information theory comes from a simple idea: Claude Shannon imagined messages as a series of yes/no choices, like a quick game of 'twenty questions', and used that picture to measure how much each answer tells you. That's why information theory studies how to measure, store and send information so messages stay small and clear even when there is noise.