distillation
1
7.0
- noun
- /ˌdɪstəˈleɪʃən/
- Specialized
:
destilación
- Researchers use distillation to help a compact model replicate the output of a more complex model.
Examples
-
This article is a distillation of the report.
Academic text (2002) -
So you don't actually write down what somebody says; you write down a distillation of what somebody says.
Blog text (23) -
Distillation of essential information and heightened legibility were central goals.
Academic text (2003) -
They tend to operate more on distillations of those papers.
Blog text (23) -
In their simplicity, the Stockbridge sermons represent a distillation of Edwards' theology.
Academic text (2003) -
Instead of symbols representing medical details or strategies articulated by expert clinicians, the knowledge base of some systems contains a mathematical distillation of a series of cases with known outcomes, such as the prior probabilities of diseases and the conditional probabilities of certain findings in patients with those diseases.
Academic text (1991) -
The author of perhaps the most influential book on the South in the twentieth century was Wilbur Cash, a South Carolina native whose The Mind of the South (1941) was a supremely effective distillation of the prevailing views on the South and the mentality of white male Southerners.
Academic text (2003) -
Through the distillation of findings from qualitative studies of NCEAS working groups (Hackett et al. 2008, Hackett and Parker 2011), other sociological research, and the firsthand experiences of working group leaders, the following have proven to be important aspects of collaboration and leadership:
Academic text (2011) -
The distillation of knowledge from large models to smaller ones is essential for efficient machine learning.
-
In machine learning, a distillation process allows a smaller model to learn from a larger model's behavior.
Compounds
- Specialized
Heating a solid material without air so it breaks down and makes gases and liquids that you collect
- Specialized
A process that separates a liquid mixture into parts by heating and cooling using their different boiling points
Surface Forms
Morphology
Etymology
Distillation is used in machine learning as a helpful image from the Latin distillare 'to drip'; a helpful way to remember it is to think of taking the clear 'essence' or best parts from a large model and letting them fall into a smaller one, like collecting pure drops. This is why distillation in AI means moving knowledge from a big model into a smaller one.