Distillation
Concetto
Addestramento e inferenza
Teaching a small model to imitate a big one.
Stai visualizzando una scheda concettuale: cosa significa questo termine in linguaggio chiaro, e i record che mette in relazione.
Distillation trains a compact student on a larger teacher's outputs, keeping most capability at a fraction of the serving cost — the standard way 'mini' and 'flash' tiers are made. It is also a flashpoint: training on a rival API's outputs against its terms is industrial-scale imitation, an accusation that surfaced prominently around DeepSeek's rise.
Come si collega al resto dello stack
I collegamenti di questa scheda a colpo d'occhio — clicca un gruppo per raggiungerlo.
Correlati
Fonti
Distillation paper (Hinton et al.) ↗
Record revisionato al 2026-01-15 — vedi Metodologia.