Fundamental technique lets researchers use a big, expensive “teacher” model to train a “student” model for less.

The story How Distillation Makes AI Models Smaller and Cheaper first appeared on Quanta Magazine.