Model Distillation

A technique where a smaller, faster model is trained to mimic the behavior of a larger, more capable model to reduce computational costs.