Artificial-Intelligence

Knowledge Distillation in Machine Learning

Overview Knowledge distillation is a machine learning technique where a smaller, efficient “student” model is trained to reproduce the behavior and outputs of a larger, …