Model Distillation

Model Distillation: Creating Efficient Student Models

Tomorrow we'll dive deeper into knowledge distillation techniques. Distilling Knowledge in Neural Networks TinyBERT DistilBERT