Model Compression

Knowledge Distillation: Advanced Techniques and Applications

Tomorrow we'll explore small language models. Knowledge Distillation Survey DistilBERT Paper Self Distillation