INT8

INT8 Quantization: Practical Implementation Guide

Tomorrow we'll explore model distillation techniques. LLM.int8() Paper PyTorch Quantization ONNX Runtime Quantization