Quantization Aware Training Implementation Guide
Implementation details and best practices for Quantization Aware Training (QAT) with LoRA, including GPU memory optimization strategies
Read more →Writing about AI-ML
Research notes on efficient AI, hardware, and the systems behind them.
2 articles about AI-ML
Newest first
Quantization Strategy Report: Switchable and Cyclic Precision Training
Comprehensive report on quantization strategies including switchable precision and cyclic precision training applied to WikiText-103 dataset
Read more →