Diffusion LLM Evaluation: Pipeline, Frameworks, and Prompting Pitfalls
A practical guide to evaluating diffusion LLMs, from sampler integration and extraction to framework selection and prompt hygiene.
Read more →My thoughts on technology, engineering, and life
A practical guide to evaluating diffusion LLMs, from sampler integration and extraction to framework selection and prompt hygiene.
Read more →
A structured study guide covering LLMs, deep learning, classic ML, and algorithms for SEED interviews.
Read more →
A deep-dive into 5 positional encoding strategies with mathematical formulations, code walkthroughs, architectural diagrams, and comparative analysis
Read more →
A review of the Rick and Morty episode S02 E04, discussing the themes of memory, relationships, and the nature of imperfection.
Read more →
Introduction to GPU programming with Triton and build the matrix multiplication along the way
Read more →
Implementation details and best practices for Quantization Aware Training (QAT) with LoRA, including GPU memory optimization strategies
Read more →
Comprehensive report on quantization strategies including switchable precision and cyclic precision training applied to WikiText-103 dataset
Read more →
Weekly progress journal documenting my journey learning SystemVerilog, including module structures, always blocks, and FSM implementations
Read more →