Deriving a Quantization-Aware Distillation Recipe for NVFP4 Inference Accuracy Recovery
We develop an NVFP4 quantization-aware distillation (QAD) recipe from open data, using domain-specific failure analysis and small-scale experiments to guide data selection and iteration. On Nemotron models, it uses up to 4.7× fewer training tokens than NVIDIA's official QAD recipe while recovering more of the quantization-induced accuracy loss.