Hugging Face Blog·· 2026-08-25AI 评分51
Multiverse Computing 提出 Quantization-Aware Healing,让 60B MXFP4 模型在 7/9 基准上超过 BF16 版本
Quantization-Aware Healing: a compressed, 4-bit model that outperforms its full-precision original
AI 导读
Multiverse Computing 发布论文 Quantization-Aware Healing,提出直接用压缩前的原始全精度模型作为教师,向结构压缩并量化为 MXFP4 的学生模型做 KL 蒸馏。
来源:Hugging Face Blog · huggingface.co