SGLang RL 团队实现 INT4 QAT 端到端 RL 训练,单张 H200 跑约 1TB 模型
SGLang RL 团队在 slime 框架上复现并落地了 INT4 QAT 端到端方案,训练侧用假量化加 STE,推理侧用 W4A16 真实量化,使约 1TB 规模的 K2 类模型可装入单张 H200(141GB)。消融实验显示,训练端假量化与推理端真实量化必须同时开启,否则训练与推理的 logprob 差异会明显增大;在 Qwen3-235B-A22B 和 Kimi-K2-Thinking 上,BF16 训练加 INT4 推理的奖励与评测分数走势与 BF16、FP8 方案基本重合。团队称 INT4 的主要收益来自显存压缩带来的单节点 rollout,因为 H 系列 GPU 没有原生 INT4 Tensor Core,其计算速度与 FP8 大致同档。

requires frequent weight updates, we must solve format compatibility. We therefore designed a reverse restore weights before loading safety mechanism. Using cached original shapes metadata, it restores (resizes) the in-memory Marlin weight format back to original shapes before any weight update happens. This prevents runtime errors due to shape mismatches and enables smooth switching between standard weight formats and Marlin formats. We also added a system-level post process weights API to allo
匹配字段正文



