InternLM 开源 ARM-Thinker:用智能体工具调用强化多模态生成式奖励模型
InternLM 发布 ARM-Thinker,一个以 Qwen2.5-VL-7B 为基座、采用“Think–Act–Verify”智能体循环的多模态奖励模型,可自主调用图像裁剪、多页文档检索等工具为判断提供可验证证据。它通过 SFT 冷启动加两阶段 GRPO 训练,在奖励建模上提升 16.2%、工具使用任务上提升 9.6%,可与 Qwen3-VL-8B、GPT-4o 等更大模型竞争。团队同时推出首个面向多步、证据支撑奖励模型的基准 ARMBench-VL,代码已开源。
able judgment. To train this behavior, we first perform SFT + cold-start initialization to establish stable tool-use patterns. We then apply a two-stage GRPO process: Stage 1 encourages correct tool selection, while Stage 2 refines reward accuracy using verifiable rewards that balance correctness and tool efficiency. Together, these components equip ARM-Thinker with reliable, interpretable, and tool-augmented multimodal reasoning capabilities. 💡 Highlights 🔥 Agentic "Think–Act–Verify" Paradigm A
匹配字段正文







