←新闻详情

Rohan Paul更新于 10月21日 22:46

清华、牛津与斯坦福论文发现 LLM 关闭思考后仍会继续推理

New Tsinghua, Oxford, and Stanford paper finds that LLMs keep reasoning out loud even with thinking turned off, especially on open-ended questions.

AI 导读

清华大学、牛津大学与斯坦福大学的新论文发现,LLM 在关闭思考后仍会继续输出推理过程,在开放式问题上尤其明显。关闭思考时,DeepSeek-V4-Flash 在 99.9% 的开放式回答中仍写出了推理内容,缺少 think 标签或回复简短并不能证明模型跳过了推理。对 5 个模型强制只给答案可将开放式任务的遵从率提升到约 40%,但准确率下降约 15 个百分点。论文地址为 arxiv.org/abs/2610.11765。

推荐理由

AI 评分 61

论文用多模型实验说明关闭思考后模型仍会输出推理,并给出强制只答对准确率的影响。

主题

标签

正文

当前显示原文,中文全文译文尚未就绪。

New Tsinghua, Oxford, and Stanford paper finds that LLMs keep reasoning out loud even with thinking turned off, especially on open-ended questions.

With thinking disabled, DeepSeek-V4-Flash still wrote out reasoning in 99.9% of open-ended answers. A missing think tag or a short reply does not prove the model skipped reasoning.

Yes/no questions are easy to answer directly, multiple-choice questions sit in the middle, and open-ended ones keep pulling the model back into reasoning.

Forcing answer-only replies on open-ended tasks raised compliance to about 40% across 5 models but cut accuracy by about 15 points.

– arxiv. org/abs/2610.11765

来源

Rohan Paul