←新闻详情

Thomas Wolf更新于 10月18日 01:30

Thomas Wolf 评 DeepSeek-V4.1-Flash:小更新却大幅提升 Terminal-Bench

we’re getting used to it by now but DeepSeek calling this a “minor update” while moving Terminal-Bench 4.0 from 31.2 to 42.3 is very funny.

AI 导读

Thomas Wolf 指出,DeepSeek 把 DeepSeek-V4.1-Flash-1017 称作“minor update”,但 Terminal-Bench 4.0 从 31.2 升到 42.3,DeepSWE 报 77.0,高于 Opus 5 的 74.0 和 GPT-5.6 Sol 的 73.0。他认为最值得关注的是任务完成更快、输出更短,用更少 token 是压低成本曲线的实际方式,且模型延续 MIT 许可权重。他表示好奇这些数字在 DeepSeek 自家评测环境之外是否成立。

推荐理由

精选AI 评分 77

作者把 DeepSeek 自称的小更新与 Terminal-Bench 4.0 的分数跃升放在一起看,并点出更短输出对成本的意义。

主题

标签

引用

DeepSeek

@deepseek_ai

🚀 DeepSeek-V4.1-Flash-1017 is here! Stronger benchmark performance, faster task completion, and shorter outputs than the previous version—a Pareto improvement in performance and cost. Now live on our website, app, and API. 🛠️ Optimized for @DeepSeekHarness, Tencent CodeBuddy, WorkBuddy, and more. Upgrade to DeepSeek Harness v0.2.1-rc.1 or later for the…

展开完整原文

🚀 DeepSeek-V4.1-Flash-1017 is here! Stronger benchmark performance, faster task completion, and shorter outputs than the previous version—a Pareto improvement in performance and cost. Now live on our website, app, and API. 🛠️ Optimized for @DeepSeekHarness, Tencent CodeBuddy, WorkBuddy, and more. Upgrade to DeepSeek Harness v0.2.1-rc.1 or later for the best experience with the new model. 1/4

查看原帖

正文

当前显示原文,中文全文译文尚未就绪。

we’re getting used to it by now but DeepSeek calling this a “minor update” while moving Terminal-Bench 4.0 from 31.2 to 42.3 is very funny.

also reports 77.0 on DeepSWE (vs 74.0 for Opus 5 and 73.0 for GPT-5.6 Sol…)

and the most interesting line may be faster task completion with shorter outputs. using fewer tokens is one of the practical way the cost curve collapses often done as an afterthought

all with MIT-licensed weights in DeepSeek tradition

now curious to see how these numbers will hold up outside their own eval setup

来源

Thomas Wolf