Fireworks 评测:DeepSeek V4 Pro 在 SWE-Bench 领先,单任务成本约为 Fable 5 的三分之一
Fireworks 用 SWE-Bench Verified、LiveCodeBench v6、Aider Polyglot v1 和 Terminal-Bench 2.1 四组基准测试 DeepSeek V4 Pro 0813,其在 SWE-Bench 上每解决一个任务花费 $0.309,Fable 5 为 $0.808,LiveCodeBench 上为 $0.040 对 $0.225。在 409 个任务的合并样本上,DeepSeek V4 Pro 与 Fable 5 的 oracle 路由达到 92.4% 准确率,高于单用 Fable 5 的 86.6%,每任务成本 $0.279 对 $4.510,其中 86.3% 的任务路由到 V4 Pro。该模型在 Aider Polyglot 的 Java 子集上仅 48.9%,明显低于 Fable 5 的 74.5%,Fireworks 认为 Java 为主的代码库更适合多模型路由;DeepSeek V4 Pro 的训练已在 Fireworks 上线,支持 SFT、DPO 和 RFT。
agent runtime handling everything from the model adapter down to the core execution loop. It speaks Deepseek V4’s native tool semantics instead of routing calls through a generic OpenAI-style interface. For this model, Deepseek also has not ship a standard chat template, so small serialization mismatches can silently drop model performance. During testing on Fireworks, we found that a "minimal-first" setup yields much more consistent tool calls than jumping straight to the full standard catalog
匹配字段正文



