Search “DeepSeek”

DeepSeek V4 Pro leads in code evaluation

On August 26, 2026, Fireworks AI released evaluation results for DeepSeek V4 Pro 0813 and announced that training support for the model is now live on Fireworks, supporting SFT, DPO, and RFT. The evaluation used four benchmark suites: SWE-Bench Verified, LiveCodeBench v6, Aider Polyglot, and Terminal-Bench 2.1. Fireworks stated that DeepSeek V4 Pro scored 95.2% on SWE-Bench Verified, higher than Kimi K3's 92.6% and Fable 5's 85.4%; on LiveCodeBench v6 it scored 92.0%. In terms of cost, the model spent $0.309 per task solved on SWE-Bench, compared with $0.808 for Fable 5; on LiveCodeBench the figures were $0.040 and $0.225, respectively. On a combined sample of 409 tasks, the oracle routing accuracy of DeepSeek V4 Pro and Fable 5 was 92.4%, higher than the 86.6% achieved by Fable 5 alone, with a per-task cost

English translation is being prepared.

English translation is being prepared.

English translation is being prepared.

English translation is being prepared.

English translation is being prepared.

English translation is being prepared.

English translation is being prepared.

DeepSeek V4 Pro leads in code evaluation

On August 26, 2026, Fireworks AI released evaluation results for DeepSeek V4 Pro 0813 and announced that training support for the model is now live on Fireworks, supporting SFT, DPO, and RFT. The evaluation used four benchmark suites: SWE-Bench Verified, LiveCodeBench v6, Aider Polyglot, and Terminal-Bench 2.1. Fireworks stated that DeepSeek V4 Pro scored 95.2% on SWE-Bench Verified, higher than Kimi K3's 92.6% and Fable 5's 85.4%; on LiveCodeBench v6 it scored 92.0%. In terms of cost, the model spent $0.309 per task solved on SWE-Bench, compared with $0.808 for Fable 5; on LiveCodeBench the figures were $0.040 and $0.225, respectively. On a combined sample of 409 tasks, the oracle routing accuracy of DeepSeek V4 Pro and Fable 5 was 92.4%, higher than the 86.6% achieved by Fable 5 alone, with a per-task cost

View story:DeepSeek V4 Pro leads in code evaluation

Fireworks AI announces evaluation results of DeepSeek V4 Pro on CyberGym

On August 26, 2026, Fireworks AI published evaluation results of DeepSeek V4 Pro 0813 on the CyberGym security benchmark. The test covered 697 common valid tasks; DeepSeek V4 Pro's reward rate was 53.7%, with a cost of $2.502 per successful task, about half that of Kimi K3. In the same batch of results, Kimi K3 had the highest reward rate at 68.4%, with a cost of $4.914 per successful task; GPT-5.5 had a reward rate of 47.6%, with a cost of $9.641 per successful task; Claude Opus 4.8 had a reward rate of 5.9%, with a cost of $33.275 per successful task. Fireworks AI also said that DeepSeek V4 Pro produced native tool calls on all 840 tasks, with no refusals or output truncation; once it passed first-stage validation, its rate of completing the full patch was 94.7%. There are currently no further developments.

View story:Fireworks AI publishes evaluation results of DeepSeek V4 Pro on CyberGym

Fireworks AI publishes evaluation results of DeepSeek V4 Pro on CyberGym

On August 26, 2026, Fireworks AI published evaluation results of DeepSeek V4 Pro 0813 on the CyberGym security benchmark. The test covered 697 common valid tasks; DeepSeek V4 Pro's reward rate was 53.7%, with a cost of $2.502 per successful task, about half that of Kimi K3. In the same batch of results, Kimi K3 had the highest reward rate at 68.4%, with a cost of $4.914 per successful task; GPT-5.5 had a reward rate of 47.6%, with a cost of $9.641 per successful task; Claude Opus 4.8 had a reward rate of 5.9%, with a cost of $33.275 per successful task. Fireworks AI also said that DeepSeek V4 Pro produced native tool calls on all 840 tasks, with no refusals or output truncation; once it passed first-stage validation, its rate of completing the full patch was 94.7%. There are currently no further developments.

English translation is being prepared.

View story:English translation is being prepared.

English translation is being prepared.

View story:English translation is being prepared.

English translation is being prepared.

View story:English translation is being prepared.

English translation is being prepared.

View story:English translation is being prepared.

English translation is being prepared.

View story:English translation is being prepared.

English translation is being prepared.

View story:English translation is being prepared.

English translation is being prepared.

View story:English translation is being prepared.

English translation is being prepared.

View story:English translation is being prepared.

English translation is being prepared.