Fireworks AI publishes evaluation results of DeepSeek V4 Pro on CyberGym

On August 26, 2026, Fireworks AI published evaluation results of DeepSeek V4 Pro 0813 on the CyberGym security benchmark. The test covered 697 common valid tasks; DeepSeek V4 Pro's reward rate was 53.7%, with a cost of $2.502 per successful task, about half that of Kimi K3. In the same batch of results, Kimi K3 had the highest reward rate at 68.4%, with a cost of $4.914 per successful task; GPT-5.5 had a reward rate of 47.6%, with a cost of $9.641 per successful task; Claude Opus 4.8 had a reward rate of 5.9%, with a cost of $33.275 per successful task. Fireworks AI also said that DeepSeek V4 Pro produced native tool calls on all 840 tasks, with no refusals or output truncation; once it passed first-stage validation, its rate of completing the full patch was 94.7%. There are currently no further developments.

AI-generated from public reports

1. Aug 26· 1 reports

   Fireworks AI announces evaluation results of DeepSeek V4 Pro on CyberGym

   Source:Fireworks AI