←Search results

By relevance · Total 1346 results Clear search

Sunday

  1. Story4 reports · 2 facts

    Fireworks evaluates DeepSeek's new model

    On September 14, 2026, Fireworks AI released and evaluated DeepSeek-V4.1-Flash. According to its published results, the model achieves 74.34% pass@1 on DeepSWE, on par with GPT-6-Astra's 74.12%; its cost per task is $0.43, about 1/15 that of Astra. The model is a 552B-parameter MoE, using separate activation budgets of 8B for input and 16B for output, and its KV Cache HBM footprint is reduced to 1/4 that of the previous-generation V4. On HLE it scores 34.52%, below Astra's 50.40%, and Fireworks considers it better suited to agentic coding than to highly difficult reasoning. On September 28, Fireworks AI released its first cache-aware router, FireRouter with Opus, which is now live in the CLI and offered for the first time as a standalone routing model; it can select among Claude Opus 5.5, GLM 5.3 and GLM 5.3 Flash based on task fit, prompt cache cost and switching cost; its internal A/B testing over more than a month showed coding task cost per session dropping from $15.36 to $6.63, a 57% reduction (±19 percentage points), with accuracy at pure O

    On September 14, 2026, Fireworks AI released and evaluated DeepSeek-V4.1-Flash. According to its published results, the model achieves 74.34% pass@1 on DeepSWE, on par with GPT-6-Astra's 74.12%; its cost per task is $0.43, about 1/15 that of Astra. The model is a 552B-parameter MoE, using separate activation budgets of 8B for input and 16B for output, and its KV Cache HBM footprint is reduced to 1/4 that of the previous-generation V4. On HLE it scores 34.52%, below Astra's 50.40%, and Fireworks

    Matched fieldsTitle

  2. Story2 reports · 1 facts

    DeepSeek V4 Pro leads in code evaluation

    On August 26, 2026, Fireworks AI released evaluation results for DeepSeek V4 Pro 0813 and announced that training support for the model is now live on Fireworks, supporting SFT, DPO, and RFT. The evaluation used four benchmark suites: SWE-Bench Verified, LiveCodeBench v6, Aider Polyglot, and Terminal-Bench 2.1. Fireworks stated that DeepSeek V4 Pro scored 95.2% on SWE-Bench Verified, higher than Kimi K3's 92.6% and Fable 5's 85.4%; on LiveCodeBench v6 it scored 92.0%. In terms of cost, the model spent $0.309 per task solved on SWE-Bench, compared with $0.808 for Fable 5; on LiveCodeBench the figures were $0.040 and $0.225, respectively. On a combined sample of 409 tasks, the oracle routing accuracy of DeepSeek V4 Pro and Fable 5 was 92.4%, higher than the 86.6% achieved by Fable 5 alone, with a per-task cost

    On August 26, 2026, Fireworks AI released evaluation results for DeepSeek V4 Pro 0813 and announced that training support for the model is now live on Fireworks, supporting SFT, DPO, and RFT. The evaluation used four benchmark suites: SWE-Bench Verified, LiveCodeBench v6, Aider Polyglot, and Terminal-Bench 2.1. Fireworks stated that DeepSeek V4 Pro scored 95.2% on SWE-Bench Verified, higher than Kimi K3's 92.6% and Fable 5's 85.4%; on LiveCodeBench v6 it scored 92.0%. In terms of cost, the model

    Matched fieldsTitle

Friday

Monday

  1. FactRelated story

    Fireworks evaluates DeepSeek's new model

    On September 14, 2026, Fireworks AI released and evaluated DeepSeek-V4.1-Flash. According to its published results, the model achieves 74.34% pass@1 on DeepSWE, on par with GPT-6-Astra's 74.12%; its cost per task is $0.43, about 1/15 that of Astra. The model is a 552B-parameter MoE, using separate activation budgets of 8B for input and 16B for output, and its KV Cache HBM footprint is reduced to 1/4 that of the previous-generation V4. On HLE it scores 34.52%, below Astra's 50.40%, and Fireworks considers it better suited to agentic coding than to highly difficult reasoning. On September 28, Fireworks AI released its first cache-aware router, FireRouter with Opus, which is now live in the CLI and offered for the first time as a standalone routing model; it can select among Claude Opus 5.5, GLM 5.3 and GLM 5.3 Flash based on task fit, prompt cache cost and switching cost; its internal A/B testing over more than a month showed coding task cost per session dropping from $15.36 to $6.63, a 57% reduction (±19 percentage points), with accuracy at pure O

    Matched fieldsTitle

    View story:Fireworks evaluates DeepSeek's new model

Thursday

Wednesday

  1. FactRelated story

    DeepSeek V4 Pro leads in code evaluation

    On August 26, 2026, Fireworks AI released evaluation results for DeepSeek V4 Pro 0813 and announced that training support for the model is now live on Fireworks, supporting SFT, DPO, and RFT. The evaluation used four benchmark suites: SWE-Bench Verified, LiveCodeBench v6, Aider Polyglot, and Terminal-Bench 2.1. Fireworks stated that DeepSeek V4 Pro scored 95.2% on SWE-Bench Verified, higher than Kimi K3's 92.6% and Fable 5's 85.4%; on LiveCodeBench v6 it scored 92.0%. In terms of cost, the model spent $0.309 per task solved on SWE-Bench, compared with $0.808 for Fable 5; on LiveCodeBench the figures were $0.040 and $0.225, respectively. On a combined sample of 409 tasks, the oracle routing accuracy of DeepSeek V4 Pro and Fable 5 was 92.4%, higher than the 86.6% achieved by Fable 5 alone, with a per-task cost

    Matched fieldsTitle

    View story:DeepSeek V4 Pro leads in code evaluation

  2. FactRelated story

    Fireworks AI announces evaluation results of DeepSeek V4 Pro on CyberGym

    On August 26, 2026, Fireworks AI published evaluation results of DeepSeek V4 Pro 0813 on the CyberGym security benchmark. The test covered 697 common valid tasks; DeepSeek V4 Pro's reward rate was 53.7%, with a cost of $2.502 per successful task, about half that of Kimi K3. In the same batch of results, Kimi K3 had the highest reward rate at 68.4%, with a cost of $4.914 per successful task; GPT-5.5 had a reward rate of 47.6%, with a cost of $9.641 per successful task; Claude Opus 4.8 had a reward rate of 5.9%, with a cost of $33.275 per successful task. Fireworks AI also said that DeepSeek V4 Pro produced native tool calls on all 840 tasks, with no refusals or output truncation; once it passed first-stage validation, its rate of completing the full patch was 94.7%. There are currently no further developments.

    Matched fieldsTitle

    View story:Fireworks AI publishes evaluation results of DeepSeek V4 Pro on CyberGym

Friday

  1. Story1 reports · 1 facts

    Fireworks AI publishes evaluation results of DeepSeek V4 Pro on CyberGym

    On August 26, 2026, Fireworks AI published evaluation results of DeepSeek V4 Pro 0813 on the CyberGym security benchmark. The test covered 697 common valid tasks; DeepSeek V4 Pro's reward rate was 53.7%, with a cost of $2.502 per successful task, about half that of Kimi K3. In the same batch of results, Kimi K3 had the highest reward rate at 68.4%, with a cost of $4.914 per successful task; GPT-5.5 had a reward rate of 47.6%, with a cost of $9.641 per successful task; Claude Opus 4.8 had a reward rate of 5.9%, with a cost of $33.275 per successful task. Fireworks AI also said that DeepSeek V4 Pro produced native tool calls on all 840 tasks, with no refusals or output truncation; once it passed first-stage validation, its rate of completing the full patch was 94.7%. There are currently no further developments.

    On August 26, 2026, Fireworks AI published evaluation results of DeepSeek V4 Pro 0813 on the CyberGym security benchmark. The test covered 697 common valid tasks; DeepSeek V4 Pro's reward rate was 53.7%, with a cost of $2.502 per successful task, about half that of Kimi K3. In the same batch of results, Kimi K3 had the highest reward rate at 68.4%, with a cost of $4.914 per successful task; GPT-5.5 had a reward rate of 47.6%, with a cost of $9.641 per successful task; Claude Opus 4.8 had a rewar

    Matched fieldsTitle

Friday

Thursday

Sunday