←News detail

ARC PrizeUpdated Nov 3 05:26

ARC Prize announces evaluation results of DeepSeek V4.1 Flash 1017 on ARC-AGI

AI summary

ARC Prize announces the verified results of DeepSeek V4.1 Flash 1017 on ARC-AGI: ARC-AGI-2 at 78.1% with $0.16 per task, ARC-AGI-1 at 94.5% with $0.06 per task, and ARC-AGI-3 at 5.8% with $1.2K under the provider adapter harness and 0.2% with $1.0K under the standard harness. The model leads open-weight models on ARC-AGI-3 and ARC-AGI-2, and matches the best score of open-weight models on ARC-AGI-1. Compared with the original V4.1 Flash from September 10, 2026, 1017's ARC-AGI-3 semi-private set score rose from 2.68% to 5.81%, while its public set score fell from 11.05% to 8.97%; at maximum reasoning effort, the reasoning tokens consumed by its first action decreased by an average of 36% across 25 public games and by 48.6% across 55 semi-private games.

Why read this

SelectedAI score 71

ARC Prize provides DeepSeek V4.1 Flash 1017's scores and per-task costs across three generations of ARC-AGI, allowing comparison with its predecessor versions to see the magnitude of improvement.

Topics

Tags

Quoted post

ARC Prize

@arcprize

DeepSeek V4.1 Flash 1017 from @deepseek_ai on ARC-AGI (Verified): - ARC-AGI-2: 78.1%, $0.16/task - ARC-AGI-1: 94.5%, $0.06/task The best ARC-AGI-2 scores for DeepSeek's Flash models rose from 61.4% (V4 Flash 0731) to 72.9% (V4.1 Flash) to 78.1% (V4.1 Flash 1017). https://t.co/MBV2fRytBl

View original

DeepSeek V4.1 Flash 1017 from @deepseek_ai on ARC-AGI (Verified): - ARC-AGI-2: 78.1%, $0.16/task - ARC-AGI-1: 94.5%, $0.06/task The best ARC-AGI-2 scores for DeepSeek's Flash models rose from 61.4% (V4 Flash 0731) to 72.9% (V4.1 Flash) to 78.1% (V4.1 Flash 1017). https://t.co/MBV2fRytBl

View original post

Body

@deepseek_ai @baseten DeepSeek V4.1 Flash 1017's performance on ARC-AGI-1 and ARC-AGI-2:

https://t.co/LzmoeIcpLD

Source

ARC Prize