ARC Prize announces evaluation results of DeepSeek V4.1 Flash 1017 on ARC-AGI
ARC Prize announced DeepSeek V4.1 Flash 1017's results on the ARC-AGI series of benchmarks: 5.81% on ARC-AGI-3, 78.1% on ARC-AGI-2, and 94.5% on ARC-AGI-1, leading among open-weight models. Compared with the original DeepSeek V4.1 Flash released on September 10, 2026, 1017's ARC-AGI-3 semi-private set score rose from 2.68% to 5.81%, while its public set score fell from 11.05% to 8.97%. At maximum reasoning effort, the reasoning tokens used by 1017 for its first action decreased by an average of 36% across 25 public games and by 48.6% across 55 semi-private games.
Why read this
AI score 55
ARC Prize provides DeepSeek V4.1 Flash 1017's scores on each version of ARC-AGI and the changes in reasoning tokens, which can be compared with its predecessor versions to see the extent of improvement.
Topics
Body
@deepseek_ai @baseten At max reasoning with the provider adapter harness, DeepSeek V4.1 Flash 1017 used 36% fewer reasoning tokens on its first action than the original, averaged across 25 public games. Across 55 semi-private games, it used 48.6% fewer reasoning tokens on the first action. https://t.co/Wye2tsLXJ7