ARC Prize announces evaluation results of DeepSeek V4.1 Flash 1017 on ARC-AGI
ARC Prize announces the validation results of DeepSeek V4.1 Flash 1017 on ARC-AGI: it scores 5.8% on ARC-AGI-3 at a cost of $1.2K (provider adapter harness), and 0.2% at $1.0K under the standard harness. The model leads open-weight models on ARC-AGI-3 with 5.81%, scores 78.1% on ARC-AGI-2, and ties for the highest open-weight score on ARC-AGI-1 with 94.5%. Compared with the original V4.1 Flash from September 10, 2026, 1017's ARC-AGI-3 semi-private set score rose from 2.68% to 5.81%, while its public set score fell from 11.05% to 8.97%.
Why read this
AI score 67
ARC Prize provides the scores and costs of DeepSeek V4.1 Flash 1017 on the three ARC-AGI benchmarks, and compares the changes against the previous version.
Topics
Body
DeepSeek V4.1 Flash 1017 from @deepseek_ai on ARC-AGI (Verified):
- ARC-AGI-3: 5.8%, $1.2K (provider adapter harness), 0.2%, $1.0K (standard harness)
It leads open-weight models on ARC-AGI-3 (5.81%) and ARC-AGI-2 (78.1%) and ties the best open-weight score on ARC-AGI-1 (94.5%). https://t.co/JhYiMC5xtZ