ARC Prize tests Meta Spark Open: ARC-AGI-2 score 57.5%, cost about 9 times that of models with the same score
ARC Prize tested Meta Spark Open on ARC-AGI: it scored 89.0% on ARC-AGI-1, 57.5% on ARC-AGI-2, and only 0.4% on ARC-AGI-3. Its v1/v2 scores are close to those of Haiku 5.5 and GPT-6 Luna, but its cost is about 9 times theirs. Across providers on OpenRouter, the model costs $1.25/M for input and $4.25/M for output, while Haiku 5.5 and GPT-6 Luna both cost $0.10/M for input and $0.50/M for output. As the reasoning tier increases, ARC-AGI-2 rises from 29.4% at medium (averaging 55k tokens/task) to 57.2% at xhigh (180k tokens/task).
Why read this
SelectedAI score 60
ARC Prize gives Meta Spark Open's scores on each version of ARC-AGI and its per-task cost, which can be directly compared with the prices of competitors with the same scores.
Topics
Body
@AIatMeta Meta Spark Open costs $1.25/M input, $4.25/M output on all providers listed on OpenRouter including @Baseten where we tested it. For comparison, Haiku 5.5 and GPT-6 Luna both cost $0.10/M input, $0.50/M output.
Full results: https://t.co/MHQYZ73Nyw https://t.co/R9gr1uXvKC