AI Trends

ARC Prize announces that Inception AI's Mercury 3 Preview on…

ARC PrizeUpdated Nov 17 23:22

AI summary

ARC Prize announces the validation results of Inception AI's Mercury 3 Preview on ARC-AGI: ARC-AGI-1 score 88.5%, $0.03 per task; ARC-AGI-2 score 61.8%, $0.06 per task; ARC-AGI-3 score 0.2% (provider adapter, $299) and 0.1% (standard, $333). This is the first diffusion model evaluated by ARC Prize, with a maximum output speed of 1,743 tokens/second; at the instant reasoning tier, the ARC-AGI-2 public set averages 981 output tokens/second, with a single-call peak of 1,743 tokens/second (3,001 tokens output in 1.72 seconds), and averages 500-600 tokens/second with reasoning enabled.

Why read this

AI score 58

ARC Prize has published the results and per-task costs of the first diffusion model on the three ARC-AGI benchmarks, which can be compared against the existing leaderboard to determine its position.

Topics

Tags

Body

Mercury 3 Preview from @_inception_ai on ARC-AGI (Verified):

- ARC-AGI-3: 0.2%, $299 (provider adapter), 0.1%, $333 (standard) - ARC-AGI-2: 61.8%, $0.06/task - ARC-AGI-1: 88.5%, $0.03/task

It is the first diffusion model we've evaluated, delivering up to 1,743 tokens/second. https://t.co/Wqscy5zUrl

Source

ARC Prize