AI News

Trending story Continuously updated

ARC Prize announces the ARC-AGI evaluation results of Inkling 2 Small

2 reports1 discussions3 story updatesUpdated Nov 17 05:34

Understand this story

AI overview

ARC Prize has announced the evaluation results of thinkymachines' Inkling 2 Small on ARC-AGI (Verified). On ARC-AGI-3, using the provider adapter, the score was 2.6% with a total cost of $704; under the standard configuration, it was 0.3% with a total cost of $858. The model achieved 96.5% on ARC-AGI-1, higher than DeepSeek V4.1 Flash 1017's 94.5%; it achieved 81.7% on ARC-AGI-2, higher than the latter's 78.1%; but on ARC-AGI-3 it lagged behind the latter's 5.8% with 2.6%. There are currently no further developments.

AI-generated from public reports

Latest update · Discussion

Teortaxes joined this discussion

Developments

1 confirmed developments

  1. ARC Prize announces evaluation results of Inkling 2 Small on ARC-AGI

    Source:ARC Prize

Reports and discussion timeline

Browse reports and discussion by time. Their evidence levels remain distinct.

Nov 17

  1. TeortaxesRelated discussion

    Teortaxes joined this discussion

    This post contributes to heat; it is not a formal report or confirmed fact.

  2. ARC PrizeFirst-party

    ARC Prize announces Inkling 2 Small's ARC-AGI-3 results

    ARC Prize announces the results of thinkymachines' Inkling 2 Small on ARC-AGI-3: 2.6% with the provider adapter, at a total cost of $704; 0.3% under the standard configuration, at a total cost of $858. The model surpasses DeepSeek V4.1 Flash 1017 on ARC-AGI-1 (96.5% vs 94.5%) and ARC-AGI-2 (81.7% vs 78.1%), but trails on ARC-AGI-3 (2.6% vs 5.8%).

  3. ARC PrizeFirst-party

    Inkling 2 Small's results on the three ARC-AGI benchmarks

    ARC Prize announced the results of thinkymachines' Inkling 2 Small on ARC-AGI (Verified): ARC-AGI-3 scored 2.6% with a total cost of $704 (provider adapter), and 0.3% with a total cost of $858 in standard mode. The model surpasses DeepSeek V4.1 Flash 1017 on ARC-AGI-1 (96.5% vs 94.5%) and ARC-AGI-2 (81.7% vs 78.1%), but trails on ARC-AGI-3 (2.6% vs 5.8%).

Heat trend for this story

Not enough continuous observations to show a trend.

Related stories

  1. Related storiesARC Prize announces the results of three ARC-AGI evaluations of Inkling 2 Small
  2. Related storiesQwen Releases Qwen4-Max Preview Version
  3. Related storiesBaidu Wenxin releases ERNIE 5.5 Flash Preview
  4. Related storiesArena.ai teased the upcoming release of Tencent Hunyuan Hy4, and Tencent Hunyuan subsequently launched the official version