←News detail

Artificial AnalysisUpdated Oct 30 14:22

Artificial Analysis releases the Progress Index…

AI summary

Artificial Analysis releases the Progress Index and simultaneously launches Intelligence Index v5. The Progress Index uses item response theory to estimate a general capability score for each model from all evaluations (including tasks that have been retired or not included in the Intelligence Index), for cross-time comparison; the Intelligence Index is still used to measure the intelligence level of current models. Its data shows that after the emergence of reasoning models, the frontier has improved by about 65 to 70 points per year, roughly twice the 2023 rate; open-weight models typically lag closed-source models by about 4 months, and DeepSeek V4.1 Flash 1017 ranks highest among open-weight models with 324 points.

Why read this

AI score 53

Artificial Analysis uses the same capability scale to trace back models since 2022, providing a quantitative reference for the pace of frontier growth and open-source catch-up.

Topics

Tags

Body

We’ve announced the Artificial Analysis Progress Index: a single capability scale for every language model since 2022, launched alongside Intelligence Index v5

The Intelligence Index is still our primary measure of current model intelligence. It uses the evaluations most relevant to developers today, so its mix changes as evaluations are added and retired, and scores from different versions can’t be compared.

The Progress Index is built for comparisons across time. It uses item response theory, a statistical method used to score standardized tests, to estimate one general capability score for each model from the underlying tasks in all our evaluations, including those that are retired or excluded from the Intelligence Index.

Use the Intelligence Index to choose a model today. Use the Progress Index to see how capability has changed over time.

The Progress Index builds on prior work placing models on a single capability scale, in particular @EpochAIResearch's Epoch Capabilities Index and the capability scale @AnthropicAI published in its Claude Mythos Preview system card.

Key takeaways:

➤ Since reasoning models arrived, the frontier has risen ~65 to 70 points a year, about double the 2023 pace: the highest score among released models rose 35 points in 2023 (GPT-3.5 Turbo 125 to GPT-4 Turbo 160), 67 in 2024 (to o1 at 228), 68 in 2025 (to GPT-5.2 at 296) and 56 so far in 2026 (to Gemini 4 Carbon at 352).

➤ Open weights models generally trail proprietary models by about 4 months: since January 2025, each new highest open weights score came 2-8 months (median ~4) after a proprietary model first reached it. DeepSeek V4.1 Flash 1017 is the highest-scoring model with released weights at 324, a level Claude Fable 5 reached in June 2026. Kimi K3.1 Pro (weights not yet released) scores 341, about two months after the closed frontier

➤ New frontier scores are being set more often: the highest score among released models was raised on 2 release dates in 2023, 4 in 2024, 9 in 2025 and 11 so far in 2026. That is about once every four weeks this year.

➤ OpenAI has held the top score most of the time since November 2022, but the frontier has become a close contest: OpenAI held the number one position for the first 27 months measured, but in 2026 especially there have been rapid changes in the leader between OpenAI, Anthropic, and now Google

Source

Artificial Analysis