←Story detail

Trending story

Artificial Analysis releases Coding Agent Index v2.0

2 reports2 discussions4 story updatesUpdated Oct 23 22:33

Understand this story

AI overview

On October 23, 2026, Artificial Analysis released Coding Agent Index v2.0, replacing DeepSWE with Cognition's FrontierCode v1.1 and tightening the repository question-answering scoring; the leaderboard evaluates model-plus-harness combinations. Reports that day showed Claude Code paired with Claude Opus 5.5 (max) topping the list with 61.7 points, Claude Code paired with Sonnet 5.5 second with 59.3 points, Muse Code paired with Muse Wonder Full at 58.9 points, and the first OpenAI combination, Codex paired with GPT-6 Astra, at 54.7 points. Regarding comparisons between the old and new leaderboards, earlier reports said the average score of 21 configurations fell from 58.8% to 57.1%; later reports said the mean for the same batch of 21 configurations dropped from 54.8 to 47.4, with 20 declining, and stated that the main reason was FrontierCode's mean of about 45.1%, far below DeepSWE's 65.6%.

AI-generated from public reports

Latest development · Report

Coding Agent Leaderboard Upgrade v2.0: Claude Opus 5.5 Leads at 61.7

Developments

1 confirmed developments

  1. Artificial Analysis releases Coding Agent Index v2.0

    Source:Shao Meng

Reports and discussion timeline

Browse reports and discussion by time. Their evidence levels remain distinct.

Oct 23

  1. Shao Meng

    Coding Agent Leaderboard Upgrade v2.0: Claude Opus 5.5 Leads at 61.7

    Artificial Analysis released Coding Agent Index v2.0, replacing DeepSWE with Cognition's FrontierCode v1.1 and tightening repository Q&A scoring; the leaderboard evaluates model-plus-harness combinations. Currently first is Claude Code + Claude Opus 5.5 (max) at 61.7, followed by Claude Code + Sonnet 5.5 at 59.3 and Muse Code + Muse Wonder Full at 58.9; the first OpenAI combination, Codex + GPT-6 Astra, is at 54.7. For the same 21 configurations, the mean across the old and new leaderboards fell from 54.8 to 47.4, with 20 declining, mainly because FrontierCode's mean is about 45.1%, far below DeepSWE's 65.6%.

  2. Shao MengRelated discussion

    Shao Meng joined this discussion

    This post contributes to heat; it is not a formal report or confirmed fact.

  3. TeortaxesRelated discussion

    Teortaxes joined this discussion

    This post contributes to heat; it is not a formal report or confirmed fact.

  4. Artificial Analysis

    Artificial Analysis Coding Agent Index v2.0: Claude Opus 5.5 tops with 61.7

    Artificial Analysis released Coding Agent Index v2.0, with Claude Code paired with Claude Opus 5.5 (max) topping at 61.7 points, followed by Claude Sonnet 5.5 (max) at 59.3 points. The new version replaces DeepSWE with Cognition's FrontierCode v1.1; Opus 5.5 scores 56.0% on that benchmark, ahead of Codex paired with DeepSeek V4.1 Flash at 52.6%. SWE-Atlas-QnA-AA switched to GPT-6 Luna (xhigh) for judging, with five votes per item; the average score across 21 configurations fell from 58.8% to 57.1%.

Heat trend for this story

Current
9
Period peak
24 Oct 23 23:00
24-hour change
-50%

Move the pointer or select the chart to inspect hourly heat. Use the left and right arrow keys with a keyboard.

Related stories

  1. Related storiesDeepSeek releases DeepSeek-V4.1-Flash-1017
  2. Related storiesMeta releases open-weight model Muse Spark Open
  3. Related storiesMistral releases Large 4 weights on Hugging Face
  4. Related storiesEnglish translation is being prepared.