←Story detail

Trending story

Artificial Analysis compares the medical long-text evaluation results of 14 models

1 reports1 story updatesUpdated Oct 22 10:04

Understand this story

AI overview

On October 22, 2026, Artificial Analysis compared the medical long-text performance of 14 models on two evaluations, MLCR-AA and HealthBench Professional. The results show that Claude Sonnet 5.5, Opus 5.5, and Fable 5.1 swept the top three spots for MLCR-AA completeness, leading the best OpenAI model by about 19 to 23 points; Opus and Sonnet scored 71.4% and 70.8% respectively on HealthBench Professional raw scores, slightly above GPT-6 Astra's 69.7%. OpenAI models, meanwhile, took the top spots for MLCR-AA accuracy; Anthropic models' single responses were about 4 to 6 times as long as OpenAI's, with accuracy of 19% to 61%, versus 89% to 97% for OpenAI. GPT-6 Astra (max) tied with Claude Sonnet 5.5 for first place on MLCR-AA and held a slight lead on the HealthBench Professional length-adjusted score; Claude Opus 5.5, however, fell from first on raw score to sixth on the length-adjusted score.

AI-generated from public reports

Latest development · Report

Anthropic's medical answers are more comprehensive, OpenAI's are more accurate and concise

Developments

1 confirmed developments

  1. Artificial Analysis compares medical long-text evaluation results of 14 models

    Source:Artificial Analysis

Reports and discussion timeline

Browse reports and discussion by time. Their evidence levels remain distinct.

Oct 22

  1. Artificial Analysis

    Anthropic's medical answers are more comprehensive, OpenAI's are more accurate and concise

    Artificial Analysis compared 14 models on MLCR-AA and HealthBench Professional: Claude Sonnet 5.5, Opus 5.5, and Fable 5.1 swept the top three spots for MLCR-AA completeness, leading the best OpenAI model by about 19-23 points; Opus and Sonnet scored 71.4% and 70.8% raw on HealthBench Professional, slightly above GPT-6 Astra's 69.7%. OpenAI models, meanwhile, took the top spots for MLCR-AA accuracy; Anthropic models' single responses were about 4-6 times longer than OpenAI's, with accuracy of only 19-61%, versus 89-97% for OpenAI. GPT-6 Astra (max) tied Claude Sonnet 5.5 for first place on MLCR-AA and held a slight lead on the HealthBench Professional length-adjusted score; Claude Opus 5.5, however, fell from first in raw score to sixth in length-adjusted score.

Related stories

  1. Related storiesArtificial Analysis updates the MLCR-AA medical long-context leaderboard
  2. Related storiesArtificial Analysis Launches CritPt v2 Benchmark
  3. Related storiesMiniMax releases the M3.1 Flash model
  4. Related storiesArtificial Analysis says the cost of reaching intelligence index thresholds is falling rapidly