Artificial Analysis updates the MLCR-AA medical long-context leaderboard

Artificial Analysis updated the MLCR-AA medical long-context reasoning leaderboard on October 21, 2026. The leaderboard shows that Claude Sonnet 5.5 (max with fallback) and GPT-6 Astra (max) tie for first place with a 41.7% pass rate, followed closely by GPT-6.1 Sol (max) at 38.3%, while Qwen3.8 2.4T A95B leads open-weight models at 30.6%. This update changes the prompt to a medical record reviewer role, requires conclusions and evidence to be answered in the same paragraph, switches scoring to a three-model review panel, and rechecks 60 expert reference answers, revising 15 of them. The leaderboard also shows that the medical record review task remains far from solved: no model exceeds a 42% pass rate, and the median model is below 15%; Anthropic models sweep the top 18 for completeness, with Claude Sonnet 5.5 leading at 64.8%, and OpenAI models sweep the top 27 for accuracy, with GPT-6.1 Sol leading at 96.7%.

AI-generated from public reports

1. Oct 21· 1 reports

   Artificial Analysis updates the MLCR-AA leaderboard

   Source:Artificial Analysis