Understand this story
Artificial Analysis has launched leaderboards for OpenAI's two health dialogue benchmarks, HealthBench and HealthBench Professional. HealthBench contains 5,000 conversations with general users and health workers, while HealthBench Professional consists of 525 conversations all aimed at clinicians. The leaderboard results show that on HealthBench Professional, GPT-6 Astra (max) ranks first with a length-adjusted score of 66.0%, followed by GPT-6.1 Sol (max) at 65.1% and Claude Sonnet 5.5 (max with fallback) at 63.0%; on HealthBench, Claude Sonnet 5.5 (max with fallback) leads with 62.1%, while DeepSeek V4.1 Flash (max) scores 60.9%. In addition, Claude Opus 5.5 and Claude Fable 5.1 give average answers of about 5,900 characters, losing more than 11 points after length adjustment. There are currently no further developments.
AI-generated from public reports
Latest development · Report
English translation is being prepared.Developments
1 confirmed developments
Artificial Analysis launches HealthBench and HealthBench Professional leaderboards
Source:Artificial Analysis (full article)
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Oct 20
artificialanlys
English translation is being prepared.
Oct 19
Artificial Analysis full articleFirst-partySelected
Artificial Analysis launches HealthBench and HealthBench…
Artificial Analysis has launched leaderboards for OpenAI's two health dialogue benchmarks, HealthBench and HealthBench Professional; the former contains 5,000 conversations with general users and health workers, while the latter consists of 525 conversations all aimed at clinicians. On HealthBench Professional, GPT-6 Astra (max) ranks first with a length-adjusted score of 66.0%, GPT-6.1 Sol (max) is at 65.1%, and Claude Sonnet 5.5 (max with fallback) is at 63.0%. On HealthBench, Claude Sonnet 5.5 (max with fallback) leads at 62.1%, while DeepSeek V4.1 Flash (max) is at 60.9%; Claude Opus 5.5 and Claude Fable 5.1 average about 5,900 characters per answer and lose more than 11 points after length adjustment.