Understand this story
Satya Nadella said that the team's research on a diagnostic orchestrator has been published in Science. Related reports show that in a peer-reviewed study published in Science, Microsoft's MAI-DxO diagnostic system achieved a diagnostic accuracy of 83.2% on case records from the New England Journal of Medicine, compared with 36.1% for general practitioners using reference resources. The study proposed the Sequential Diagnosis Benchmark (SDBench), which converts 304 journal cases and 325 MIMIC-IV-ED emergency cases into step-by-step diagnostic tasks in which questions can be asked and tests ordered progressively, and scores them by accuracy and testing cost. DxO paired with GPT-5 cost an average of $5,431 per case under no budget constraints; the authors also noted that the comparison did not involve specialists, multidisciplinary teams, or real clinical practice. Other reports state that Mustafa Suleyman said the system's diagnostic accuracy in emergency scenarios is 1.7 times that of doctors, with lower costs and fewer medical tests required. There are currently no subsequent developments.
AI-generated from public reports
Developments
1 confirmed developments
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Oct 23
Cailian Press
Microsoft's AI diagnostic tool simulates a doctor's step-by-step questioning, with accuracy on complex cases about twice that of general practitioners
Microsoft's research team published in the journal Science an AI diagnostic tool powered by GPT-5, which achieved a diagnostic accuracy of about 83% on complex cases selected from the New England Journal of Medicine, compared with about 36% for general practitioners with reference materials and about 22% without them. Through a mechanism called the "Diagnostic Coordinator," the tool simulates multiple clinical experts analyzing cases collaboratively, deciding step by step which medical history to ask about and which tests to order, and continuously updating diagnostic hypotheses. The research team's next step is to collaborate with Boston's Beth Israel Deaconess Medical Center to test emergency triage capabilities; Microsoft has not yet specified the timing or form of commercialization.
IT Home · AIRelated discussion
IT Home · AI joined this discussion
This post contributes to heat; it is not a formal report or confirmed fact.
Phoenix TechnologyRelated discussion
Phoenix Technology joined this discussion
This post contributes to heat; it is not a formal report or confirmed fact.
cnBetaRelated discussion
cnBeta joined this discussion
This post contributes to heat; it is not a formal report or confirmed fact.
Unite.AISelected
Microsoft MAI-DxO diagnostic system exceeds general practitioners in accuracy in Science study
In a peer-reviewed study published in Science, the Microsoft MAI-DxO diagnostic system achieved a diagnostic accuracy of 83.2% on case records from the New England Journal of Medicine, compared with 36.1% for general practitioners using reference resources. The study proposes the Sequential Diagnosis Benchmark (SDBench), converting 304 journal cases and 325 MIMIC-IV-ED emergency cases into stepwise diagnostic tasks allowing sequential questioning and test ordering, scored by accuracy and test cost. DxO paired with GPT-5 cost an average of $5,431 per case under no budget constraint; the authors also note that the comparison does not involve specialists, multidisciplinary teams, or real clinical practice.
Satya Nadella
Microsoft Diagnostic Orchestrator Published in Science: Improving Accuracy and Reducing Costs
Satya Nadella reposted Mustafa Suleyman's post, introducing the team's work published in Science: the MAI Diagnostic system achieves 1.7 times the diagnostic accuracy of physicians in emergency department settings, at lower cost and requiring fewer tests. Nadella said the diagnostic orchestrator can reason through complex cases, improving diagnostic accuracy while reducing testing costs.
Mustafa SuleymanSelected
Microsoft MAI Diagnostic Achieves 1.7x Physicians' Diagnostic Accuracy in Emergency Care
Mustafa Suleyman said that the MAI Diagnostic system achieved 1.7 times the diagnostic accuracy of physicians in emergency department (ED) settings, even when physicians were allowed to search the internet. The system costs less and requires fewer medical tests to make a diagnosis. The related results have been published in the journal Science.
The Verge AI
Microsoft AI diagnostic tool publishes research in Science, claims accuracy up to four times that of human doctors
Microsoft has announced the research results of its AI diagnostic tool Diagnostic Orchestrator, which uses multiple AI agents to collaboratively reason about symptoms, decide on tests, and provide diagnoses, and is based on OpenAI's GPT-5. In tests drawn from hundreds of case reports from the New England Journal of Medicine, the system's diagnostic accuracy was about 83%, compared with about 36% for general practitioners who used reference materials and about 22% for those who did not; on emergency cases from Beth Israel Deaconess Medical Center in Boston, its accuracy was 80%, compared with an average of 47% for human doctors, and the system's estimated cost for reaching a diagnosis was lower. Microsoft will open-source its self-built benchmark SDBench and plans to conduct tests with Beth Israel Deaconess Medical Center in a hospital setting in the coming months, but the system has so far been validated only on historical cases and still requires clinical validation.
Heat trend for this story
- Current
- 13
- Period peak
- 43 Oct 23 09:00
- 24-hour change
- —
Move the pointer or select the chart to inspect hourly heat. Use the left and right arrow keys with a keyboard.