Microsoft AI diagnostic tool publishes research in Science, claims accuracy up to four times that of human doctors
Microsoft has announced the research results of its AI diagnostic tool Diagnostic Orchestrator, which uses multiple AI agents to collaboratively reason about symptoms, decide on tests, and provide diagnoses, and is based on OpenAI's GPT-5. In tests drawn from hundreds of case reports from the New England Journal of Medicine, the system's diagnostic accuracy was about 83%, compared with about 36% for general practitioners who used reference materials and about 22% for those who did not; on emergency cases from Beth Israel Deaconess Medical Center in Boston, its accuracy was 80%, compared with an average of 47% for human doctors, and the system's estimated cost for reaching a diagnosis was lower. Microsoft will open-source its self-built benchmark SDBench and plans to conduct tests with Beth Israel Deaconess Medical Center in a hospital setting in the coming months, but the system has so far been validated only on historical cases and still requires clinical validation.
#Papers/Research#Agents#OpenAI
