Microsoft AI releases the MAI-DxO diagnostic system and the SDBench benchmark, with results published in Science
Microsoft AI has released the AI diagnostic system MAI-DxO and the step-by-step diagnostic benchmark SDBench, with the related results published in Science. On 304 complex NEJM cases, MAI-DxO achieved a diagnostic accuracy of 83%, compared with 36% for doctors with external reference materials and 22% without reference materials; on common emergency cases in MIMIC-IV-ED, MAI-DxO scored 80%, compared with 47% for doctors. The system selects examination items step by step through multi-round debates among multiple virtual doctors, and still achieves 81% accuracy under a cost-optimized configuration at less than half the cost of comparison systems, and it has open-sourced the benchmark and scoring code for the SDBench subset of NEJM cases.
Microsoft AI has released the AI diagnostic system MAI-DxO and the step-by-step diagnostic benchmark SDBench, with the related results published in Science. On 304 complex NEJM cases, MAI-DxO achieved a diagnostic accuracy of 83%, compared with 36% for doctors with external reference materials and 22% without reference materials; on common emergency cases in MIMIC-IV-ED, MAI-DxO scored 80%, compared with 47% for doctors. The system selects examination items step by step through multi-round debat
Matched fieldsTitle