Microsoft's diagnostic AI outscored physicians on past cases, but has not yet been tested in hospitals
Hospital testing with Beth Israel Deaconess is planned within a couple of months, with no firm commercial timeline.
Microsoft says its Diagnostic Orchestrator, a multi-agent system built on OpenAI's GPT-5, reached about 83 percent accuracy on diagnostic cases from New England Journal of Medicine reports, versus roughly 36 percent for generalist physicians using references and 22 percent without them. On emergency department cases from Beth Israel Deaconess Medical Center in Boston, it scored 80 percent against an average of 47 percent for human doctors, and tended to reach diagnoses at lower estimated cost. The findings appear in the journal Science, but the system has so far only been tested on past cases and has not been validated in clinical settings. Microsoft plans to begin hospital testing with Beth Israel Deaconess within a couple of months, with no firm commercial timeline, and says regulatory compliance will shape any rollout.
Why it matters
The results so far come from past cases, not live patients, so the claim that the system beats doctors remains unproven in clinical use. For patients and clinicians, the open question is how the system performs in real emergency care and whether regulators approve it. Until hospital testing reports results, the published accuracy figures show what the system did on historical records, not what it will do at the bedside.
Matters or hype?
Does this story matter, or is it hype? Vote before you see what everyone else said.
Sources
- The Verge