On emergency cases, GPT-5 alone scored 76.6%; inside Microsoft's system, 80.3%
Share of emergency cases diagnosed correctly in Microsoft's simulation, by who or what diagnosed them, in its October 22, 2026 study
Show the numbers as a table
| Category | Value |
|---|---|
| GPT-5 inside Microsoft's MAI-DxO | 80.3% |
| GPT-5 alone, with a basic prompt | 76.6% |
| Generalist physicians, with reference materials | 46.8% |
About the data
- Sources
- Microsoft AI, Building Medical Superintelligence, October 22, 2026 (opens in a new tab)Figure 2 table, Emergency Department cases (Models evaluated October 2025): GPT-5, MAI-DxO (no budget), Clinicians, open book (average)
- Microsoft, MIMIC-IV-Ext-SDBench (PhysioNet, version 1.0.0) (opens in a new tab)Usage Notes: the baseline agent and the Diagnostic Orchestrator with GPT-5 on the 325 validation and test cases
- Nori and others, Sequential diagnosis with language models, Science, October 22, 2026 (opens in a new tab)Abstract: generalist physicians on MIMIC-IV-ED emergency department admissions
- Method
- Each case starts from a short summary of an emergency department visit that ended in a hospital admission, taken from MIMIC-IV, a database of de-identified hospital records used for research. The doctor or AI asks questions and orders tests, an AI model answers from the patient's discharge summary, and another AI model grades the final diagnosis. The two GPT-5 figures cover the 325 cases Microsoft reports results on. The physicians' figure is the average for clinicians working with reference materials, from Microsoft's results table and the study's abstract, neither of which says how many of the cases the physicians worked. In the same dataset notes, the average estimated cost of the tests ordered was about $4,240 a case for GPT-5 alone and $4,980 inside MAI-DxO.
- Published
Free to share and embed with credit to Kent Applied (CC BY 4.0). The source data keeps its own terms.
Related charts
- From the blog
Benchmarks cover 12 of 89 healthcare practitioner jobs, 0 of 19 healthcare support jobs
Mercor, A benchmark map of the US economy - From the blog
OpenAI cut GPT-5.6 Luna's output price by 80% in July 2026
OpenAI, API changelog (July 30, August 21 and September 29, 2026); OpenAI, GPT-5.6 Luna model page; Max Woolf, OpenAI and Anthropic cut their LLM prices by up to 80% within a few months (October 25, 2026); Anthropic, Claude Opus 5.5 (September 22, 2026) - From research
The 320% documentation AI growth figure compares plans with current use
Healthcare Dive, sponsored content by Microsoft, March 10, 2025; Kent Applied, Where healthcare AI has proof, and where it does not - From the blog
In this worked example, building costs $94,000 less than buying over three years
Kent Applied, How to score an AI vendor before the demo
Sources for the figures above: OpenAI, API changelog (July 30, August 21 and September 29, 2026) (opens in a new tab); OpenAI, GPT-5.6 Luna model page (opens in a new tab); Max Woolf, OpenAI and Anthropic cut their LLM prices by up to 80% within a few months (October 25, 2026) (opens in a new tab); This healthcare AI use case will grow 320% by 2026, survey finds (opens in a new tab).
Book a 20-minute call
Tyler Kent can measure a question like this one in your own data. Start with a short call.
Prefer to skip the call? Get a written proposal
Or email tyler@kentapplied.com.