Meaningful oversight of medical AI beyond human in the loop
Human oversight of medical AI is increasingly required, but clinician presence alone does not make oversight meaningful. We propose four interlocking conditions—epistemic capacity, cognitive space, decisional authority, and intervention effectiveness—that determine whether human judgment can function as a safety mechanism. Embedding these conditions across procurement, deployment, monitoring, and decommissioning can turn oversight into an operational patient-safety capability across predictive, generative, semi-autonomous, and agentic systems.
Authors
- Davy van de Sande (ORCID: https://orcid.org/0000-0003-4484-0995)
- Nicoleta Economou‐Zavlanos
- Michel E. van Genderen (ORCID: https://orcid.org/0000-0001-5668-3435)
Institutions
- Duke University (US)
- Erasmus MC (NL)
- Erasmus University Rotterdam (NL)
Publication Details
- Journal
- npj Digital Medicine
- Published
- 2026-07-23
- DOI
- https://doi.org/10.1038/s41746-026-02971-1
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 0.00