Using Artificial Intelligence as Gatekeeper or Second Opinion: Designing Patient Pathways for Artificial Intelligence Augmented Healthcare

Of the 1,247 artificial intelligence (AI) systems cleared by the U.S. Food and Drug Administration as of May 2025, many function as classifiers to help screen or diagnose specific medical conditions. Yet, questions remain about how to best integrate AI into healthcare workflows, including whether AI should serve as a gatekeeper, determining which patients require human attention, or as a second opinion to complement medical consultations. Motivated by this question, we model a healthcare system in which patients can consult a specialist, an AI system, or both. The key design question is whether the patient should first consult AI or the specialist, corresponding to AI’s gatekeeper and second-opinion roles, respectively. We model a two-step decision-making process influenced by an initial signal, or anchor. Contrary to popular belief, we show using AI as a gatekeeper does not necessarily increase missed diagnoses; using AI as a second opinion, on the other hand, can increase missed diagnoses but can also increase false positives. In general, the gatekeeper approach is preferable in low-risk settings, whereas the second-opinion approach is better suited for high-risk patients for whom avoiding missed diagnoses is a primary concern. Notably, scenarios exist where AI should not be used for intermediate-risk patients for whom uncertainty is highest, challenging the premise that AI is most useful in reducing uncertainty. Finally, applying our model to glaucoma diagnosis, we numerically illustrate cost savings from optimizing patient pathways. Our work highlights the potential for AI to contribute to the United Nations’ Sustainable Development Goals by optimizing resource allocation and improving patient outcomes.

Authors

Institutions

Publication Details

Journal
Production and Operations Management
Published
2025-11-20
DOI
https://doi.org/10.1177/10591478251403269
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Using Artificial Intelligence as Gatekeeper or Second Opinion: Designing Patient Pathways for Artificial Intelligence Augmented Healthcare

Simrita Singh, Tinglong Dai
Production and Operations Management
Artificial Intelligence in Healthcare and Education
article

Using Artificial Intelligence as Gatekeeper or Second Opinion: Designing Patient Pathways for Artificial Intelligence Augmented Healthcare

Simrita Singh, Tinglong Dai
article en

Abstract

Of the 1,247 artificial intelligence (AI) systems cleared by the U.S. Food and Drug Administration as of May 2025, many function as classifiers to help screen or diagnose specific medical conditions. Yet, questions remain about how to best integrate AI into healthcare workflows, including whether AI should serve as a gatekeeper, determining which patients require human attention, or as a second opinion to complement medical consultations. Motivated by this question, we model a healthcare system in which patients can consult a specialist, an AI system, or both. The key design question is whether the patient should first consult AI or the specialist, corresponding to AI’s gatekeeper and second-opinion roles, respectively. We model a two-step decision-making process influenced by an initial signal, or anchor. Contrary to popular belief, we show using AI as a gatekeeper does not necessarily increase missed diagnoses; using AI as a second opinion, on the other hand, can increase missed diagnoses but can also increase false positives. In general, the gatekeeper approach is preferable in low-risk settings, whereas the second-opinion approach is better suited for high-risk patients for whom avoiding missed diagnoses is a primary concern. Notably, scenarios exist where AI should not be used for intermediate-risk patients for whom uncertainty is highest, challenging the premise that AI is most useful in reducing uncertainty. Finally, applying our model to glaucoma diagnosis, we numerically illustrate cost savings from optimizing patient pathways. Our work highlights the potential for AI to contribute to the United Nations’ Sustainable Development Goals by optimizing resource allocation and improving patient outcomes.

Production and Operations Management
Johns Hopkins University (US), Santa Clara University (US)
Openalex Percentile: Top 71%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.