The arc of uncertainty across clinicians’ interactions with AI

Large language models (LLMs) are increasingly being used in various clinical settings to support clinical reasoning and decision-making. Although they have demonstrated strong performance on medical knowledge and reasoning tasks, and early studies suggest potential to reduce medical errors, emerging evidence also highlights important safety concerns, including clinically significant management errors in outputs that may not be readily apparent to users. How these tools can be integrated into clinical practice to consistently lead to improved patient outcomes remains an open question. AI-assisted reasoning unfolds across a sequence of decisions: whether to use AI for the clinical question, how to engage with the tool, how to interpret its output, and whether to act. Each stage in this sequence introduces distinct risks, including inappropriate tool selection, incomplete or biased inputs, overconfidence in fluent responses, and failure to recognize error or appreciate nuance. These risks are further shaped by the same clinician factors that generally affect clinical reasoning such as experience, workload, and uncertainty management. Viewing the AI-clinician interaction as a process rather than a single moment highlights several key points of vulnerability but also opportunities for training. Ultimately, the safe use of AI may depend less on the quality of the model and more on the clinician’s ability to recognize when its outputs should be questioned, verified, or set aside.

Authors

Institutions

Publication Details

Journal
Discover Artificial Intelligence
Published
2026-11-21
DOI
https://doi.org/10.1007/s44163-026-02851-3
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

The arc of uncertainty across clinicians’ interactions with AI

Jonathan Seth Ilgen, Ryan W. Hunton, Tama Thé
Discover Artificial Intelligence
Artificial Intelligence in Healthcare and Education
article

The arc of uncertainty across clinicians’ interactions with AI

Jonathan Seth Ilgen, Ryan W. Hunton, Tama Thé
article en

Abstract

Large language models (LLMs) are increasingly being used in various clinical settings to support clinical reasoning and decision-making. Although they have demonstrated strong performance on medical knowledge and reasoning tasks, and early studies suggest potential to reduce medical errors, emerging evidence also highlights important safety concerns, including clinically significant management errors in outputs that may not be readily apparent to users. How these tools can be integrated into clinical practice to consistently lead to improved patient outcomes remains an open question. AI-assisted reasoning unfolds across a sequence of decisions: whether to use AI for the clinical question, how to engage with the tool, how to interpret its output, and whether to act. Each stage in this sequence introduces distinct risks, including inappropriate tool selection, incomplete or biased inputs, overconfidence in fluent responses, and failure to recognize error or appreciate nuance. These risks are further shaped by the same clinician factors that generally affect clinical reasoning such as experience, workload, and uncertainty management. Viewing the AI-clinician interaction as a process rather than a single moment highlights several key points of vulnerability but also opportunities for training. Ultimately, the safe use of AI may depend less on the quality of the model and more on the clinician’s ability to recognize when its outputs should be questioned, verified, or set aside.

Discover Artificial IntelligenceVol. 6(1)
University of Kentucky (US)
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
The arc of uncertainty across clinicians’ interactions with AI — Jonathan Seth Ilgen, Ryan W. Hunton, et al. · Discover Artificial Intelligence (2026) | TGRS Research Map | TGRS