Hallucinated Evidence and Real-World Risk—Physicians’ Intent to Act on AI-Generated Abstracts in Emergency Medicine and Trauma Surgery: Cross-Sectional, Vignette-Based Diagnostic Accuracy Study

BACKGROUND: Large language models (LLMs) are increasingly used in academic writing and can generate linguistically polished but factually incorrect scientific content. Such misinformation may distort evidence appraisal and, if translated into clinical practice, compromise patient care. OBJECTIVE: This study aimed to estimate physicians' likelihood of misperceiving false information embedded in LLM-generated abstracts as true and reporting an intent to use that information in future practice. We also explored which features were associated with perceived credibility and intended clinical action. METHODS: We conducted a cross-sectional, vignette-based survey of physicians working in emergency medicine and trauma surgery across 4 hospitals in Germany. Each participant assessed 4 abstracts generated using GPT-5 Thinking mode, of which 2 contained intentionally false claims supported by plausible explanations and 2 contained accurate claims. The primary outcome was the proportion of physicians reporting an intent to use or act on recommendations contained in abstracts with false claims. Secondary outcomes included perceived accuracy, rejection of accurate claims, and ratings of precision, structure, and grammar. RESULTS: Twenty physicians provided 80 ratings of 4 abstracts. Overall, physicians reported that they would act on 68% (54/80) of abstracts. Using abstract truth status as the reference, the decision to act had a sensitivity of 78% (31/40), specificity of 43% (17/40), positive predictive value of 57% (31/54), and negative predictive value of 65% (17/26). The positive likelihood ratio was 1.35 (95% CI 0.98-1.85), the negative likelihood ratio was 0.53 (95% CI 0.27-1.04), and the diagnostic odds ratio was 2.55 (95% CI 0.96-6.73). True and false abstracts received similar ratings for perceived accuracy (mean 3.15, SD 0.89 vs mean 2.88, SD 1.04; P=.21), precision (mean 3.15, SD 0.89 vs mean 2.93, SD 1.00; P=.29), structure (mean 3.23, SD 0.77 vs mean 3.20, SD 0.88; P=.89), and grammar (mean 3.40, SD 0.59 vs mean 3.43, SD 0.68; P=.86). Abstracts that physicians intended to act on were rated substantially higher for perceived accuracy, precision, and structure than those they would not act on (all P<.001), whereas grammar ratings did not differ (P=.80). CONCLUSIONS: Physicians frequently reported an intent to act on LLM-generated abstracts containing false claims, and true and false abstracts were not reliably distinguished on perceived quality measures. Perceived accuracy, precision, and structure were strongly associated with intended action, whereas grammar was not. These findings highlight the risk that persuasive scientific presentation may increase the credibility and potential clinical influence of fabricated or inaccurate AI-generated evidence.

Authors

Institutions

Publication Details

Journal
Journal of Medical Internet Research
Published
2026-11-13
DOI
https://doi.org/10.2196/91095
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Hallucinated Evidence and Real-World Risk—Physicians’ Intent to Act on AI-Generated Abstracts in Emergency Medicine and Trauma Surgery: Cross-Sectional, Vignette-Based Diagnostic Accuracy Study

Robert Prill, Nicolas Vuillerme, Marko Ostojić, Roland Becker et al.
1 links
Journal of Medical Internet Research
Artificial Intelligence in Healthcare and Education
article

Hallucinated Evidence and Real-World Risk—Physicians’ Intent to Act on AI-Generated Abstracts in Emergency Medicine and Trauma Surgery: Cross-Sectional, Vignette-Based Diagnostic Accuracy Study

Robert Prill, Nicolas Vuillerme, Marko Ostojić, Roland Becker, Nikolai Ramadanov, Felix Muehlensiepen, Jonathan Lettner, Hassan Tarek Hakam
article en

Abstract

BACKGROUND: Large language models (LLMs) are increasingly used in academic writing and can generate linguistically polished but factually incorrect scientific content. Such misinformation may distort evidence appraisal and, if translated into clinical practice, compromise patient care. OBJECTIVE: This study aimed to estimate physicians' likelihood of misperceiving false information embedded in LLM-generated abstracts as true and reporting an intent to use that information in future practice. We also explored which features were associated with perceived credibility and intended clinical action. METHODS: We conducted a cross-sectional, vignette-based survey of physicians working in emergency medicine and trauma surgery across 4 hospitals in Germany. Each participant assessed 4 abstracts generated using GPT-5 Thinking mode, of which 2 contained intentionally false claims supported by plausible explanations and 2 contained accurate claims. The primary outcome was the proportion of physicians reporting an intent to use or act on recommendations contained in abstracts with false claims. Secondary outcomes included perceived accuracy, rejection of accurate claims, and ratings of precision, structure, and grammar. RESULTS: Twenty physicians provided 80 ratings of 4 abstracts. Overall, physicians reported that they would act on 68% (54/80) of abstracts. Using abstract truth status as the reference, the decision to act had a sensitivity of 78% (31/40), specificity of 43% (17/40), positive predictive value of 57% (31/54), and negative predictive value of 65% (17/26). The positive likelihood ratio was 1.35 (95% CI 0.98-1.85), the negative likelihood ratio was 0.53 (95% CI 0.27-1.04), and the diagnostic odds ratio was 2.55 (95% CI 0.96-6.73). True and false abstracts received similar ratings for perceived accuracy (mean 3.15, SD 0.89 vs mean 2.88, SD 1.04; P=.21), precision (mean 3.15, SD 0.89 vs mean 2.93, SD 1.00; P=.29), structure (mean 3.23, SD 0.77 vs mean 3.20, SD 0.88; P=.89), and grammar (mean 3.40, SD 0.59 vs mean 3.43, SD 0.68; P=.86). Abstracts that physicians intended to act on were rated substantially higher for perceived accuracy, precision, and structure than those they would not act on (all P<.001), whereas grammar ratings did not differ (P=.80). CONCLUSIONS: Physicians frequently reported an intent to act on LLM-generated abstracts containing false claims, and true and false abstracts were not reliably distinguished on perceived quality measures. Perceived accuracy, precision, and structure were strongly associated with intended action, whereas grammar was not. These findings highlight the risk that persuasive scientific presentation may increase the credibility and potential clinical influence of fabricated or inaccurate AI-generated evidence.

Journal of Medical Internet ResearchVol. 28
Centre National de la Recherche Scientifique (FR), University Hospital Centre Zagreb (HR), University of Mostar (BA), Institut Universitaire de France (FR), University Clinical Hospital Mostar (BA), Humboldt-Universität zu Berlin (DE), Laboratoire d'Informatique de Grenoble (FR), Medizinische Hochschule Brandenburg Theodor Fontane (DE), Brandenburg University of Applied Sciences (DE), Universitätsklinikum Brandenburg an der Havel (DE), Université Grenoble Alpes (FR)
Good health and well-being
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon