‘ChatGPT can make mistakes’ warnings fail: A randomized controlled trial

The students underweight AI's diagnostic advice. The disclaimer did not alter students' use of AI advice, suggesting that their perceived credibility of ChatGPT was already near a behavioural floor. This finding supports the existence of a credibility threshold, beyond which additional cautionary cues have limited effect. Our results refine advice-taking theory and signal that simple warnings may be insufficient to ensure calibrated trust in AI-supported learning.

Authors

Institutions

Publication Details

Journal
Medical Education
Published
2025-09-25
DOI
https://doi.org/10.1111/medu.70056
Citations
2
Primary Topic
Clinical Reasoning and Diagnostic Skills
Type
article
Field-Weighted Citation Impact
3.03
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

‘ChatGPT can make mistakes’ warnings fail: A randomized controlled trial

Yavuz Selim Kıyak, Işıl İrem Budakoğlu, Özlem Çoşkun
2 citations
Medical Education
Clinical Reasoning and Diagnostic Skills
3.03
article

‘ChatGPT can make mistakes’ warnings fail: A randomized controlled trial

Yavuz Selim Kıyak, Işıl İrem Budakoğlu, Özlem Çoşkun
article en
2 citations

Abstract

The students underweight AI's diagnostic advice. The disclaimer did not alter students' use of AI advice, suggesting that their perceived credibility of ChatGPT was already near a behavioural floor. This finding supports the existence of a credibility threshold, beyond which additional cautionary cues have limited effect. Our results refine advice-taking theory and signal that simple warnings may be insufficient to ensure calibrated trust in AI-supported learning.

Medical EducationVol. 60(2)
Gazi University (TR)
Openalex Percentile: Top 7%
Clinical Reasoning and Diagnostic Skills
3.03
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.