Influence of medical educational background on the diagnostic quality of <scp>ChatGPT</scp>‐4 responses in internal medicine: A pilot study

This pilot study evaluated the influence of medical background on the diagnostic quality of ChatGPT-4's responses in Internal Medicine. Third-year students, residents and specialists summarised five complex NEJM clinical cases before querying ChatGPT-4. Diagnostic ranking, assessed by independent experts, revealed that residents significantly outperformed students (OR 2.33, p = .007); though overall performance was low. These findings indicate that user expertise and concise case summaries are critical for optimising AI diagnostics, highlighting the need for enhanced AI training and user interaction strategies.

Authors

Institutions

Publication Details

Journal
European Journal of Clinical Investigation
Published
2025-09-08
DOI
https://doi.org/10.1111/eci.70113
Citations
2
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
1.31

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Influence of medical educational background on the diagnostic quality of ChatGPT‐4 responses in internal medicine: A pilot study

Lorenzo Ferrando, Benedetta Cigolini, Andrea Bellodi, Mario Stabile et al.
2 citations
European Journal of Clinical Investigation
Artificial Intelligence in Healthcare and Education
1.31
article

Influence of medical educational background on the diagnostic quality of ChatGPT‐4 responses in internal medicine: A pilot study

Lorenzo Ferrando, Benedetta Cigolini, Andrea Bellodi, Mario Stabile, Fabrizio Montecucco, Nicolò Gilardi, Gabriele Zoppoli, Federico Carbone, Giovanni Talerico, Carlo Genova, Alberto Ballestrero, Francesco Ravera, Christian Bracco, M. Ballabio
article en
2 citations

Abstract

This pilot study evaluated the influence of medical background on the diagnostic quality of ChatGPT-4's responses in Internal Medicine. Third-year students, residents and specialists summarised five complex NEJM clinical cases before querying ChatGPT-4. Diagnostic ranking, assessed by independent experts, revealed that residents significantly outperformed students (OR 2.33, p = .007); though overall performance was low. These findings indicate that user expertise and concise case summaries are critical for optimising AI diagnostics, highlighting the need for enhanced AI training and user interaction strategies.

European Journal of Clinical InvestigationVol. 55(11)
Azienda Ospedaliera San Giovanni Addolorata (IT), Azienda Sanitaria Ospedaliera S.Croce e Carle Cuneo (IT), Ospedale Policlinico San Martino (IT), University of Genoa (IT)
Associazione Italiana per la Ricerca sul Cancro
Openalex Percentile: Top 14%
Artificial Intelligence in Healthcare and Education
1.31
DOIOpen Access PDFOpenAlex
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Influence of medical educational background on the diagnostic quality of <scp>ChatGPT</scp>‐4 responses in internal medicine: A pilot study — Lorenzo Ferrando, Benedetta Cigolini, et al. · European Journal of Clinical Investigation (2025) | TGRS Research Map | TGRS