The Diagnostic Ability of GPT-3.5 and GPT-4.0 in Surgery: Comparative Analysis

This study demonstrates that ChatGPT, particularly GPT-4.0, possesses significant diagnostic potential, with GPT-4.0 exhibiting higher accuracy than GPT-3.5. However, GPT-4.0 still has limitations, particularly in recognizing patient symptoms and laboratory data, indicating a need for more research in real-world clinical settings to enhance its diagnostic capabilities.

Authors

Institutions

Publication Details

Journal
Journal of Medical Internet Research
Published
2024-09-10
DOI
https://doi.org/10.2196/54985
Citations
20
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
2.41
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Diagnostic Ability of GPT-3.5 and GPT-4.0 in Surgery: Comparative Analysis

D. Fang, Jianning Zhang, Hui Xie, Chengliang Yin et al.
20 citations
Journal of Medical Internet Research
Artificial Intelligence in Healthcare and Education
2.41
article

The Diagnostic Ability of GPT-3.5 and GPT-4.0 in Surgery: Comparative Analysis

D. Fang, Jianning Zhang, Hui Xie, Chengliang Yin, Xiaochun Sun, Ping Hu, Yue Tong, Bingxian Wang, Yanteng Li, Hebin Che, Gang Cheng, Jiqi Zheng, Jiayu Liu, Yuanyuan Chen, Xiuting Liang, Fan Yang
article en
20 citations

Abstract

This study demonstrates that ChatGPT, particularly GPT-4.0, possesses significant diagnostic potential, with GPT-4.0 exhibiting higher accuracy than GPT-3.5. However, GPT-4.0 still has limitations, particularly in recognizing patient symptoms and laboratory data, indicating a need for more research in real-world clinical settings to enhance its diagnostic capabilities.

Journal of Medical Internet ResearchVol. 26
Fujian Medical University (CN), Peking University (CN), Chinese PLA General Hospital (CN), Xian Central Hospital (CN), People's Liberation Army No. 150 Hospital (CN), First Affiliated Hospital of Fujian Medical University (CN), Chinese People’s Liberation Army 263 hospital (CN), Peking University Sixth Hospital (CN)
Good health and well-being
Openalex Percentile: Top 11%
Artificial Intelligence in Healthcare and Education
2.41
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.