Performance of ChatGPT-5.5 Instant and DeepSeek-V4 Flash in answering questions of patients undergoing ACDF surgery

This study compared ChatGPT-5.5 Instant and DeepSeek-V4 Flash in generating responses to a physician-curated set of questions commonly concerning patients undergoing anterior cervical discectomy and fusion (ACDF), aiming to evaluate expert-rated accuracy, clarity, completeness, consistency, and linguistic readability as a proxy for patient education quality. Based on Google related searches and the cervical spine preoperative education experience of three senior spine surgeons, 20 questions of concern to patients undergoing ACDF surgery were compiled and submitted to ChatGPT-5.5 Instant and DeepSeek-V4 Flash. Two clinically experienced spine surgeons independently rated the responses on accuracy, clarity, completeness, and consistency using a 5-point Likert scale. Inter-rater and intra-rater agreement were assessed using intraclass correlation coefficients (ICCs). Readability was assessed using the Flesch–Kincaid Grade Level (FKGL) and Flesch Reading Ease Score (FRES). The question was treated as the paired unit of analysis, and the Wilcoxon signed-rank test was used, with significance set at P < 0.05. A Bonferroni sensitivity analysis was also performed. Both chatbots achieved strong scores in accuracy, clarity, and consistency. A significant difference emerged in completeness: ChatGPT-5.5 Instant delivered more comprehensive responses (4.8 vs. 4.2, P = 0.0008). DeepSeek-V4 Flash achieved a significantly lower FKGL (8.5 vs. 11.4, P = 0.0003) and a higher FRES (64.0 vs. 45.0, P = 0.0002), indicating greater linguistic readability. ICC analysis confirmed strong inter-rater consistency (overall ICC = 0.86, 95% CI: 0.73–0.92). Under an expert-rated, physician-curated proxy evaluation, both ChatGPT-5.5 Instant and DeepSeek-V4 Flash provided accurate, clear, and consistent information for ACDF preoperative education, with ChatGPT-5.5 Instant excelling in completeness and DeepSeek-V4 Flash in readability. However, this study did not evaluate real-patient comprehension or clinical effectiveness. Future AI-assisted patient education tools may need to combine depth with readability, but this hypothesis requires validation through direct patient assessment.

Authors

Institutions

Publication Details

Journal
Langenbeck s Archives of Surgery
Published
2026-11-17
DOI
https://doi.org/10.1007/s00423-026-04384-w
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Performance of ChatGPT-5.5 Instant and DeepSeek-V4 Flash in answering questions of patients undergoing ACDF surgery

Tengshuai Li, Xiaoyang Huo, Jiaming Zhou, Jingchao Li et al.
4 links
Langenbeck s Archives of Surgery
Artificial Intelligence in Healthcare and Education
article

Performance of ChatGPT-5.5 Instant and DeepSeek-V4 Flash in answering questions of patients undergoing ACDF surgery

Tengshuai Li, Xiaoyang Huo, Jiaming Zhou, Jingchao Li, Yuan Xue
article en

Abstract

This study compared ChatGPT-5.5 Instant and DeepSeek-V4 Flash in generating responses to a physician-curated set of questions commonly concerning patients undergoing anterior cervical discectomy and fusion (ACDF), aiming to evaluate expert-rated accuracy, clarity, completeness, consistency, and linguistic readability as a proxy for patient education quality. Based on Google related searches and the cervical spine preoperative education experience of three senior spine surgeons, 20 questions of concern to patients undergoing ACDF surgery were compiled and submitted to ChatGPT-5.5 Instant and DeepSeek-V4 Flash. Two clinically experienced spine surgeons independently rated the responses on accuracy, clarity, completeness, and consistency using a 5-point Likert scale. Inter-rater and intra-rater agreement were assessed using intraclass correlation coefficients (ICCs). Readability was assessed using the Flesch–Kincaid Grade Level (FKGL) and Flesch Reading Ease Score (FRES). The question was treated as the paired unit of analysis, and the Wilcoxon signed-rank test was used, with significance set at P < 0.05. A Bonferroni sensitivity analysis was also performed. Both chatbots achieved strong scores in accuracy, clarity, and consistency. A significant difference emerged in completeness: ChatGPT-5.5 Instant delivered more comprehensive responses (4.8 vs. 4.2, P = 0.0008). DeepSeek-V4 Flash achieved a significantly lower FKGL (8.5 vs. 11.4, P = 0.0003) and a higher FRES (64.0 vs. 45.0, P = 0.0002), indicating greater linguistic readability. ICC analysis confirmed strong inter-rater consistency (overall ICC = 0.86, 95% CI: 0.73–0.92). Under an expert-rated, physician-curated proxy evaluation, both ChatGPT-5.5 Instant and DeepSeek-V4 Flash provided accurate, clear, and consistent information for ACDF preoperative education, with ChatGPT-5.5 Instant excelling in completeness and DeepSeek-V4 Flash in readability. However, this study did not evaluate real-patient comprehension or clinical effectiveness. Future AI-assisted patient education tools may need to combine depth with readability, but this hypothesis requires validation through direct patient assessment.

Langenbeck s Archives of Surgery
Tianjin Medical University General Hospital (CN)
Good health and well-being
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon