Evaluation of the accuracy of large language models in answering bone cancer-related questions

When answering bone cancer-related questions, Deepseek V3.1, ChatGPT 5, and Grok 4 generally performed well. Specifically, when responding to questions about Ewing sarcoma, ChatGPT 5 and Grok 4 demonstrated higher accuracy than Deepseek V3.1. While each model has its own strengths and limitations, their collective potential to enhance medical knowledge and improve healthcare outcomes is undeniable.

Authors

Institutions

Publication Details

Journal
Frontiers in Public Health
Published
2025-12-05
DOI
https://doi.org/10.3389/fpubh.2025.1719047
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evaluation of the accuracy of large language models in answering bone cancer-related questions

S. Ye, Feng Lin, Liping Huang, Qi Pan et al.
Frontiers in Public Health
Artificial Intelligence in Healthcare and Education
article

Evaluation of the accuracy of large language models in answering bone cancer-related questions

S. Ye, Feng Lin, Liping Huang, Qi Pan, Ning Liu
article en

Abstract

When answering bone cancer-related questions, Deepseek V3.1, ChatGPT 5, and Grok 4 generally performed well. Specifically, when responding to questions about Ewing sarcoma, ChatGPT 5 and Grok 4 demonstrated higher accuracy than Deepseek V3.1. While each model has its own strengths and limitations, their collective potential to enhance medical knowledge and improve healthcare outcomes is undeniable.

Frontiers in Public HealthVol. 13
Ganzhou People's Hospital (CN)
Openalex Percentile: Top 67%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.