Performance of DeepSeek and ChatGPT on the Chinese Health Professional and Technical Examination: A comparative study
DeepSeek-R1 outperformed the GPT-4o API across multiple dimensions of nursing competency assessment, particularly in overall accuracy and consistent accuracy. GPT-4o API exhibited high response stability but a tendency toward systematic errors, underscoring the need for careful interpretation of model outputs. Further research is needed to evaluate LLM performance using open-ended clinical reasoning tasks and real-world assessment data to support safe and effective educational integration.
Authors
- Hailing Ju
- Zhiang Sun
- Pin Yu
- Xu Li
- Huiting Xu
- Xu Hu
Institutions
- Tongji University (CN)
- Fudan University (CN)
- Soochow University (CN)
- Zhongshan Hospital (CN)
- Shanghai Tenth People's Hospital (CN)
- First Affiliated Hospital of Soochow University (CN)
Publication Details
- Journal
- PLoS ONE
- Published
- 2026-01-22
- DOI
- https://doi.org/10.1371/journal.pone.0338328
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 0.00