DeepSeek-R1 for automated scoring in radiology residency examinations: an agreement and test–retest reliability study
The performance of DeepSeek-R1 was comparable to that of radiologists in the evaluation of radiology residents' reports. The integration of DeepSeek-R1 into medical education could effectively assist in assessment tasks, potentially alleviating faculty workload while preserving the quality of evaluations.
Authors
- Lan‐Fang Huang
- Shanshan Niu
- Ying-Qin Li
- Xiaobin Liu (ORCID: https://orcid.org/0000-0002-1472-4312)
- Guojie Wang (ORCID: https://orcid.org/0000-0003-0059-7882)
Institutions
- Sun Yat-sen University (CN)
- Fifth Affiliated Hospital of Sun Yat-sen University (CN)
Publication Details
- Journal
- BMC Medical Education
- Published
- 2025-11-11
- DOI
- https://doi.org/10.1186/s12909-025-08184-6
- Primary Topic
- Radiology practices and education
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Sun Yat-sen University