Comparing ChatGPT and DeepSeek for Assessment of Multiple-Choice Questions in Orthopedic Medical Education: Cross-Sectional Study
ChatGPT outperformed DeepSeek in correctness and response time, demonstrating its efficiency in evaluating orthopedic MCQs. This high reliability suggests its potential for integration into medical assessments. However, our results indicate that some MCQs will require revisions by instructors to improve their clarity. Further studies are needed to evaluate the role of artificial intelligence in other disciplines and to validate other LLMs.
Authors
- Chirathit Anusitviwat (ORCID: https://orcid.org/0000-0001-6730-7486)
- Boonsin Tangtrakulwanich (ORCID: https://orcid.org/0000-0003-0933-1669)
- Jongdee Bvonpanttarananon (ORCID: https://orcid.org/0000-0001-6692-8627)
- Sitthiphong Suwannaphisit (ORCID: https://orcid.org/0000-0002-4895-5987)
Institutions
- Prince of Songkla University (TH)
- Navamindradhiraj University (TH)
- Vajira Hospital (TH)
Publication Details
- Journal
- JMIR Formative Research
- Published
- 2025-12-19
- DOI
- https://doi.org/10.2196/75607
- Citations
- 3
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 1.96