Assessing the Efficacy of Ortho GPT: A Comparative Study with Medical Students and General LLMs on Orthopedic Examination Questions
These findings illustrate the superiority of Ortho GPT in orthopedic exam accuracy and context relevance, attributed to its specialized training data. The domain-specific approach enables performance matching or exceeding top general LLMs in orthopedics, emphasizing the importance of domain specialization for reliable, curriculum-aligned support in medical education.
Authors
- Dominik Stephan Schoeb
- Andreas Fuchs (ORCID: https://orcid.org/0000-0002-0816-8188)
- Christian Gratzke (ORCID: https://orcid.org/0000-0003-4070-0952)
- Philippe-Fabian Pohlmann (ORCID: https://orcid.org/0000-0001-8578-7452)
- Hagen Schmal (ORCID: https://orcid.org/0000-0002-8801-2385)
- Maximilian Glienke (ORCID: https://orcid.org/0000-0002-6051-4404)
- Richard Sandkamp
Institutions
- University of Freiburg (DE)
- University Medical Center Freiburg (DE)
- Odense University Hospital (DK)
Publication Details
- Journal
- Bioengineering
- Published
- 2025-11-24
- DOI
- https://doi.org/10.3390/bioengineering12121290
- Citations
- 1
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 0.65
Funders
- Albert-Ludwigs-Universität Freiburg