Performance Comparison of Junior Residents and ChatGPT in the Objective Structured Clinical Examination (OSCE) for Medical History Taking and Documentation of Medical Records: Development and Usability Study
The performance of ChatGPT 4.0 was on par with that of human participants in Objective Structured Clinical Examination evaluations, signifying its potential in medical history and medical record documentation. Despite this, the superiority of human consultations in terms of quality was evident. The study underscores both the promise and the current limitations of LLMs in the realm of clinical practice.
Authors
- Yung‐Chun Chang (ORCID: https://orcid.org/0000-0002-9634-8380)
- Pei Hsing Hsieh (ORCID: https://orcid.org/0000-0001-8059-9735)
- Ting-Yun Huang (ORCID: https://orcid.org/0000-0002-1509-0606)
Institutions
- Taipei Medical University-Shuang Ho Hospital (TW)
- Taipei Medical University (TW)
Publication Details
- Journal
- JMIR Medical Education
- Published
- 2024-11-21
- DOI
- https://doi.org/10.2196/59902
- Citations
- 17
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 2.04