Is ChatGPT 3.5 smarter than Otolaryngology trainees? A comparison study of board style exam questions
ChatGPT can outperform lower-level medical trainees on Otolaryngology board-style exam but still lacks the ability to outperform higher-level trainees. These questions primarily test rote memorization of medical facts; in contrast, the art of practicing medicine is predicated on the synthesis of complex presentations of disease and multilayered application of knowledge of the healing process. Given that upper-level trainees outperform ChatGPT, it is unlikely that ChatGPT, in its current form will provide significant clinical utility over an Otolaryngologist.
Authors
- Jaimin Patel (ORCID: https://orcid.org/0000-0002-5679-0772)
- Benjamin Anthony (ORCID: https://orcid.org/0000-0002-5890-2045)
- Peyton Robinson (ORCID: https://orcid.org/0000-0002-0507-0900)
- Elisa A. Illing (ORCID: https://orcid.org/0000-0002-8497-7876)
Institutions
- Indiana University School of Medicine
- Indiana University – Purdue University Indianapolis (US)
Publication Details
- Journal
- PLoS ONE
- Published
- 2024-09-26
- DOI
- https://doi.org/10.1371/journal.pone.0306233
- Citations
- 5
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 0.60