Human versus Artificial Intelligence: ChatGPT-4 Outperforming Bing, Bard, ChatGPT-3.5 and Humans in Clinical Chemistry Multiple-Choice Questions
The findings indicated that ChatGPT-4 excelled in the Clinical Chemistry exam, while ChatGPT-3.5, Bing, and Bard were above average. Given that the MCQs were directed to postgraduate students with a high degree of specialization, the performance of these AI chatbots was remarkable. Due to the risk of academic dishonesty and possible dependence on these AI models, the appropriateness of MCQs as an assessment tool in higher education should be re-evaluated.
Authors
- Jan Egger (ORCID: https://orcid.org/0000-0002-5225-1982)
- Huda Eid (ORCID: https://orcid.org/0000-0002-2804-1942)
- Behrus Puladi (ORCID: https://orcid.org/0000-0001-5909-6105)
- Khaled Al‐Salahat
- Malik Sallam (ORCID: https://orcid.org/0000-0002-0165-9670)
Institutions
- University of Jordan (JO)
- Jordan Hospital (JO)
- RWTH Aachen University (DE)
Publication Details
- Journal
- Advances in Medical Education and Practice
- Published
- 2024-09-01
- DOI
- https://doi.org/10.2147/amep.s479801
- Citations
- 22
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 2.65