Is artificial intelligence successful in the Turkish neurology board exam?
This is the first study to investigate the performance of ChatGPT on the real Neurology Proficiency Examination. The success rate was shown to be above GPT-3.5. Furthermore, this study showed that translating questions from the original language into English did not affect the performance of GPT-4 in medical licensing exams, unlike GPT-3.5. It is therefore very important that the information obtained is accurate and verifiable. ChatGPT-4's ability to find the correct answer with feedback on questions that it initially answered incorrectly may be due to the model's ability to generate flexible and adaptive answers.These models should be used carefully and consciously, knowing that they will not always give the correct answer.
Authors
- Emine Altin (ORCID: https://orcid.org/0000-0002-6020-6022)
- Ece Yanık (ORCID: https://orcid.org/0000-0001-8326-0526)
- Özlem Kurtkaya Koçak (ORCID: https://orcid.org/0009-0002-2914-8765)
- Ayse Betul Acar (ORCID: https://orcid.org/0009-0002-2042-230X)
Institutions
- Memorial Ankara Hospital (TR)
- City Hospital (GB)
- Gazi University (TR)
Publication Details
- Journal
- Neurological Research
- Published
- 2025-03-20
- DOI
- https://doi.org/10.1080/01616412.2025.2481444
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 0.00