The performance of OpenAI ChatGPT-4 and Google Gemini in virology multiple-choice questions: a comparative analysis of English and Arabic responses
ChatGPT-4 and Gemini performed better in English compared to Arabic, with ChatGPT-4 consistently surpassing Gemini in correctness and CLEAR scores. ChatGPT-4 led Gemini with 80% vs. 62.5% correctness in English compared to 65% vs. 55% in Arabic. For both AI models, superior performance in lower cognitive domains was reported. Both ChatGPT-4 and Gemini exhibited potential in educational applications; nevertheless, their performance varied across languages highlighting the importance of continued development to ensure the effective AI integration in healthcare education globally.
Authors
- Muna Barakat (ORCID: https://orcid.org/0000-0002-7966-1172)
- Kholoud Al-Mahzoum
- Reem Abdullah Almutairi (ORCID: https://orcid.org/0009-0005-0221-3987)
- Malik Sallam (ORCID: https://orcid.org/0000-0002-0165-9670)
- Rawan Ahmad Almutawaa (ORCID: https://orcid.org/0009-0007-6551-7480)
- Jasmen Ahmad Alhashash (ORCID: https://orcid.org/0009-0000-2967-6192)
- Retaj Abdullah Dashti (ORCID: https://orcid.org/0009-0008-4181-7558)
- Danah Raed AlSafy (ORCID: https://orcid.org/0009-0003-1598-409X)
Institutions
- University of Jordan (JO)
- Applied Science Private University (JO)
- King Abdullah University Hospital (JO)
Publication Details
- Journal
- BMC Research Notes
- Published
- 2024-09-03
- DOI
- https://doi.org/10.1186/s13104-024-06920-7
- Citations
- 15
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 1.80