Comparing new tools of artificial intelligence to the authentic intelligence of our global health students
Our findings reveal strengths and limitations on the potential of AI tools to assist in understanding the complexities of global health topics. Strengths mentioned by students included the ability of ChatGPT-4o to produce content very quickly and to suggest topics that they had not considered in the 3-perspective sections of their papers. Consistently presenting up-to-date facts and references, as well as further examining or summarizing the complexities of global health topics, appears to be a current limitation of ChatGPT-4o. Because ChatGPT-4o generated references from highly credible biomedical research journals that did not exist, our findings conclude that ChatGPT-4o failed an important component in using information effectively. Moreover, misrepresenting trusted sources of public health information is highly concerning, particularly given recent experiences from the COVID-19 pandemic and more recently in reporting on the impact of, and response to natural disasters. This is a significant limitation of GenAI's ability to meet information literacy standards expected of graduate students.
Authors
- Benjamin Greenberg (ORCID: https://orcid.org/0000-0002-2091-8201)
- Jacob E. Gardner
- Peter A. Zimmerman (ORCID: https://orcid.org/0000-0002-5349-4513)
- Joseph P. O’Brien
- Yasaswini Iyer
- Rajesh U. Modi (ORCID: https://orcid.org/0000-0002-6370-7199)
- Anusha Mudigonda (ORCID: https://orcid.org/0009-0005-9825-8855)
- Chris Beltran (ORCID: https://orcid.org/0000-0001-7688-0815)
- Estefanía Hernández (ORCID: https://orcid.org/0000-0002-8925-911X)
- A. S. Menon (ORCID: https://orcid.org/0009-0003-3911-1744)
- Alyssa Hubal (ORCID: https://orcid.org/0000-0002-4039-0918)
- Sylvain G. Leblanc (ORCID: https://orcid.org/0000-0003-2456-7119)
- Maria A. Prokos
- Jacqueline Moran
- Daouda Malick Gueye (ORCID: https://orcid.org/0000-0003-3699-4046)
- Timsi Rao (ORCID: https://orcid.org/0000-0002-1307-0433)
- Sara G. Yacoub
- Skanda Moorthy (ORCID: https://orcid.org/0000-0001-9861-8834)
- Olivia R. Thomas (ORCID: https://orcid.org/0009-0002-3846-7549)
- Anna C. Winnicki
- Junwei Zhang (ORCID: https://orcid.org/0009-0002-1911-8642)
- Aashna Shah
- Grace Q. Armstrong
- Shilpa R. Thandla
- Taylor Guerrieri
- Yuliana P. Lapina
- Christina Yoka
- Clara Harb
- Abigail R. Hotchner
Institutions
- Ohio Department of Health (US)
- University Hospitals Cleveland Medical Center (US)
- Center for Global Health (US)
- Case Western Reserve University (US)
Publication Details
- Journal
- BioData Mining
- Published
- 2024-12-18
- DOI
- https://doi.org/10.1186/s13040-024-00408-7
- Citations
- 8
- Primary Topic
- Global Health and Surgery
- Type
- article
- Field-Weighted Citation Impact
- 4.34
Funders
- Kenyon College
- Case Western Reserve University