ChatGPT and large language models (LLMs) awareness and use. A prospective cross-sectional survey of U.S. medical students
Generative-AI (GAI) models like ChatGPT are becoming widely discussed and utilized tools in medical education. For example, it can be used to assist with studying for exams, shown capable of passing the USMLE board exams. However, there have been concerns expressed regarding its fair and ethical use. We designed an electronic survey for students across North American medical colleges to gauge their views on and current use of ChatGPT and similar technologies in May, 2023. Overall, 415 students from at least 28 medical schools completed the questionnaire and 96% of respondents had heard of ChatGPT and 52% had used it for medical school coursework. The most common use in pre-clerkship and clerkship phase was asking for explanations of medical concepts and assisting with diagnosis/treatment plans, respectively. The most common use in academic research was for proof reading and grammar edits. Respondents recognized the potential limitations of ChatGPT, including inaccurate responses, patient privacy, and plagiarism. Students recognized the importance of regulations to ensure proper use of this novel technology. Understanding the views of students is essential to crafting workable instructional courses, guidelines, and regulations that ensure the safe, productive use of generative-AI in medical school.
Authors
- Muhammad S Ghauri (ORCID: https://orcid.org/0000-0001-6387-589X)
- Bayan Yazdi (ORCID: https://orcid.org/0000-0003-2948-8030)
- Conner Ganjavi (ORCID: https://orcid.org/0000-0001-9698-964X)
- Michael Eppler (ORCID: https://orcid.org/0000-0001-6336-5857)
- Giovanni Cacciamani (ORCID: https://orcid.org/0000-0002-8892-5539)
- Devon O'Brien
- Victoria Shi (ORCID: https://orcid.org/0000-0002-1309-0098)
- Lorenzo Storino Ramacciotti (ORCID: https://orcid.org/0000-0002-0615-9720)
- Jae Hyuk Choi
- Claudia Stephens
- Madeline Ebert
- Michaela Derby
- Issac Anderson
- Darby Dwyer
Institutions
- University of Southern California (US)
- LAC+USC Medical Center (US)
- Wayne State University (US)
- University of South Dakota (US)
- Loyola University Chicago (US)
- Medical College of Wisconsin (US)
- Southwestern Medical Center (US)
- University of Missouri–Kansas City (US)
- University of South Alabama (US)
- The University of Texas Southwestern Medical Center (US)
- Bryan College (US)
Publication Details
- Journal
- PLOS Digital Health
- Published
- 2024-09-05
- DOI
- https://doi.org/10.1371/journal.pdig.0000596
- Citations
- 42
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 5.05