Usefulness of Large Language Models (LLMs) for Student Feedback on H&P During Clerkship: Artificial Intelligence for Personalized Learning

Large Language Models (LLMs) notably GPT-4, demonstrate exceptional language generation and comprehension abilities, and they have potential uses in clinical practice, learning, and medical research. In this study, we explore practical use of Large Language Models (LLMs) in enhancing case-based learning in medical education. The study employes a designed mixed-methods approach, combining quantitative metrics with qualitative feedback from 100 medical students, providing comprehensive insights into both the technical performance and educational value of LLM-based feedback systems. Our results indicate that LLMs can enhance medical students’ History and Physical (H&P) skills by providing personalized insights, fostering critical thinking, and improving their abilities to analyze, diagnose, and present clinical cases. This study has surfaced significant insights into the potential benefits and limitations of integrating LLMs into medical education. Our findings show the positive impact of LLMs on enhancing personalized learning experiences, critical thinking, and the effectiveness of case-based learning aids and highlighting its limitations.