Comparing GenAI Summaries Versus Chatbots for Supporting Reflection in Healthcare Simulation
Reflection is critical for learning. In healthcare, simulations help learners practice clinical and teamwork skills, while reflection supports improving practice. Learning analytics (LA) dashboards can support reflection by visualizing activity data, but their effectiveness is limited by learners’ ability to interpret data visualizations and domain knowledge. Generative AI (GenAI) may bridge this gap through narrative explanations of data. Yet little is known about how forms of GenAI support—such as chatbots or summaries—affect reflection. We conducted a comparative study with 41 nursing students who wrote reflections after a simulation, supported by an LA dashboard augmented with a GenAI summary or chatbot. Results suggest that written reflections differed across conditions: GenAI summaries help align reflections with learning goals, while chatbots encourage consideration of actions and plans. However, nursing teachers identified no difference in the quality of plans. These findings suggest GenAI configuration may shape how technologies support reflection.
Authors
- Viktoria Pammer‐Schindler (ORCID: https://orcid.org/0000-0001-7061-8947)
- Linxuan Zhao (ORCID: https://orcid.org/0000-0001-5564-0185)
- Abra Osborne (ORCID: https://orcid.org/0000-0001-8887-3188)
- Dragan Gašević (ORCID: https://orcid.org/0000-0001-9265-1908)
- Lixiang Yan (ORCID: https://orcid.org/0000-0003-3818-045X)
- Roberto Martínez‐Maldonado (ORCID: https://orcid.org/0000-0002-8375-1816)
- Riordan Alfredo (ORCID: https://orcid.org/0000-0001-5440-6143)
- Vanessa Echeverría (ORCID: https://orcid.org/0000-0002-2022-9588)
- Yueqiao Jin (ORCID: https://orcid.org/0009-0003-7309-4984)
- Mikaela Elizabeth Milesi (ORCID: https://orcid.org/0009-0002-0910-9822)
- Jie Xiang Fan (ORCID: https://orcid.org/0009-0000-8585-2760)
- Yi‐Shan Tsai (ORCID: https://orcid.org/0000-0001-8967-5327)
Institutions
- Escuela Superior Politecnica del Litoral (EC)
- Graz University of Technology (AT)
- Education University of Hong Kong (HK)
- Monash University (AU)
- RMIT University (AU)
- University of Hong Kong (HK)
- Tsinghua University (CN)
Publication Details
- Journal
- International Journal of Human-Computer Interaction
- Published
- 2026-09-24
- DOI
- https://doi.org/10.1080/10447318.2026.2731321
- Primary Topic
- Simulation-Based Education in Healthcare
- Type
- article
- Field-Weighted Citation Impact
- 0.00