Evaluating ChatGPT in Pediatric Craniofacial Surgery Counseling: A Vignette-Based Assessment of Educational Quality, Specificity, Readability, and Emotional Content
ChatGPT-4o produced organized, accessible responses, but underperformed in reliability, quality, specificity, and actionability. Reading level exceeds recommended patient education standards of sixth to eighth grade. Emotional tone was moderate but not consistently tailored to sensitive pediatric contexts. These findings suggest ChatGPT is insufficient for unsupervised use. With refinement, LLMs may serve as support, but not replace, physician-led counseling in pediatric craniofacial surgery.
Authors
- Kate M Miller (ORCID: https://orcid.org/0000-0002-1142-7697)
- Wrood Kassira (ORCID: https://orcid.org/0000-0001-7803-3038)
- Seth Ray Thaller (ORCID: https://orcid.org/0000-0003-0190-0812)
- Baylee M. Brochu
- Savanah R. Sturm
- Sarah Antonevich
- Adriana Sandino
Institutions
- University of Miami (US)
Publication Details
- Journal
- Journal of Craniofacial Surgery
- Published
- 2026-02-25
- DOI
- https://doi.org/10.1097/scs.0000000000012116
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 0.00