Evaluation of artificial intelligence-generated vignettes depicting patient chatbot use in psychiatric contexts
Chatbot-related mental health risks have attracted increasing public attention, yet educational case materials for clinicians remain limited. We evaluated ChatGPT-5 Pro's ability to generate psychiatric vignettes involving patient chatbot use. Three board-certified psychiatrists rated the vignettes on chatbot relevance, diagnostic sufficiency, explanation quality, and safety. While chatbot relevance and diagnostic sufficiency were high, safety ratings were lower, underscoring the need for expert review before educational use.
Authors
- Daniel Elswick (ORCID: https://orcid.org/0000-0002-3131-3419)
- Wanhong Zheng (ORCID: https://orcid.org/0000-0003-3262-2720)
- Gangqing Hu
- Mohammad Iqbal Nouyed
- Dilip N. Chandran
Institutions
- West Virginia University (US)
- West Virginia University Hospitals (US)
Publication Details
- Journal
- npj Digital Medicine
- Published
- 2026-04-07
- DOI
- https://doi.org/10.1038/s41746-026-02605-6
- Primary Topic
- Digital Mental Health Interventions
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Science Foundation
- National Institute of General Medical Sciences