Evaluation of artificial intelligence-generated vignettes depicting patient chatbot use in psychiatric contexts

Chatbot-related mental health risks have attracted increasing public attention, yet educational case materials for clinicians remain limited. We evaluated ChatGPT-5 Pro's ability to generate psychiatric vignettes involving patient chatbot use. Three board-certified psychiatrists rated the vignettes on chatbot relevance, diagnostic sufficiency, explanation quality, and safety. While chatbot relevance and diagnostic sufficiency were high, safety ratings were lower, underscoring the need for expert review before educational use.

Authors

Institutions

Publication Details

Journal
npj Digital Medicine
Published
2026-04-07
DOI
https://doi.org/10.1038/s41746-026-02605-6
Primary Topic
Digital Mental Health Interventions
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evaluation of artificial intelligence-generated vignettes depicting patient chatbot use in psychiatric contexts

Daniel Elswick, Wanhong Zheng, Gangqing Hu, Mohammad Iqbal Nouyed et al.
npj Digital Medicine
Digital Mental Health Interventions
article

Evaluation of artificial intelligence-generated vignettes depicting patient chatbot use in psychiatric contexts

Daniel Elswick, Wanhong Zheng, Gangqing Hu, Mohammad Iqbal Nouyed, Dilip N. Chandran
article en

Abstract

Chatbot-related mental health risks have attracted increasing public attention, yet educational case materials for clinicians remain limited. We evaluated ChatGPT-5 Pro's ability to generate psychiatric vignettes involving patient chatbot use. Three board-certified psychiatrists rated the vignettes on chatbot relevance, diagnostic sufficiency, explanation quality, and safety. While chatbot relevance and diagnostic sufficiency were high, safety ratings were lower, underscoring the need for expert review before educational use.

npj Digital Medicine
West Virginia University (US), West Virginia University Hospitals (US)
National Science Foundation, National Institute of General Medical Sciences
Quality Education
Openalex Percentile: Top 26%
Digital Mental Health Interventions
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.