Retrieval‑augmented large language models for depression screening and suicide risk stratification

Depression imposes substantial individual and societal burdens, yet more than 80% of cases remain undetected in non‑psychiatric settings, and approximately 15% of individuals with severe depression die by suicide. Existing screening methods are limited by subjective self‑report, fragmented care pathways, and stigma‑related underutilization. We developed and locally deployed a Retrieval‑Augmented Generation (RAG) framework that integrates large language models (LLMs) with an evidence‑based clinical knowledge base for depression and suicidality. Three leading Chinese LLMs (DeepSeek, Qwen, Baichuan) were evaluated under base and RAG‑augmented configurations. The knowledge base comprised clinical practice guidelines, standard textbooks, and peer‑reviewed literature. Model performance was assessed on multi‑source datasets. Outcomes included classification of depression and suicide risk, consistency of diagnostic outputs, symptom‑summary quality, and clinician‑rated empathy and dialogue quality. RAG augmentation consistently improved diagnostic performance across datasets. For depression detection, Qwen3 + RAG achieved an F1‑score of 0.9107, and for suicide risk stratification, RAG enhanced F1‑scores by approximately 0.15 compared with non‑RAG baselines. The best‑performing configuration demonstrated high reproducibility for both depression diagnosis and suicide risk classification (overall κ = 0.93; 95% CI: 0.91–0.95). Symptom summarization was substantially improved with RAG, with relative gains of 44.1–207.2% in BLEU‑2 and 37.0–94.0% in ROUGE‑L. Clinician‑blinded ratings indicated clinician-evaluated high-level empathic expression in RAG‑enhanced models (mean scores 4.23–4.98/5), with Qwen3 + RAG exhibiting particularly strong emotional concordance (95% CI: 4.80–4.92). Dialogue quality was rated as high across domains, including fluency (mean 4.98/5) and perceived doctor‑likeness (mean 4.94/5). A domain‑specific, RAG‑enhanced LLM framework can deliver clinically reliable, reproducible, and empathetic depression screening and suicide risk stratification in both real‑world and simulated settings. Local on‑premises deployment supports privacy and data‑governance requirements, while the scalable architecture and structured outputs position this approach as a promising tool for augmenting mental health triage and longitudinal monitoring in resource‑constrained environments.

Authors

Institutions

Publication Details

Journal
BMC Psychiatry
Published
2026-03-31
DOI
https://doi.org/10.1186/s12888-026-07988-0
Primary Topic
Mental Health via Writing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Retrieval‑augmented large language models for depression screening and suicide risk stratification

Xiaomeng De, Gaoqiang Fei, Xulai Song, Fengyi Zuo et al.
BMC Psychiatry
Mental Health via Writing
article

Retrieval‑augmented large language models for depression screening and suicide risk stratification

Xiaomeng De, Gaoqiang Fei, Xulai Song, Fengyi Zuo, Zerui Lu, Siqi Ding, Bin Zhu, Bangyu Wu, Lin Xu, Tianhao Gu, Wenbo Xie, Yujia Zhou
article en

Abstract

Depression imposes substantial individual and societal burdens, yet more than 80% of cases remain undetected in non‑psychiatric settings, and approximately 15% of individuals with severe depression die by suicide. Existing screening methods are limited by subjective self‑report, fragmented care pathways, and stigma‑related underutilization. We developed and locally deployed a Retrieval‑Augmented Generation (RAG) framework that integrates large language models (LLMs) with an evidence‑based clinical knowledge base for depression and suicidality. Three leading Chinese LLMs (DeepSeek, Qwen, Baichuan) were evaluated under base and RAG‑augmented configurations. The knowledge base comprised clinical practice guidelines, standard textbooks, and peer‑reviewed literature. Model performance was assessed on multi‑source datasets. Outcomes included classification of depression and suicide risk, consistency of diagnostic outputs, symptom‑summary quality, and clinician‑rated empathy and dialogue quality. RAG augmentation consistently improved diagnostic performance across datasets. For depression detection, Qwen3 + RAG achieved an F1‑score of 0.9107, and for suicide risk stratification, RAG enhanced F1‑scores by approximately 0.15 compared with non‑RAG baselines. The best‑performing configuration demonstrated high reproducibility for both depression diagnosis and suicide risk classification (overall κ = 0.93; 95% CI: 0.91–0.95). Symptom summarization was substantially improved with RAG, with relative gains of 44.1–207.2% in BLEU‑2 and 37.0–94.0% in ROUGE‑L. Clinician‑blinded ratings indicated clinician-evaluated high-level empathic expression in RAG‑enhanced models (mean scores 4.23–4.98/5), with Qwen3 + RAG exhibiting particularly strong emotional concordance (95% CI: 4.80–4.92). Dialogue quality was rated as high across domains, including fluency (mean 4.98/5) and perceived doctor‑likeness (mean 4.94/5). A domain‑specific, RAG‑enhanced LLM framework can deliver clinically reliable, reproducible, and empathetic depression screening and suicide risk stratification in both real‑world and simulated settings. Local on‑premises deployment supports privacy and data‑governance requirements, while the scalable architecture and structured outputs position this approach as a promising tool for augmenting mental health triage and longitudinal monitoring in resource‑constrained environments.

BMC Psychiatry
Jiangsu Cancer Hospital (CN), Second Affiliated Hospital of Nanjing Medical University (CN), Nanjing Medical University (CN)
Gender equality
Openalex Percentile: Top 32%
Mental Health via Writing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.