Empathetic AI for Mental Health: A Comparative Study of Retrieval-Augmented Language Models in CBT Applications

The global mental health crisis has underscored the urgent need for scalable, accessible, and cost-effective support systems. This study presents MindHaven, an AI-driven chatbot designed to deliver personalized mental health support based on Cognitive Behavioral Therapy (CBT) principles. Leveraging state-of-the-art Large Language Models (LLMs), including Llama-3.2-3B-Instruct, BlenderBot, and Retrieval-Augmented Generation (RAG)-enhanced architectures, we systematically evaluate chatbot efficacy in generating empathetic, contextually relevant, and clinically informed responses. A rigorous comparative analysis was conducted across twelve transformer-based models, fine-tuned on 99,086 structured therapeutic dialogues. Model performance was assessed using quantitative NLP metrics (ROUGE, BLEU, Semantic Similarity) and qualitative human evaluations. Results indicate that Llama-3.2-3B-Instruct achieved the highest semantic similarity score of 0.8123, while DistilGPT-2 with RAG demonstrated a 15.4% improvement in response factuality over non-RAG models. Additionally, Llama-3.2-3B-bnb-4bit obtained the lowest training loss (0.6051), significantly outperforming larger models such as MedAlpaca-7B. These findings suggest that parameter-efficient architectures can rival larger models in mental health applications. Despite promising advancements, challenges remain in long-term context retention, ethical safeguards, and crisis intervention capabilities. Future work will focus on multi-lingual generalization, dynamic memory augmentation, and psychologist-in-the-loop validation to ensure clinical safety and efficacy. By bridging cutting-edge AI with evidence-based mental health interventions, this research lays a foundation for the responsible deployment of scalable, AI-assisted therapeutic solutions, with potential applications in digital psychiatry, mental wellness apps, and hybrid human-AI therapy frameworks.

Authors

Institutions

Publication Details

Published
2025-07-12
DOI
https://doi.org/10.1109/imsa65733.2025.11166690
Primary Topic
Mental Health via Writing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Empathetic AI for Mental Health: A Comparative Study of Retrieval-Augmented Language Models in CBT Applications

Ahmed Yahia, Noha Gamal El-Din Saad, Nasr M. Radwan, Ahmed Amin et al.
Mental Health via Writing
article

Empathetic AI for Mental Health: A Comparative Study of Retrieval-Augmented Language Models in CBT Applications

Ahmed Yahia, Noha Gamal El-Din Saad, Nasr M. Radwan, Ahmed Amin, Mohamed Bakry, Ibrahim Ahmed, Nourhan Yossef
article en

Abstract

The global mental health crisis has underscored the urgent need for scalable, accessible, and cost-effective support systems. This study presents MindHaven, an AI-driven chatbot designed to deliver personalized mental health support based on Cognitive Behavioral Therapy (CBT) principles. Leveraging state-of-the-art Large Language Models (LLMs), including Llama-3.2-3B-Instruct, BlenderBot, and Retrieval-Augmented Generation (RAG)-enhanced architectures, we systematically evaluate chatbot efficacy in generating empathetic, contextually relevant, and clinically informed responses. A rigorous comparative analysis was conducted across twelve transformer-based models, fine-tuned on 99,086 structured therapeutic dialogues. Model performance was assessed using quantitative NLP metrics (ROUGE, BLEU, Semantic Similarity) and qualitative human evaluations. Results indicate that Llama-3.2-3B-Instruct achieved the highest semantic similarity score of 0.8123, while DistilGPT-2 with RAG demonstrated a 15.4% improvement in response factuality over non-RAG models. Additionally, Llama-3.2-3B-bnb-4bit obtained the lowest training loss (0.6051), significantly outperforming larger models such as MedAlpaca-7B. These findings suggest that parameter-efficient architectures can rival larger models in mental health applications. Despite promising advancements, challenges remain in long-term context retention, ethical safeguards, and crisis intervention capabilities. Future work will focus on multi-lingual generalization, dynamic memory augmentation, and psychologist-in-the-loop validation to ensure clinical safety and efficacy. By bridging cutting-edge AI with evidence-based mental health interventions, this research lays a foundation for the responsible deployment of scalable, AI-assisted therapeutic solutions, with potential applications in digital psychiatry, mental wellness apps, and hybrid human-AI therapy frameworks.

Nile University (EG)
Openalex Percentile: Top 70%
Mental Health via Writing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Empathetic AI for Mental Health: A Comparative Study of Retrieval-Augmented Language Models in CBT Applications — Ahmed Yahia, Noha Gamal El-Din Saad, et al. · (2025) | TGRS Research Map | TGRS