Harnessing Deep Learning for Mental Health: A Comparative Study of BERT, LSTM, and GPT-2

Mental health disorders in particular depression threaten the lives of millions of people worldwide, making early detection vital for timely intervention. With the emergence of social media, user-generated posts present an extensive repository of data for studying mental health disorders.The present study examines various deep learning models including BERT, LSTM and GPT-2 for detecting depressive symptoms in social media text. A Mental Health Social Media Dataset made available by Kaggle was used to carry out binary classification of the posts, as either depressed or not depressed.The models were fine-tuned and evaluated based on the metrics of accuracy, precision, recall, F1-score and AUC-ROC.From the experimental results, BERT performed the best, achieving an accuracy of 91.38% and AUC-ROC of 0.97 compared to 90.15% for GPT-2 and 81.72% for LSTM.BERT was excellent in understanding context where GPT-2 could analyze conversation well, and LSTM was best in computational efficiency.This study emphasizes deep learning techniques for mental health prediction and discusses challenges with respect to model interpretability, dataset bias, and real-time deployment. Future work should focus on multimodal learning, bias reduction, and Explainable AI (XAI) for enhanced transparency and ethical deployment within mental health diagnosis.

Authors

Institutions

Publication Details

Published
2025-05-23
DOI
https://doi.org/10.1109/incet64471.2025.11140291
Primary Topic
Machine Learning in Healthcare
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Harnessing Deep Learning for Mental Health: A Comparative Study of BERT, LSTM, and GPT-2

Himanshu Himanshu, Debangan Mandal
Machine Learning in Healthcare
article

Harnessing Deep Learning for Mental Health: A Comparative Study of BERT, LSTM, and GPT-2

Himanshu Himanshu, Debangan Mandal
article en

Abstract

Mental health disorders in particular depression threaten the lives of millions of people worldwide, making early detection vital for timely intervention. With the emergence of social media, user-generated posts present an extensive repository of data for studying mental health disorders.The present study examines various deep learning models including BERT, LSTM and GPT-2 for detecting depressive symptoms in social media text. A Mental Health Social Media Dataset made available by Kaggle was used to carry out binary classification of the posts, as either depressed or not depressed.The models were fine-tuned and evaluated based on the metrics of accuracy, precision, recall, F1-score and AUC-ROC.From the experimental results, BERT performed the best, achieving an accuracy of 91.38% and AUC-ROC of 0.97 compared to 90.15% for GPT-2 and 81.72% for LSTM.BERT was excellent in understanding context where GPT-2 could analyze conversation well, and LSTM was best in computational efficiency.This study emphasizes deep learning techniques for mental health prediction and discusses challenges with respect to model interpretability, dataset bias, and real-time deployment. Future work should focus on multimodal learning, bias reduction, and Explainable AI (XAI) for enhanced transparency and ethical deployment within mental health diagnosis.

Lovely Professional University (IN)
Openalex Percentile: Top 88%
Machine Learning in Healthcare
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Harnessing Deep Learning for Mental Health: A Comparative Study of BERT, LSTM, and GPT-2 — Himanshu Himanshu, Debangan Mandal · (2025) | TGRS Research Map | TGRS