Machine Learning and Deep Learning Models for Predicting Mental Health Disorders and Performance Analysis through Chatbot Interactions

Mental health disorders have recently been prompting increased concern globally and finding new ways of diagnosing and treating them efficiently. Machine learning (ML) and deep learning (DL) enabled chatbots are enormous tool for predicting and supporting mental health. This work aims to carry out an assessment of several AI models for prognostics of mental health disorders based on the comparison of intents, patterns, and responses in a structured chatbot-based dataset. Since it is intent-based, our dataset is best suited to classifying user inputs accurately into different mental health thematic buckets such as anxiety, stress, and proved suicide ideation. To assess the models, we compared basic models such as Multinomial Naïve Bayes, Random Forest and SVM as well as deep learning models including LSTM networks. SVM and LSTM showed promising results among the tested models with the accuracy of 94.6%. LSTM was proved to address the problem of sequential context dependence typical for conversational data. For further improvement in the model’s accuracy, we used ensemble methods whose accuracy came out near like the highest accuracy models, 94.2% accurate. This work is new in the sense that it involves the use of data from an intent-based chatbot, and a comparison of the ML and DL models designed specifically for the prediction of mental health outcomes. Also, it is important to note that we dealt with underrepresented intents, including suicide ideation, using data augmentation and ensemble approach. It fills the gaps in the deployment of AI for mental health by providing recommendations concerning the model’s performance and possible ethical concerns as well as integrating it into conversational assistance. We also found the relevance of an AI chatbot in the delivery of efficient and easily deployable intervention for mental health.

Authors

Publication Details

Journal
European Journal of Computer Science and Information Technology
Published
2024-09-15
DOI
https://doi.org/10.37745/ejcsit.2013/vol12n93860
Citations
2
Primary Topic
Digital Mental Health Interventions
Type
article
Field-Weighted Citation Impact
0.82
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Machine Learning and Deep Learning Models for Predicting Mental Health Disorders and Performance Analysis through Chatbot Interactions

Sabrina Haque, Md Aminul Islam, Sakib Chowdhury, Md. Bahadur Badsha et al.
2 citations
European Journal of Computer Science and Information Technology
Digital Mental Health Interventions
0.82
article

Machine Learning and Deep Learning Models for Predicting Mental Health Disorders and Performance Analysis through Chatbot Interactions

Sabrina Haque, Md Aminul Islam, Sakib Chowdhury, Md. Bahadur Badsha, Abdul Rahim Abdullah, Md Al Nafiul Bary, Atia Farzana Chowdury
article en
2 citations

Abstract

Mental health disorders have recently been prompting increased concern globally and finding new ways of diagnosing and treating them efficiently. Machine learning (ML) and deep learning (DL) enabled chatbots are enormous tool for predicting and supporting mental health. This work aims to carry out an assessment of several AI models for prognostics of mental health disorders based on the comparison of intents, patterns, and responses in a structured chatbot-based dataset. Since it is intent-based, our dataset is best suited to classifying user inputs accurately into different mental health thematic buckets such as anxiety, stress, and proved suicide ideation. To assess the models, we compared basic models such as Multinomial Naïve Bayes, Random Forest and SVM as well as deep learning models including LSTM networks. SVM and LSTM showed promising results among the tested models with the accuracy of 94.6%. LSTM was proved to address the problem of sequential context dependence typical for conversational data. For further improvement in the model’s accuracy, we used ensemble methods whose accuracy came out near like the highest accuracy models, 94.2% accurate. This work is new in the sense that it involves the use of data from an intent-based chatbot, and a comparison of the ML and DL models designed specifically for the prediction of mental health outcomes. Also, it is important to note that we dealt with underrepresented intents, including suicide ideation, using data augmentation and ensemble approach. It fills the gaps in the deployment of AI for mental health by providing recommendations concerning the model’s performance and possible ethical concerns as well as integrating it into conversational assistance. We also found the relevance of an AI chatbot in the delivery of efficient and easily deployable intervention for mental health.

European Journal of Computer Science and Information TechnologyVol. 12(9)
Openalex Percentile: Top 22%
Digital Mental Health Interventions
0.82
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.