DEPRESSION CLASSIFICATION AND PREDICTION SYSTEM FROM USERS' DATA USING & MACHINE LEARNING TECHNIQUES

ABSTRACT Depression detection from social media texts, such as tweets and comments, is crucial for early intervention, potentiallypreventing severe outcomes like suicide. This study focuses on classifying depression intensity using a labelled Twitterdataset, employing four transformer-based pre-trained language models with fewer than 15 million tunable parameters: ElectraSmall Generator (ESG), Electra Small Discriminator (ESD), XtremeDistil-L6 (XDL), and Albert Base V2 (ABV). The modelswere fine-tuned using hyperparameter optimisation and evaluated on three depression intensity classes: severe, moderate,and mild. Performance metrics were calculated, including accuracy, F1 score, precision, recall, and specificity. A comparativeanalysis with Distil BERT, a larger model with 67 million parameters, revealed ESG as the top-performing model with an F1score of 89%, achieving better contextual understanding and faster training. This research underscores the potential oflightweight models for efficient and accurate depression detection, with recommendations for further optimizing ESG forresource-constrained environments.

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-08-02
DOI
https://doi.org/10.5281/zenodo.16725268
Primary Topic
Mental Health via Writing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

DEPRESSION CLASSIFICATION AND PREDICTION SYSTEM FROM USERS' DATA USING & MACHINE LEARNING TECHNIQUES

Zenodo (CERN European Organization for Nuclear Research)
Mental Health via Writing
article

DEPRESSION CLASSIFICATION AND PREDICTION SYSTEM FROM USERS' DATA USING & MACHINE LEARNING TECHNIQUES

article en

Abstract

ABSTRACT Depression detection from social media texts, such as tweets and comments, is crucial for early intervention, potentiallypreventing severe outcomes like suicide. This study focuses on classifying depression intensity using a labelled Twitterdataset, employing four transformer-based pre-trained language models with fewer than 15 million tunable parameters: ElectraSmall Generator (ESG), Electra Small Discriminator (ESD), XtremeDistil-L6 (XDL), and Albert Base V2 (ABV). The modelswere fine-tuned using hyperparameter optimisation and evaluated on three depression intensity classes: severe, moderate,and mild. Performance metrics were calculated, including accuracy, F1 score, precision, recall, and specificity. A comparativeanalysis with Distil BERT, a larger model with 67 million parameters, revealed ESG as the top-performing model with an F1score of 89%, achieving better contextual understanding and faster training. This research underscores the potential oflightweight models for efficient and accurate depression detection, with recommendations for further optimizing ESG forresource-constrained environments.

Zenodo (CERN European Organization for Nuclear Research)
Noida International University (IN)
Reduced inequalities
Openalex Percentile: Top 47%
Mental Health via Writing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

DEPRESSION CLASSIFICATION AND PREDICTION SYSTEM FROM USERS' DATA USING & MACHINE LEARNING TECHNIQUES · Zenodo (CERN European Organization for Nuclear Research) (2025) | TGRS Research Map | TGRS