Comparison of Depression Detection Between LLMs and Zero-Shot Learning Using DAD Dataset

Early and accurate detection of depression is critical for improving mental health outcomes. Yet, selecting an appropriate machine learning approach remains challenging due to differences in data availability, annotation costs, and computational resources. Fine-tuned Large Language Models (LLMs) and Zero-Shot Learning (ZSL) represent fundamentally distinct paradigms for natural language understanding tasks. Comparing these approaches is crucial because LLMs rely on large, labeled datasets, while ZSL provides a practical alternative in scenarios with limited or no annotated data. Despite their growing application, these methods are often studied in isolation, leaving a gap in understanding their relative advantages and trade-offs. This study addresses this gap by evaluating the performance of a fine-tuned BERT-LLM and a BART-based ZSL model on our custom-made Depression Analysis Dataset (DAD). Our research experiments showed that the fine-tuned BERT-LLM achieved accuracy and F1 scores of 98.94% and 99.24 %, respectively, while the BART-ZSL model attained 76.53% and 81.26%. The findings highlight the suitability of LLMs for high-reliability settings and ZSL for early detection in resource-constrained contexts, providing actionable insights for data scientists and mental health practitioners to design effective and accessible depression detection systems.

Authors

Institutions

Publication Details

Published
2025-02-07
DOI
https://doi.org/10.1109/cspa64953.2025.10933098
Citations
3
Primary Topic
Mental Health via Writing
Type
article
Field-Weighted Citation Impact
4.88
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Comparison of Depression Detection Between LLMs and Zero-Shot Learning Using DAD Dataset

Richard T.K. Wong, Bayan Issa, Hui Na Chua, Muhammed Basheer Jasser et al.
3 citations
Mental Health via Writing
4.88
article

Comparison of Depression Detection Between LLMs and Zero-Shot Learning Using DAD Dataset

Richard T.K. Wong, Bayan Issa, Hui Na Chua, Muhammed Basheer Jasser, Justin J. D. Leow
article en
3 citations

Abstract

Early and accurate detection of depression is critical for improving mental health outcomes. Yet, selecting an appropriate machine learning approach remains challenging due to differences in data availability, annotation costs, and computational resources. Fine-tuned Large Language Models (LLMs) and Zero-Shot Learning (ZSL) represent fundamentally distinct paradigms for natural language understanding tasks. Comparing these approaches is crucial because LLMs rely on large, labeled datasets, while ZSL provides a practical alternative in scenarios with limited or no annotated data. Despite their growing application, these methods are often studied in isolation, leaving a gap in understanding their relative advantages and trade-offs. This study addresses this gap by evaluating the performance of a fine-tuned BERT-LLM and a BART-based ZSL model on our custom-made Depression Analysis Dataset (DAD). Our research experiments showed that the fine-tuned BERT-LLM achieved accuracy and F1 scores of 98.94% and 99.24 %, respectively, while the BART-ZSL model attained 76.53% and 81.26%. The findings highlight the suitability of LLMs for high-reliability settings and ZSL for early detection in resource-constrained contexts, providing actionable insights for data scientists and mental health practitioners to design effective and accessible depression detection systems.

University of Aleppo (SY), Sunway University (MY)
Openalex Percentile: Top 7%
Mental Health via Writing
4.88
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.