Comparison of Depression Detection Between LLMs and Zero-Shot Learning Using DAD Dataset
Early and accurate detection of depression is critical for improving mental health outcomes. Yet, selecting an appropriate machine learning approach remains challenging due to differences in data availability, annotation costs, and computational resources. Fine-tuned Large Language Models (LLMs) and Zero-Shot Learning (ZSL) represent fundamentally distinct paradigms for natural language understanding tasks. Comparing these approaches is crucial because LLMs rely on large, labeled datasets, while ZSL provides a practical alternative in scenarios with limited or no annotated data. Despite their growing application, these methods are often studied in isolation, leaving a gap in understanding their relative advantages and trade-offs. This study addresses this gap by evaluating the performance of a fine-tuned BERT-LLM and a BART-based ZSL model on our custom-made Depression Analysis Dataset (DAD). Our research experiments showed that the fine-tuned BERT-LLM achieved accuracy and F1 scores of 98.94% and 99.24 %, respectively, while the BART-ZSL model attained 76.53% and 81.26%. The findings highlight the suitability of LLMs for high-reliability settings and ZSL for early detection in resource-constrained contexts, providing actionable insights for data scientists and mental health practitioners to design effective and accessible depression detection systems.
Authors
- Richard T.K. Wong (ORCID: https://orcid.org/0000-0002-4480-5076)
- Bayan Issa (ORCID: https://orcid.org/0000-0002-7559-3416)
- Hui Na Chua (ORCID: https://orcid.org/0000-0001-9792-1292)
- Muhammed Basheer Jasser (ORCID: https://orcid.org/0000-0001-5292-465X)
- Justin J. D. Leow
Institutions
- University of Aleppo (SY)
- Sunway University (MY)
Publication Details
- Published
- 2025-02-07
- DOI
- https://doi.org/10.1109/cspa64953.2025.10933098
- Citations
- 3
- Primary Topic
- Mental Health via Writing
- Type
- article
- Field-Weighted Citation Impact
- 4.88