Enhanced Multimodal Depression Detection With Emotion Prompts
Depression is a pervasive mental health disorder that remains frequently undiagnosed and untreated due to societal barriers and the subjective nature of its symptoms. Leveraging recent advances in large language models (LLMs), we propose a novel depression detection pipeline that generates emotion prompts tailored to individual data, enhancing detection accuracy. Our approach integrates cross-modality fusion via cross attention mechanisms to combine depressive and emotional features, creating a comprehensive representation of depression indicators. Evaluated on the E-DAIC and EATD datasets, our method outperforms state-of-the-art techniques, demonstrating its potential for more precise emotion-based depression detection.
Authors
- Jiaqing Liu (ORCID: https://orcid.org/0000-0002-5340-7053)
- Tomoko Tateyama
- Yen‐Wei Chen (ORCID: https://orcid.org/0000-0002-5952-0188)
- Hao Sun (ORCID: https://orcid.org/0000-0001-8094-1991)
- Shiyu Teng (ORCID: https://orcid.org/0000-0001-7233-5027)
- Shurong Chai (ORCID: https://orcid.org/0000-0003-2252-6786)
- Lanfen Lin
Institutions
- Ritsumeikan University (JP)
- Fujita Health University (JP)
- Zhejiang University of Science and Technology (CN)
Publication Details
- Published
- 2025-03-12
- DOI
- https://doi.org/10.1109/icassp49660.2025.10889035
- Citations
- 1
- Primary Topic
- Emotion and Mood Recognition
- Type
- article
- Field-Weighted Citation Impact
- 2.12