Depression detection using deep learning and large language models from multimodalities

Depression is a complex psychiatric disorder that affects neural functioning, cognition, emotion, and behavior, making objective assessment a persistent clinical challenge. Traditional diagnostic methods depend on subjective interpretation, whereas recent advances in deep learning have enabled automated, data-driven detection across physiological and behavioral modalities. Among unimodal approaches, electroencephalography (EEG) remains the most widely used due to its sensitivity to depression-related neurophysiological alterations. However, EEG models often rely on small, homogeneous datasets and controlled laboratory conditions, limiting their generalizability. Multimodal architectures that integrate speech, facial expression, and EEG features provide richer representations and consistently outperform single-modality systems. Transformer-based fusion mechanisms and attention-guided models effectively capture complementary cross-modal cues, achieving 90%-95% accuracy on controlled laboratory datasets such as SEED-IV, while yielding more conservative F1-scores of approximately 0.80-0.90 on ecologically valid community datasets such as DAIC-WOZ. The emergence of Large Language Models (LLMs) represents a further methodological shift, offering cross-modal alignment, contextual inference, and data-efficient adaptation through unified embedding spaces and few-shot capabilities. This mini-review synthesizes recent advances in EEG-based, multimodal, and LLM-driven depression detection. It evaluates how modality diversity and architectural sophistication enhance performance while critically examining persisting limitations in dataset diversity, standardization, interpretability, and clinical validation. The convergence of multimodal deep learning with LLM reasoning signals a promising direction toward scalable, explainable, and clinically deployable AI systems for the assessment of objective depression.

Authors

Institutions

Publication Details

Journal
Frontiers in Digital Health
Published
2026-03-09
DOI
https://doi.org/10.3389/fdgth.2026.1759857
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Depression detection using deep learning and large language models from multimodalities

Asima Khan, Aamir Saeed Malik, Yasir Hussain, Muhammad Asad Zaheer
Frontiers in Digital Health
Emotion and Mood Recognition
article

Depression detection using deep learning and large language models from multimodalities

Asima Khan, Aamir Saeed Malik, Yasir Hussain, Muhammad Asad Zaheer
article en

Abstract

Depression is a complex psychiatric disorder that affects neural functioning, cognition, emotion, and behavior, making objective assessment a persistent clinical challenge. Traditional diagnostic methods depend on subjective interpretation, whereas recent advances in deep learning have enabled automated, data-driven detection across physiological and behavioral modalities. Among unimodal approaches, electroencephalography (EEG) remains the most widely used due to its sensitivity to depression-related neurophysiological alterations. However, EEG models often rely on small, homogeneous datasets and controlled laboratory conditions, limiting their generalizability. Multimodal architectures that integrate speech, facial expression, and EEG features provide richer representations and consistently outperform single-modality systems. Transformer-based fusion mechanisms and attention-guided models effectively capture complementary cross-modal cues, achieving 90%-95% accuracy on controlled laboratory datasets such as SEED-IV, while yielding more conservative F1-scores of approximately 0.80-0.90 on ecologically valid community datasets such as DAIC-WOZ. The emergence of Large Language Models (LLMs) represents a further methodological shift, offering cross-modal alignment, contextual inference, and data-efficient adaptation through unified embedding spaces and few-shot capabilities. This mini-review synthesizes recent advances in EEG-based, multimodal, and LLM-driven depression detection. It evaluates how modality diversity and architectural sophistication enhance performance while critically examining persisting limitations in dataset diversity, standardization, interpretability, and clinical validation. The convergence of multimodal deep learning with LLM reasoning signals a promising direction toward scalable, explainable, and clinically deployable AI systems for the assessment of objective depression.

Frontiers in Digital HealthVol. 8
Korean Council for University Education (KR), University of Education (PK), Brno University of Technology (CZ)
Quality Education
Openalex Percentile: Top 33%
Emotion and Mood Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.