Large Language Model–Driven Multimodal Framework for Social Media Depression Detection

Depression, the second leading cause of disability worldwide, is a prevalent and increasingly widespread mental disorder. Traditional diagnostic methods rely on patient communication and subjective cooperation, incurring significant costs in labor, resources, and time. With the accumulation of user data on social media and advancements in large language models (LLMs), computer-aided diagnosis has become feasible, offering more objective and efficient analysis for depression detection and presenting novel research directions. We propose a novel Large Language Model (LLM)-based multimodal framework integrating textual content from historical social media posts and nonlinguistic user behavioral data. Our method detects depressive tendencies with improved accuracy. Experimental results on a public multimodal Twitter dataset demonstrate substantial performance gains over standalone LLMs, achieving state-of-theart effectiveness.

Authors

Institutions

Publication Details

Published
2025-06-20
DOI
https://doi.org/10.1109/caibda65784.2025.11182958
Primary Topic
Mental Health via Writing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Large Language Model–Driven Multimodal Framework for Social Media Depression Detection

Jing Ma, Cuong Dang, Yueheng Liu, Ziyuan Li
Mental Health via Writing
article

Large Language Model–Driven Multimodal Framework for Social Media Depression Detection

Jing Ma, Cuong Dang, Yueheng Liu, Ziyuan Li
article en

Abstract

Depression, the second leading cause of disability worldwide, is a prevalent and increasingly widespread mental disorder. Traditional diagnostic methods rely on patient communication and subjective cooperation, incurring significant costs in labor, resources, and time. With the accumulation of user data on social media and advancements in large language models (LLMs), computer-aided diagnosis has become feasible, offering more objective and efficient analysis for depression detection and presenting novel research directions. We propose a novel Large Language Model (LLM)-based multimodal framework integrating textual content from historical social media posts and nonlinguistic user behavioral data. Our method detects depressive tendencies with improved accuracy. Experimental results on a public multimodal Twitter dataset demonstrate substantial performance gains over standalone LLMs, achieving state-of-theart effectiveness.

China Electronics Technology Group Corporation (CN)
Openalex Percentile: Top 67%
Mental Health via Writing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.