Three-dimensional face reconstruction for emotional dynamics: a novel approach to distinguishing bipolar disorder from major depressive disorder
Major depressive disorder (MDD) and bipolar disorder (BD) are frequently misdiagnosed in clinical practice due to their overlapping symptoms, resulting in delayed treatment and an increased burden on patients. Reliable biomarkers for early differential diagnosis are currently lacking. To address this, we developed a clinical facial video dataset of patients with BD and MDD and introduced an adaptive-shape vision-to-language model (AsmV2L), a vision-language-guided fine-grained three-dimensional (3D) face reconstruction framework that better preserves affect-related facial cues from monocular videos. Using valence-arousal (VA) representations estimated from these reconstructed 3D faces, we identified distinct affective patterns that differentiated the two disorders. In the subject-level downstream evaluation, the emotional dynamic features extracted by our framework achieved 88.9% accuracy in distinguishing BD from MDD. Additionally, experiments on public benchmark datasets demonstrated that AsmV2L maintained competitive 3D reconstruction accuracy while preserving emotion-related semantic information more effectively.
Authors
- Shaohua Hu (ORCID: https://orcid.org/0000-0003-0570-670X)
- Jingkai Chen (ORCID: https://orcid.org/0000-0002-7830-2039)
- Xin Xu (ORCID: https://orcid.org/0000-0002-4639-6480)
- Jinchao Ge (ORCID: https://orcid.org/0000-0002-2192-200X)
- Tao Du
- Hong Lyu
- Yutong Zhang
Institutions
- Shenyang Ligong University (CN)
- Allen Institute for Brain Science (US)
- Loughborough University (GB)
- University of Wollongong (AU)
- Zhejiang Lab (CN)
- Second Affiliated Hospital of Zhejiang University (CN)
- First Affiliated Hospital Zhejiang University (CN)
- Zhejiang University (CN)
Publication Details
- Journal
- Journal of Zhejiang University SCIENCE B
- Published
- 2026-09-12
- DOI
- https://doi.org/10.1631/jzus.b2500705
- Primary Topic
- Emotion and Mood Recognition
- Type
- article
- Field-Weighted Citation Impact
- 0.00