Dual-Stream Neural Architecture for Integrative Analysis of Large Multimodal Model in Mood Disorder Classification
Mood disorders, particularly Bipolar Disorder (BD), present significant challenges in accurate diagnosis due to their complex neurobiological underpinnings. While recent advancements in neuroimaging techniques have provided valuable insights, the integration of multimodal data remains a critical challenge. This paper introduces a novel dual-stream neural architecture that leverages both structural and functional MRI data for mood disorder classification. Our large multimodal model uniquely combines advanced mathematical frameworks with domain adaptation techniques to address the inherent heterogeneity in neuroimaging data across different populations. We propose a theoretical foundation rooted in information geometry and optimal transport theory to formalize the domain adaptation problem in the context of neuroimaging analysis. Our method demonstrates superior performance in cross-domain mood disorder classification. Furthermore, we provide rigorous theoretical guarantees on the convergence and generalization capabilities of our model, establishing a new benchmark for robust and interpretable multimodal neuroimaging analysis in psychiatric diagnostics.
Authors
- Hedong Wang
- Haosong Ran (ORCID: https://orcid.org/0009-0007-8991-2629)
- Han Yu (ORCID: https://orcid.org/0000-0001-6893-8650)
- Tingsong Huang
- Ziyang Zhang (ORCID: https://orcid.org/0000-0001-8832-1754)
- Xianglong Li (ORCID: https://orcid.org/0000-0002-6200-1178)
Institutions
- University of Leeds (GB)
- Duke University (US)
- Coquitlam College (CA)
- New York University (US)
- Xi’an Jiaotong-Liverpool University (CN)
- University of Sheffield (GB)
Publication Details
- Published
- 2024-12-03
- DOI
- https://doi.org/10.1109/bibm62325.2024.10822402
- Primary Topic
- Mental Health Research Topics
- Type
- article
- Field-Weighted Citation Impact
- 0.00