Multimodal Sentiment Analysis Based on Heterogeneous Directed Acyclic Graph Neural Networks
In multimodal sentiment analysis, existing methods often struggle with dynamic context modeling in multi-speaker dialogues, speaker interaction, and effective multimodal fusion. To address this, we propose a model based on a heterogeneous directed acyclic graph neural network. It uses BiLSTM and Gated TCN for multi-granularity context modeling and introduces speaker embeddings to capture individual expression differences. The DAG structure helps avoid cyclic dependencies and oversmoothing in traditional GNNs. Experiments show weighted F1 scores of $\mathbf{7 0. 6 8 \%}$ on IEMOCAP and $\mathbf{6 0. 8 3 \%}$ on MELD.
Authors
- Xiaohong Qin (ORCID: https://orcid.org/0000-0003-4663-903X)
- Ying Chen (ORCID: https://orcid.org/0000-0002-1620-9904)
- Zijian Ma
- Runchun Fan
Institutions
- Xidian University (CN)
- Beijing Electronic Science and Technology Institute (CN)
Publication Details
- Published
- 2025-05-29
- DOI
- https://doi.org/10.1109/icaide65466.2025.11189773
- Primary Topic
- Advanced Computational Techniques and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00