Hierarchical Contrastive Attention and Dynamically Heterogeneous Fusion-Based Multimodal Sentiment Synergistic Analysis Model
Multimodal sentiment analysis plays a crucial role in intelligent human-computer interaction, personalized recommendation systems, and psychological health monitoring. However, existing models still struggle with modality heterogeneity, dynamic interaction modeling, and sentiment feature extraction. To address these limitations, this paper proposes a Hierarchical Contrastive Attention and Dynamically Heterogeneous Fusion-Based Multimodal Sentiment Synergistic Analysis Model, which employs a dual-network framework to enhance cross-modal information fusion. The experimental results demonstrate that HCD-MSA achieves significantly higher accuracy, recall, and F1-score compared to existing models on both the CMU-MOSEI and IEMOCAP datasets. Furthermore, ablation studies confirm the effectiveness of each module. This research offers new insights into multimodal sentiment analysis, providing both theoretical support and practical guidance for cross-modal information fusion and sentiment recognition.
Authors
- Jinghao Qu (ORCID: https://orcid.org/0000-0003-2368-3708)
- Siyu Tian (ORCID: https://orcid.org/0009-0008-7337-7016)
- Wei Shi (ORCID: https://orcid.org/0000-0001-6499-2473)
- Jiatian Zhang (ORCID: https://orcid.org/0009-0006-0257-8932)
- Xilai Wang
Institutions
- Henan University of Technology (CN)
- Harbin University of Commerce (CN)
- IMDEA Materials (ES)
- Zhengzhou Business University (CN)
Publication Details
- Published
- 2025-03-28
- DOI
- https://doi.org/10.1109/aiita65135.2025.11048173
- Primary Topic
- Simulation and Modeling Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00