Reward-Guided Dynamic Fusion and Modality Decoupling for Enhanced Multimodal Sentiment Analysis
Multimodal Sentiment Analysis (MSA) integrates multiple modalities to better understand human emotions. However, existing methods often neglect heterogeneity among modal features, causing redundancy and inconsistencies. Additionally, the dynamic interplay between modalities is frequently ignored during fusion, limiting performance. To address these issues, we propose Reward-Guided Dynamic Fusion and Modality Decoupling (RDFD). RDFD includes two key components: (1) a feature decoupling module that separates modality-specific and modality-shared features, reducing redundancy and conflicts; (2) a Reward-Guided Dynamic Fusion module that adaptively selects guiding modalities to enhance modality-specific representations and enable flexible fusion. Experiments on the CMU-MOSI and CMU-MOSEI datasets show that RDFD achieves state-of-the-art performance, demonstrating its effectiveness in advancing Multimodal Sentiment Analysis.
Authors
- Linsong Liu (ORCID: https://orcid.org/0009-0006-1978-2999)
- He Zhang (ORCID: https://orcid.org/0000-0003-3695-6250)
- Qi Yan (ORCID: https://orcid.org/0000-0002-5236-9673)
- Dequan An
- Yu Gu (ORCID: https://orcid.org/0009-0001-1576-8739)
- GAO Zichen
- Shuang Wang
Institutions
- Xidian University (CN)
- Harbin Engineering University (CN)
- Yantai University (CN)
- Northwest University (CN)
Publication Details
- Journal
- Electronics
- Published
- 2026-04-24
- DOI
- https://doi.org/10.3390/electronics15091813
- Primary Topic
- Emotion and Mood Recognition
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- National Key Research and Development Program of China