Multimodal sentiment analysis based on exchange fusion
To address the challenges faced by existing sentiment analysis models in handling redundant information, disparities in modality emotion representation, and low cross-modal interaction efficiency, this paper proposes a multimodal sentiment analysis model based on exchange fusion. The model first extracts features from each modality through a modality embedding layer and removes redundant information. Then, in the exchange fusion module, the language modality serves as the dominant modality, interacting layer by layer with the visual and audio modalities, gradually eliminating redundancies and conflicts between modalities while fully leveraging the complementary advantages of each modality. Experimental results show that the model achieves sentiment binary classification accuracy of 88.26%, 87.62%, and 81.18% on the public datasets CMU-MOSI, CMU-MOSEI, and CH-SIMS, respectively, demonstrating excellent performance.
Authors
- Mairidan Wushouer (ORCID: https://orcid.org/0000-0002-9480-6915)
- Freddie H. Fu (ORCID: https://orcid.org/0000-0001-7821-4269)
- Gulanbaier Tuerhong (ORCID: https://orcid.org/0000-0003-2441-2483)
Institutions
- Xinjiang University (CN)
Publication Details
- Published
- 2025-07-16
- DOI
- https://doi.org/10.1117/12.3070902
- Primary Topic
- Sentiment Analysis and Opinion Mining
- Type
- article
- Field-Weighted Citation Impact
- 0.00