Multimodal sentiment analysis based on exchange fusion

To address the challenges faced by existing sentiment analysis models in handling redundant information, disparities in modality emotion representation, and low cross-modal interaction efficiency, this paper proposes a multimodal sentiment analysis model based on exchange fusion. The model first extracts features from each modality through a modality embedding layer and removes redundant information. Then, in the exchange fusion module, the language modality serves as the dominant modality, interacting layer by layer with the visual and audio modalities, gradually eliminating redundancies and conflicts between modalities while fully leveraging the complementary advantages of each modality. Experimental results show that the model achieves sentiment binary classification accuracy of 88.26%, 87.62%, and 81.18% on the public datasets CMU-MOSI, CMU-MOSEI, and CH-SIMS, respectively, demonstrating excellent performance.

Authors

Institutions

Publication Details

Published
2025-07-16
DOI
https://doi.org/10.1117/12.3070902
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multimodal sentiment analysis based on exchange fusion

Mairidan Wushouer, Freddie H. Fu, Gulanbaier Tuerhong
Sentiment Analysis and Opinion Mining
article

Multimodal sentiment analysis based on exchange fusion

Mairidan Wushouer, Freddie H. Fu, Gulanbaier Tuerhong
article en

Abstract

To address the challenges faced by existing sentiment analysis models in handling redundant information, disparities in modality emotion representation, and low cross-modal interaction efficiency, this paper proposes a multimodal sentiment analysis model based on exchange fusion. The model first extracts features from each modality through a modality embedding layer and removes redundant information. Then, in the exchange fusion module, the language modality serves as the dominant modality, interacting layer by layer with the visual and audio modalities, gradually eliminating redundancies and conflicts between modalities while fully leveraging the complementary advantages of each modality. Experimental results show that the model achieves sentiment binary classification accuracy of 88.26%, 87.62%, and 81.18% on the public datasets CMU-MOSI, CMU-MOSEI, and CH-SIMS, respectively, demonstrating excellent performance.

Xinjiang University (CN)
Openalex Percentile: Top 91%
Sentiment Analysis and Opinion Mining
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.