FDC-MSA: Feature denoising and conflict decoupling for inconsistent multimodal sentiment analysis

Multimodal Sentiment Analysis (MSA) aims to capture complex emotions by integrating diverse modalities. However, existing methods often struggle to distinguish cross-modal consensus from conflicts, while facing challenges from redundant noise and feature manifold distortion. To address these issues, we propose FDC-MSA, a framework for noise suppression and conflict decoupling in inconsistent MSA. The model enhances sentiment modeling through three integrated components. First, a Variational Information Bottleneck (VIB) strategy is employed to compress and reconstruct auxiliary semantics. By suppressing task-irrelevant redundancy while maximizing sentiment sufficiency, it achieves semantic purification. Second, the Geometric Orthogonal Decoupling Routing (GODR) mechanism decomposes visual representations into consensus and specificity components, utilizing dynamic routing to adaptively model cross-modal conflicts. Furthermore, a Prototype-Guided Topology Rectification (PGTR) module stabilizes high-dimensional representation spaces by guiding feature distributions toward category structures. Experimental results on MVSA-Single, MVSA-Multiple, and HFM datasets demonstrate that FDC-MSA achieves state-of-the-art performance, notably reaching 78.96% accuracy on MVSA-Single. The framework exhibits superior robustness in handling text-image sentiment inconsistencies, validating the effectiveness of our denoising and decoupling strategies in complex cross-modal scenarios.

Authors

Institutions

Publication Details

Journal
Journal of King Saud University - Computer and Information Sciences
Published
2026-06-16
DOI
https://doi.org/10.1007/s44443-026-00935-9
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

FDC-MSA: Feature denoising and conflict decoupling for inconsistent multimodal sentiment analysis

Shujuan Ji, Yu Liu, Yiqun Li, DeHao Jiang et al.
Journal of King Saud University - Computer and Information Sciences
Emotion and Mood Recognition
article

FDC-MSA: Feature denoising and conflict decoupling for inconsistent multimodal sentiment analysis

Shujuan Ji, Yu Liu, Yiqun Li, DeHao Jiang, Na Su
article en

Abstract

Multimodal Sentiment Analysis (MSA) aims to capture complex emotions by integrating diverse modalities. However, existing methods often struggle to distinguish cross-modal consensus from conflicts, while facing challenges from redundant noise and feature manifold distortion. To address these issues, we propose FDC-MSA, a framework for noise suppression and conflict decoupling in inconsistent MSA. The model enhances sentiment modeling through three integrated components. First, a Variational Information Bottleneck (VIB) strategy is employed to compress and reconstruct auxiliary semantics. By suppressing task-irrelevant redundancy while maximizing sentiment sufficiency, it achieves semantic purification. Second, the Geometric Orthogonal Decoupling Routing (GODR) mechanism decomposes visual representations into consensus and specificity components, utilizing dynamic routing to adaptively model cross-modal conflicts. Furthermore, a Prototype-Guided Topology Rectification (PGTR) module stabilizes high-dimensional representation spaces by guiding feature distributions toward category structures. Experimental results on MVSA-Single, MVSA-Multiple, and HFM datasets demonstrate that FDC-MSA achieves state-of-the-art performance, notably reaching 78.96% accuracy on MVSA-Single. The framework exhibits superior robustness in handling text-image sentiment inconsistencies, validating the effectiveness of our denoising and decoupling strategies in complex cross-modal scenarios.

Journal of King Saud University - Computer and Information Sciences
Shandong University of Science and Technology (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 5%
Emotion and Mood Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.