Enhancing Multimodal Sentiment Analysis with Dynamic Weight Adjustment and Adversarial Training

Multimodal emotion recognition is a challenging task due to the complexity and variability of human emotions across different modalities. In this paper, we propose an innovative framework that integrates dynamic weight adjustment and adversarial training to enhance the robustness and accuracy of emotion recognition models. The dynamic weight adjustment module leverages statistical properties and entropy values to optimize modality weights, while the adversarial training module generates emotion-label-based adversarial samples to improve model resilience against noise and incomplete data. Extensive experiments on benchmark datasets demonstrate that our approach significantly outperforms existing methods in terms of both robustness and accuracy, making it a promising solution for real-world multimodal emotion recognition applications.

Authors

Institutions

Publication Details

Published
2024-11-01
DOI
https://doi.org/10.1109/cac63892.2024.10865061
Citations
1
Primary Topic
Anomaly Detection Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Multimodal Sentiment Analysis with Dynamic Weight Adjustment and Adversarial Training

Xiwei Liu, Yilin Zhu
1 citations
Anomaly Detection Techniques and Applications
0.35
article

Enhancing Multimodal Sentiment Analysis with Dynamic Weight Adjustment and Adversarial Training

Xiwei Liu, Yilin Zhu
article en
1 citations

Abstract

Multimodal emotion recognition is a challenging task due to the complexity and variability of human emotions across different modalities. In this paper, we propose an innovative framework that integrates dynamic weight adjustment and adversarial training to enhance the robustness and accuracy of emotion recognition models. The dynamic weight adjustment module leverages statistical properties and entropy values to optimize modality weights, while the adversarial training module generates emotion-label-based adversarial samples to improve model resilience against noise and incomplete data. Extensive experiments on benchmark datasets demonstrate that our approach significantly outperforms existing methods in terms of both robustness and accuracy, making it a promising solution for real-world multimodal emotion recognition applications.

Chinese Academy of Sciences (CN), Institute of Automation (CN)
Openalex Percentile: Top 29%
Anomaly Detection Techniques and Applications
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.