Research on Multimodal Sentiment Analysis Technique Based on Global Attention Mechanism

Emotion analysis, as the most active research field at present, has gradually moved from single mode to multi-mode. The purpose is to identify and understand human emotion state more accurately and analyze and understand complex emotional information more comprehensively by comprehensively utilizing the information in multiple modes (such as language, vision, audio, etc.). It has been developed to develop complex feature fusion techniques. At present, researchers are committed to the development of complex feature fusion techniques. However, due to the differences in the dimensions of different modes, the fusion process faces many challenges, which becomes the bottleneck of achieving efficient sentiment analysis. Aiming at this challenge, this paper proposes a solution of sentiment analysis based on global perception ability to effectively improve the fusion effect between modes and improve the accuracy of sentiment analysis. Based on the MISA framework, we optimized the mode processing method, projected each mode into two identical intervals of complementing each other. By introducing the strategies of invariant mode and specific mode, we solved the problem of commonness and characteristics in multi-mode fusion, reduced the gap between modes, and retained the unique characteristics of each mode. In doing so, the Global View Attention Mechanism (GVT) is combined to better capture long-distance dependencies and global features, enabling more accurate prediction of sentiment analysis tasks. Experimental results show that the optimized model performs significantly better than the existing baseline methods on MOSI and MOSEI public datasets.

Authors

Institutions

Publication Details

Published
2025-02-21
DOI
https://doi.org/10.1109/icicacs65178.2025.10968560
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on Multimodal Sentiment Analysis Technique Based on Global Attention Mechanism

Shoujin Wang, Ning Jin, Xiaobin Zhu
Sentiment Analysis and Opinion Mining
article

Research on Multimodal Sentiment Analysis Technique Based on Global Attention Mechanism

Shoujin Wang, Ning Jin, Xiaobin Zhu
article en

Abstract

Emotion analysis, as the most active research field at present, has gradually moved from single mode to multi-mode. The purpose is to identify and understand human emotion state more accurately and analyze and understand complex emotional information more comprehensively by comprehensively utilizing the information in multiple modes (such as language, vision, audio, etc.). It has been developed to develop complex feature fusion techniques. At present, researchers are committed to the development of complex feature fusion techniques. However, due to the differences in the dimensions of different modes, the fusion process faces many challenges, which becomes the bottleneck of achieving efficient sentiment analysis. Aiming at this challenge, this paper proposes a solution of sentiment analysis based on global perception ability to effectively improve the fusion effect between modes and improve the accuracy of sentiment analysis. Based on the MISA framework, we optimized the mode processing method, projected each mode into two identical intervals of complementing each other. By introducing the strategies of invariant mode and specific mode, we solved the problem of commonness and characteristics in multi-mode fusion, reduced the gap between modes, and retained the unique characteristics of each mode. In doing so, the Global View Attention Mechanism (GVT) is combined to better capture long-distance dependencies and global features, enabling more accurate prediction of sentiment analysis tasks. Experimental results show that the optimized model performs significantly better than the existing baseline methods on MOSI and MOSEI public datasets.

Shenyang Jianzhu University (CN)
Department of Education of Liaoning Province
Openalex Percentile: Top 96%
Sentiment Analysis and Opinion Mining
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.