Multimodal Aspect-Level Sentiment Analysis Based on Attention Mechanism and Multi-Layer Perceptron

Multimodal Aspect-Based Sentiment Analysis aims to enhance sentiment classification accuracy by integrating information from multiple modalities, such as text and images. This paper introduces an enhanced method for multimodal sentiment analysis, leveraging the FITE model along with Multi-Layer Perceptron (MLP) and Multi-Head Self-Attention for better feature fusion. The approach first designs an effective fusion strategy to improve the interaction between modalities, then applies a gating mechanism to prioritize textual and visual information. Experiments on Twitter-2015 and Twitter-2017 datasets show the model outperforms existing baselines in precision and F1 score. The model also demonstrates robustness and adapts well to modality variations. Future work will aim at improving cross-domain adaptability, optimizing feature fusion, and applying the model in real-time sentiment analysis.

Authors

Institutions

Publication Details

Published
2025-04-23
DOI
https://doi.org/10.1109/acctcs66275.2025.00016
Primary Topic
Advanced Computing and Algorithms
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multimodal Aspect-Level Sentiment Analysis Based on Attention Mechanism and Multi-Layer Perceptron

Zhenghao Huang, Rongyi Cui, Guozhe Jin, Bin Liu et al.
Advanced Computing and Algorithms
article

Multimodal Aspect-Level Sentiment Analysis Based on Attention Mechanism and Multi-Layer Perceptron

Zhenghao Huang, Rongyi Cui, Guozhe Jin, Bin Liu, Yahui Zhao, Meiyu Du
article en

Abstract

Multimodal Aspect-Based Sentiment Analysis aims to enhance sentiment classification accuracy by integrating information from multiple modalities, such as text and images. This paper introduces an enhanced method for multimodal sentiment analysis, leveraging the FITE model along with Multi-Layer Perceptron (MLP) and Multi-Head Self-Attention for better feature fusion. The approach first designs an effective fusion strategy to improve the interaction between modalities, then applies a gating mechanism to prioritize textual and visual information. Experiments on Twitter-2015 and Twitter-2017 datasets show the model outperforms existing baselines in precision and F1 score. The model also demonstrates robustness and adapts well to modality variations. Future work will aim at improving cross-domain adaptability, optimizing feature fusion, and applying the model in real-time sentiment analysis.

Yanbian University (CN)
Openalex Percentile: Top 69%
Advanced Computing and Algorithms
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.