Multimodal Aspect-Level Sentiment Analysis Based on Attention Mechanism and Multi-Layer Perceptron
Multimodal Aspect-Based Sentiment Analysis aims to enhance sentiment classification accuracy by integrating information from multiple modalities, such as text and images. This paper introduces an enhanced method for multimodal sentiment analysis, leveraging the FITE model along with Multi-Layer Perceptron (MLP) and Multi-Head Self-Attention for better feature fusion. The approach first designs an effective fusion strategy to improve the interaction between modalities, then applies a gating mechanism to prioritize textual and visual information. Experiments on Twitter-2015 and Twitter-2017 datasets show the model outperforms existing baselines in precision and F1 score. The model also demonstrates robustness and adapts well to modality variations. Future work will aim at improving cross-domain adaptability, optimizing feature fusion, and applying the model in real-time sentiment analysis.
Authors
- Zhenghao Huang (ORCID: https://orcid.org/0000-0001-5848-2012)
- Rongyi Cui (ORCID: https://orcid.org/0000-0003-2968-8921)
- Guozhe Jin (ORCID: https://orcid.org/0000-0002-1835-1613)
- Bin Liu (ORCID: https://orcid.org/0000-0002-7028-5334)
- Yahui Zhao
- Meiyu Du
Institutions
- Yanbian University (CN)
Publication Details
- Published
- 2025-04-23
- DOI
- https://doi.org/10.1109/acctcs66275.2025.00016
- Primary Topic
- Advanced Computing and Algorithms
- Type
- article
- Field-Weighted Citation Impact
- 0.00