Syntax-guided multi-granularity fusion for multimodal aspect-based sentiment analysis
Multimodal Aspect-Based Sentiment Analysis (MABSA) aims to predict the sentiment polarity toward a given aspect term from social-media image–text pairs. Prior approaches often under-exploit hierarchical visual cues and do not explicitly leverage syntactic constraints to bind aspect terms with their sentiment-bearing opinion expressions, which weakens aspect-specific cross-modal alignment under noisy visual content. To this end, we propose a Multi-Granularity Gated Fusion Network (MGGFN) that couples syntax-aware evidence modeling with multi-granularity visual–text representation learning. MGGFN constructs a weighted graph by combining probabilistic dependency weights with semantic similarities between visually enhanced textual nodes. Scene-level captions and face-level descriptions provide global visual-semantic context. An adaptive gating mechanism then integrates global context and local evidence for aspect-level sentiment prediction. Experiments on Twitter-2015 and Twitter-2017 show that MGGFN achieves mean macro-F1 scores of 73.2 and 69.6, respectively, across three runs. Among the compared methods, MGGFN demonstrates competitive performance on both datasets, supporting its effectiveness for aspect-level multimodal sentiment prediction. The source code is publicly available at: https://github.com/BlackHand12138/MGGFN-MABSA.git .
Authors
- Peisen Tan (ORCID: https://orcid.org/0000-0003-4621-2845)
- Xinyu Wang (ORCID: https://orcid.org/0000-0002-9599-4743)
- Yuhang Gao (ORCID: https://orcid.org/0009-0006-1645-2636)
- Zhaobin Tan (ORCID: https://orcid.org/0009-0006-6241-1237)
- Beining Cui
- Lv Xiao
Institutions
- North China Institute of Aerospace Engineering (CN)
Publication Details
- Journal
- Scientific Reports
- Published
- 2026-11-17
- DOI
- https://doi.org/10.1038/s41598-026-80989-x
- Primary Topic
- Sentiment Analysis and Opinion Mining
- Type
- article
- Field-Weighted Citation Impact
- 0.00