Syntax-guided multi-granularity fusion for multimodal aspect-based sentiment analysis

Multimodal Aspect-Based Sentiment Analysis (MABSA) aims to predict the sentiment polarity toward a given aspect term from social-media image–text pairs. Prior approaches often under-exploit hierarchical visual cues and do not explicitly leverage syntactic constraints to bind aspect terms with their sentiment-bearing opinion expressions, which weakens aspect-specific cross-modal alignment under noisy visual content. To this end, we propose a Multi-Granularity Gated Fusion Network (MGGFN) that couples syntax-aware evidence modeling with multi-granularity visual–text representation learning. MGGFN constructs a weighted graph by combining probabilistic dependency weights with semantic similarities between visually enhanced textual nodes. Scene-level captions and face-level descriptions provide global visual-semantic context. An adaptive gating mechanism then integrates global context and local evidence for aspect-level sentiment prediction. Experiments on Twitter-2015 and Twitter-2017 show that MGGFN achieves mean macro-F1 scores of 73.2 and 69.6, respectively, across three runs. Among the compared methods, MGGFN demonstrates competitive performance on both datasets, supporting its effectiveness for aspect-level multimodal sentiment prediction. The source code is publicly available at: https://github.com/BlackHand12138/MGGFN-MABSA.git .

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-11-17
DOI
https://doi.org/10.1038/s41598-026-80989-x
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Syntax-guided multi-granularity fusion for multimodal aspect-based sentiment analysis

Peisen Tan, Xinyu Wang, Yuhang Gao, Zhaobin Tan et al.
3 links
Scientific Reports
Sentiment Analysis and Opinion Mining
article

Syntax-guided multi-granularity fusion for multimodal aspect-based sentiment analysis

Peisen Tan, Xinyu Wang, Yuhang Gao, Zhaobin Tan, Beining Cui, Lv Xiao
article en

Abstract

Multimodal Aspect-Based Sentiment Analysis (MABSA) aims to predict the sentiment polarity toward a given aspect term from social-media image–text pairs. Prior approaches often under-exploit hierarchical visual cues and do not explicitly leverage syntactic constraints to bind aspect terms with their sentiment-bearing opinion expressions, which weakens aspect-specific cross-modal alignment under noisy visual content. To this end, we propose a Multi-Granularity Gated Fusion Network (MGGFN) that couples syntax-aware evidence modeling with multi-granularity visual–text representation learning. MGGFN constructs a weighted graph by combining probabilistic dependency weights with semantic similarities between visually enhanced textual nodes. Scene-level captions and face-level descriptions provide global visual-semantic context. An adaptive gating mechanism then integrates global context and local evidence for aspect-level sentiment prediction. Experiments on Twitter-2015 and Twitter-2017 show that MGGFN achieves mean macro-F1 scores of 73.2 and 69.6, respectively, across three runs. Among the compared methods, MGGFN demonstrates competitive performance on both datasets, supporting its effectiveness for aspect-level multimodal sentiment prediction. The source code is publicly available at: https://github.com/BlackHand12138/MGGFN-MABSA.git .

Scientific Reports
North China Institute of Aerospace Engineering (CN)
Sentiment Analysis and Opinion Mining
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon