Conflict-aware commonsense knowledge distillation with hypergraph reasoning for robust multimodal sentiment analysis
Existing graph-structured multimodal sentiment analysis (MSA) methods generally rely on heuristic topology construction and shallow statistical correlation modeling, making them susceptible to spurious semantic cues and modality bias under implicit sarcasm, semantic reversal, and cross-modal conflict scenarios. To address these limitations, this paper proposes CKD-MHR, a robust framework based on conflict-aware commonsense knowledge distillation and population manifold hypergraph reasoning. Specifically, the framework leverages a multimodal large language model (MLLM) to construct a commonsense knowledge elicitation (CKE) mechanism that extracts structured semantic rationales and conflict-aware signals from image–text pairs in a zero-shot manner. The same MLLM-derived semantic supervision jointly guides conflict-aware pathway allocation, rationale-derived intent-prototype hypergraph construction, and rationale-aligned contrastive learning. This coordinated design connects intra-sample interaction with cross-sample high-order semantic propagation while reducing reliance on misleading cross-modal associations. Experimental results show that CKD-MHR improves the F1 score by 2.89% over the strongest baseline on MVSA and achieves the best AUPRC, ACC, and F1 on Hateful Memes, while remaining competitive in MMSD2.0, indicating improved robustness to cross-modal conflicts and misleading cross-modal associations.
Authors
- Meng Du (ORCID: https://orcid.org/0000-0002-5397-2925)
- Zhanyou Ma (ORCID: https://orcid.org/0000-0002-1016-6608)
- Chenhui Deng
- Yanjie Zheng
Institutions
- State Ethnic Affairs Commission (CN)
- North Minzu University (CN)
Publication Details
- Journal
- Journal of King Saud University - Computer and Information Sciences
- Published
- 2026-09-25
- DOI
- https://doi.org/10.1007/s44443-026-01277-2
- Primary Topic
- Sentiment Analysis and Opinion Mining
- Type
- article
- Field-Weighted Citation Impact
- 0.00