Conflict-aware commonsense knowledge distillation with hypergraph reasoning for robust multimodal sentiment analysis

Existing graph-structured multimodal sentiment analysis (MSA) methods generally rely on heuristic topology construction and shallow statistical correlation modeling, making them susceptible to spurious semantic cues and modality bias under implicit sarcasm, semantic reversal, and cross-modal conflict scenarios. To address these limitations, this paper proposes CKD-MHR, a robust framework based on conflict-aware commonsense knowledge distillation and population manifold hypergraph reasoning. Specifically, the framework leverages a multimodal large language model (MLLM) to construct a commonsense knowledge elicitation (CKE) mechanism that extracts structured semantic rationales and conflict-aware signals from image–text pairs in a zero-shot manner. The same MLLM-derived semantic supervision jointly guides conflict-aware pathway allocation, rationale-derived intent-prototype hypergraph construction, and rationale-aligned contrastive learning. This coordinated design connects intra-sample interaction with cross-sample high-order semantic propagation while reducing reliance on misleading cross-modal associations. Experimental results show that CKD-MHR improves the F1 score by 2.89% over the strongest baseline on MVSA and achieves the best AUPRC, ACC, and F1 on Hateful Memes, while remaining competitive in MMSD2.0, indicating improved robustness to cross-modal conflicts and misleading cross-modal associations.

Authors

Institutions

Publication Details

Journal
Journal of King Saud University - Computer and Information Sciences
Published
2026-09-25
DOI
https://doi.org/10.1007/s44443-026-01277-2
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Conflict-aware commonsense knowledge distillation with hypergraph reasoning for robust multimodal sentiment analysis

Meng Du, Zhanyou Ma, Chenhui Deng, Yanjie Zheng
Journal of King Saud University - Computer and Information Sciences
Sentiment Analysis and Opinion Mining
article

Conflict-aware commonsense knowledge distillation with hypergraph reasoning for robust multimodal sentiment analysis

Meng Du, Zhanyou Ma, Chenhui Deng, Yanjie Zheng
article en

Abstract

Existing graph-structured multimodal sentiment analysis (MSA) methods generally rely on heuristic topology construction and shallow statistical correlation modeling, making them susceptible to spurious semantic cues and modality bias under implicit sarcasm, semantic reversal, and cross-modal conflict scenarios. To address these limitations, this paper proposes CKD-MHR, a robust framework based on conflict-aware commonsense knowledge distillation and population manifold hypergraph reasoning. Specifically, the framework leverages a multimodal large language model (MLLM) to construct a commonsense knowledge elicitation (CKE) mechanism that extracts structured semantic rationales and conflict-aware signals from image–text pairs in a zero-shot manner. The same MLLM-derived semantic supervision jointly guides conflict-aware pathway allocation, rationale-derived intent-prototype hypergraph construction, and rationale-aligned contrastive learning. This coordinated design connects intra-sample interaction with cross-sample high-order semantic propagation while reducing reliance on misleading cross-modal associations. Experimental results show that CKD-MHR improves the F1 score by 2.89% over the strongest baseline on MVSA and achieves the best AUPRC, ACC, and F1 on Hateful Memes, while remaining competitive in MMSD2.0, indicating improved robustness to cross-modal conflicts and misleading cross-modal associations.

Journal of King Saud University - Computer and Information SciencesVol. 38(8)
State Ethnic Affairs Commission (CN), North Minzu University (CN)
Peace, Justice and strong institutions
Openalex Percentile: Top 9%
Sentiment Analysis and Opinion Mining
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.