Reliability-Aware Multi-View Fusion for Robust Multimodal Sarcasm Detection with Incomplete Observations
Multimodal sarcasm detection identifies ironic intent by jointly analyzing text and images. It has attracted increasing attention due to its importance in understanding user-generated content on social media. However, multimodal observations are often incomplete due to data loss during transmission or collection, leading to unreliable predictions in real-world multimodal sarcasm detection scenarios. To address incomplete observations, we further propose a Reliability-Aware Dynamic Fusion (RADF) module, which predicts the reliability of the textual, visual, and interactive views from their representations, converts these reliability scores into dynamic fusion weights via a temperature-scaled softmax to control the sharpness of the weight distribution, and refines the fused features through feature-wise scaling. In this way, degraded views are suppressed while more informative views are emphasized under incomplete observations. Extensive experiments on public datasets validate the effectiveness of our approach, which consistently outperforms existing baselines.
Authors
- Chao Kong (ORCID: https://orcid.org/0000-0002-4671-9825)
- Sanmin Liu (ORCID: https://orcid.org/0000-0002-0399-7737)
- 更治 筏
- Junjie Chen (ORCID: https://orcid.org/0009-0001-5288-048X)
- Subin Huang (ORCID: https://orcid.org/0000-0003-1886-4192)
- Hao Guo (ORCID: https://orcid.org/0009-0000-7703-8507)
Institutions
- Anhui University (CN)
- Anhui Polytechnic University (CN)
Publication Details
- Journal
- ACM Transactions on Multimedia Computing Communications and Applications
- Published
- 2026-06-18
- DOI
- https://doi.org/10.1145/3820382
- Primary Topic
- Sentiment Analysis and Opinion Mining
- Type
- article
- Field-Weighted Citation Impact
- 0.00