GHMCL: A diffusion-based generative hypergraph framework with multi-Scale contrastive learning
Multimodal Emotion Recognition in Conversation (MERC) requires models to capture high-order semantic relationships across modalities while staying robust to noise and structural uncertainty. Existing hypergraph methods usually depend on static or manually designed hyperedge structures, failing to model the complex, dynamically evolving dependencies in multimodal data. To tackle this issue, we propose the GHMCL framework. It generates dynamic hypergraphs through diffusion processes and integrates multiscale contrastive learning to synergistically optimize high-order structure modeling and discriminative feature learning. Concretely, we first build a diffusion-based hypergraph generation module. Via a stepwise denoising diffusion process, it adaptively generates and optimizes hyperedge structures, capturing flexible, globally consistent high-order semantic relationships and explicitly modeling structural uncertainty. On this basis, we design a multi-scale contrastive learning mechanism, covering local contrast between nodes and hyperedges, global contrast between same and different-type semantics, and an uncertainty confidence weighting mechanism derived from hyperedge weights. This boosts the model's robustness to noisy and ambiguous samples, strengthening feature representations with local structural consistency and global category discriminability. Experiments were conducted on the public datasets MELD and IEMOCAP. The results show that GHMCL outperforms mainstream baseline models in both F1-score and accuracy, thus verifying the effectiveness of the proposed GHMCL framework in multimodal emotion recognition tasks.
Authors
- Weijun Gao (ORCID: https://orcid.org/0000-0003-0299-3686)
- Chen Zhuyu
- Su Maotang
Publication Details
- Journal
- International Journal of Modern Physics C
- Published
- 2026-07-17
- DOI
- https://doi.org/10.1142/s0129183127501294
- Primary Topic
- Emotion and Mood Recognition
- Type
- article
- Field-Weighted Citation Impact
- 0.00