Unifying Within and Across: Intra-Modality Multi-View Fusion and Inter-Modality Alignment for Knowledge Graph Completion
Multi-modal knowledge graph completion (MMKGC) enhances the structural and semantic richness of knowledge graphs by integrating diverse information across modalities. However, existing methods often either overlook the diversity within a single modality or fail to ensure effective cross-modality alignment for entity representation. This leads to suboptimal entity representations, as inconsistent or irrelevant data is treated uniformly. To address these challenges, we propose a unified framework that combines intra-modality multi-view fusion with cross-modality alignment (IMVIA for short). Our approach captures the most relevant information within each modality by leveraging relational context. Simultaneously, we apply information disentanglement and contrastive learning, allowing each modality-specific learner to focus on extracting distinctive features while maintaining consistent training objectives across all modalities. Furthermore, we employ a relation-aware gated decision fusion network to robustly integrate diverse information. Experimental results show that IMVIA significantly outperforms state-of-the-art approaches across multiple benchmark datasets, validating its effectiveness and robustness in MMKGC task.
Authors
- Zhuo Chen (ORCID: https://orcid.org/0000-0003-4265-8313)
- Meng Ai (ORCID: https://orcid.org/0000-0002-5796-2054)
- Leike An
- Zhen Li (ORCID: https://orcid.org/0000-0002-7669-2686)
- Haoxuan Li (ORCID: https://orcid.org/0009-0007-1429-2082)
- Liqiang Wang (ORCID: https://orcid.org/0009-0004-1840-5652)
- Jibin Wang (ORCID: https://orcid.org/0009-0005-9128-3716)
- Wu Kun (ORCID: https://orcid.org/0009-0004-7478-3025)
Institutions
- China Mobile (China) (CN)
- Peking University (CN)
Publication Details
- Published
- 2025-03-12
- DOI
- https://doi.org/10.1109/icassp49660.2025.10890167
- Primary Topic
- Semantic Web and Ontologies
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China