Unifying Within and Across: Intra-Modality Multi-View Fusion and Inter-Modality Alignment for Knowledge Graph Completion

Multi-modal knowledge graph completion (MMKGC) enhances the structural and semantic richness of knowledge graphs by integrating diverse information across modalities. However, existing methods often either overlook the diversity within a single modality or fail to ensure effective cross-modality alignment for entity representation. This leads to suboptimal entity representations, as inconsistent or irrelevant data is treated uniformly. To address these challenges, we propose a unified framework that combines intra-modality multi-view fusion with cross-modality alignment (IMVIA for short). Our approach captures the most relevant information within each modality by leveraging relational context. Simultaneously, we apply information disentanglement and contrastive learning, allowing each modality-specific learner to focus on extracting distinctive features while maintaining consistent training objectives across all modalities. Furthermore, we employ a relation-aware gated decision fusion network to robustly integrate diverse information. Experimental results show that IMVIA significantly outperforms state-of-the-art approaches across multiple benchmark datasets, validating its effectiveness and robustness in MMKGC task.

Authors

Institutions

Publication Details

Published
2025-03-12
DOI
https://doi.org/10.1109/icassp49660.2025.10890167
Primary Topic
Semantic Web and Ontologies
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Unifying Within and Across: Intra-Modality Multi-View Fusion and Inter-Modality Alignment for Knowledge Graph Completion

Zhuo Chen, Meng Ai, Leike An, Zhen Li et al.
Semantic Web and Ontologies
article

Unifying Within and Across: Intra-Modality Multi-View Fusion and Inter-Modality Alignment for Knowledge Graph Completion

Zhuo Chen, Meng Ai, Leike An, Zhen Li, Haoxuan Li, Liqiang Wang, Jibin Wang, Wu Kun
article en

Abstract

Multi-modal knowledge graph completion (MMKGC) enhances the structural and semantic richness of knowledge graphs by integrating diverse information across modalities. However, existing methods often either overlook the diversity within a single modality or fail to ensure effective cross-modality alignment for entity representation. This leads to suboptimal entity representations, as inconsistent or irrelevant data is treated uniformly. To address these challenges, we propose a unified framework that combines intra-modality multi-view fusion with cross-modality alignment (IMVIA for short). Our approach captures the most relevant information within each modality by leveraging relational context. Simultaneously, we apply information disentanglement and contrastive learning, allowing each modality-specific learner to focus on extracting distinctive features while maintaining consistent training objectives across all modalities. Furthermore, we employ a relation-aware gated decision fusion network to robustly integrate diverse information. Experimental results show that IMVIA significantly outperforms state-of-the-art approaches across multiple benchmark datasets, validating its effectiveness and robustness in MMKGC task.

China Mobile (China) (CN), Peking University (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 98%
Semantic Web and Ontologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.