Multi Feature Deep Fusion Based on Relationship Path Enhancement for Multi-Modal Knowledge Graph Completion

Multimodal knowledge graph integrates information from different modalities to enhance knowledge representation, but multimodal knowledge graphs still have deficiencies in completeness and accuracy. Most existing completion methods rely on entity text, images, and triplet information, ignoring the relationship path information between entities. In addition, due to the heterogeneity between text and images, there is often semantic conflict, and directly fusing information from different modalities makes it difficult to accurately capture the deep associations between text and images. Therefore, we propose a multimodal knowledge graph completion method based on relationship path enhancement with multi feature deep fusion. This method identifies and strengthens key relationship paths, while also deeply mining the deep semantic connections between multiple modalities, achieving deep integration between multiple features. Finally, the model was experimentally verified on the FB15K-237 and WN18RR datasets, results showed that the model improved on most metrics, which evidence the effectiveness of the proposed method.

Authors

Institutions

Publication Details

Published
2024-10-11
DOI
https://doi.org/10.1109/cbase64041.2024.10824600
Primary Topic
Text and Document Classification Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multi Feature Deep Fusion Based on Relationship Path Enhancement for Multi-Modal Knowledge Graph Completion

Yafei Jia, Yong Liu, Gege Li, Aoqi Zhang et al.
Text and Document Classification Technologies
article

Multi Feature Deep Fusion Based on Relationship Path Enhancement for Multi-Modal Knowledge Graph Completion

Yafei Jia, Yong Liu, Gege Li, Aoqi Zhang, Wei Deng, D.T. Qi
article en

Abstract

Multimodal knowledge graph integrates information from different modalities to enhance knowledge representation, but multimodal knowledge graphs still have deficiencies in completeness and accuracy. Most existing completion methods rely on entity text, images, and triplet information, ignoring the relationship path information between entities. In addition, due to the heterogeneity between text and images, there is often semantic conflict, and directly fusing information from different modalities makes it difficult to accurately capture the deep associations between text and images. Therefore, we propose a multimodal knowledge graph completion method based on relationship path enhancement with multi feature deep fusion. This method identifies and strengthens key relationship paths, while also deeply mining the deep semantic connections between multiple modalities, achieving deep integration between multiple features. Finally, the model was experimentally verified on the FB15K-237 and WN18RR datasets, results showed that the model improved on most metrics, which evidence the effectiveness of the proposed method.

Henan University of Science and Technology (CN), Yellow River Institute of Hydraulic Research (CN)
Openalex Percentile: Top 77%
Text and Document Classification Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Multi Feature Deep Fusion Based on Relationship Path Enhancement for Multi-Modal Knowledge Graph Completion — Yafei Jia, Yong Liu, et al. · (2024) | TGRS Research Map | TGRS