RGembed: A Knowledge Graph Embedding Model Integrating Dual-Prediction andGraph Attention Networks

Knowledge graph embeddings play a vital role in subsequent tasks such as link prediction, entity alignment, and question answering systems. However, current techniques frequently encounter difficulties in capturing intricate semantic connections. Introducing RGembed, a model specifically developed to better the representation of embeddings and increase the performance of models. Firstly, it utilizes a technique of reversing the training data, allowing for bidirectional prediction between head and tail entities inside a knowledge graph. This strategy employs a shared loss function, which enables the model to effectively capture a wider range of semantic correlations throughout the training process. Furthermore, the model incorporates a Graph Attention Network layer during the entity embedding stage. This layer improves entity representations by combining information from neighboring entities. An extensive series of comparative studies were undertaken to verify the efficacy of the RGembed model. The mean reciprocal rank (MRR) of RGembed increased by 7.1%, 7.3%, 1.9%, 3.4%, and 6.4%, respectively, compared to the baseline model. Furthermore, the ablation experiments demonstrated that eliminating the bidirectional prediction and GAT layer resulted in a notable decrease in the model's ability to embed information. This further validates the crucial significance of these components in the performance of the model.

Authors

Institutions

Publication Details

Published
2024-09-13
DOI
https://doi.org/10.1109/aiotc63215.2024.10748257
Primary Topic
Advanced Graph Neural Networks
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

RGembed: A Knowledge Graph Embedding Model Integrating Dual-Prediction andGraph Attention Networks

Xiaojun Zhou, Xiaoqi Ma, Xiaohui Rong
Advanced Graph Neural Networks
article

RGembed: A Knowledge Graph Embedding Model Integrating Dual-Prediction andGraph Attention Networks

Xiaojun Zhou, Xiaoqi Ma, Xiaohui Rong
article en

Abstract

Knowledge graph embeddings play a vital role in subsequent tasks such as link prediction, entity alignment, and question answering systems. However, current techniques frequently encounter difficulties in capturing intricate semantic connections. Introducing RGembed, a model specifically developed to better the representation of embeddings and increase the performance of models. Firstly, it utilizes a technique of reversing the training data, allowing for bidirectional prediction between head and tail entities inside a knowledge graph. This strategy employs a shared loss function, which enables the model to effectively capture a wider range of semantic correlations throughout the training process. Furthermore, the model incorporates a Graph Attention Network layer during the entity embedding stage. This layer improves entity representations by combining information from neighboring entities. An extensive series of comparative studies were undertaken to verify the efficacy of the RGembed model. The mean reciprocal rank (MRR) of RGembed increased by 7.1%, 7.3%, 1.9%, 3.4%, and 6.4%, respectively, compared to the baseline model. Furthermore, the ablation experiments demonstrated that eliminating the bidirectional prediction and GAT layer resulted in a notable decrease in the model's ability to embed information. This further validates the crucial significance of these components in the performance of the model.

Computer Network Information Center (CN), University of Chinese Academy of Sciences (CN)
Openalex Percentile: Top 82%
Advanced Graph Neural Networks
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.