Enhancing Zero-Shot Knowledge Graph Relation Prediction through Large Language Models and Contrastive Learning

Knowledge graph completion (KGC) aims to predict missing facts in a knowledge graph (KG), with zero-shot relation prediction remaining a significant challenge due to limited descriptive information. In this paper, we propose ROCKGC, a framework that leverages large language models (LLMs) to generate enriched relation descriptions and integrates contrastive learning with a conditional variational autoencoder (C-VAE) to enhance relational separation in the embedding space. By combining LLM-generated semantic representations with C-VAE and contrastive loss, ROCKGC effectively captures nuanced relational differences and improves zero-shot learning performance. Extensive experiments on benchmark datasets show that our method outperforms state-of-the-art approaches, achieving superior accuracy and robustness in predicting unseen relations.

Authors

Institutions

Publication Details

Published
2025-05-08
DOI
https://doi.org/10.1145/3701716.3715553
Primary Topic
Advanced Graph Neural Networks
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Zero-Shot Knowledge Graph Relation Prediction through Large Language Models and Contrastive Learning

Hang Yu, Haoyi Yu
1 links
Advanced Graph Neural Networks
article

Enhancing Zero-Shot Knowledge Graph Relation Prediction through Large Language Models and Contrastive Learning

Hang Yu, Haoyi Yu
article en

Abstract

Knowledge graph completion (KGC) aims to predict missing facts in a knowledge graph (KG), with zero-shot relation prediction remaining a significant challenge due to limited descriptive information. In this paper, we propose ROCKGC, a framework that leverages large language models (LLMs) to generate enriched relation descriptions and integrates contrastive learning with a conditional variational autoencoder (C-VAE) to enhance relational separation in the embedding space. By combining LLM-generated semantic representations with C-VAE and contrastive loss, ROCKGC effectively captures nuanced relational differences and improves zero-shot learning performance. Extensive experiments on benchmark datasets show that our method outperforms state-of-the-art approaches, achieving superior accuracy and robustness in predicting unseen relations.

Shanghai University (CN)
Quality Education
Openalex Percentile: Top 93%
Advanced Graph Neural Networks
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Enhancing Zero-Shot Knowledge Graph Relation Prediction through Large Language Models and Contrastive Learning — Hang Yu, Haoyi Yu · (2025) | TGRS Research Map | TGRS