Two-Stage Prompt-Based Entity Representation in Contrastive Learning for Knowledge Graph Completion

The task of Knowledge Graph Completion (KGC) focuses on inferring missing entities automatically. Existing methodologies mainly fall into two categories: structure-based and description-based approaches. Recently, contrastive learning has shown great advantage in description-based KGC. However, this approach necessitates large batch sizes for negative sampling, yet increasing batch size risks introducing false negatives. Furthermore, many contrastive-based methods underutilize the rich semantic content in textual data. To address these issues, leveraging recent research in sentence representation learning and Chain of thought (CoT) in prompt engineering, we proposes a novel description-based KGC method with two-stage prompt-based template. Simultaneously, we proposed a contrastive learning model architecture with <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathbf{infoNCE} -\gamma$</tex> loss. Extensive experiments on three KGC benchmarks validate the superior performance of our approach in KGC.

Authors

Institutions

Publication Details

Published
2024-12-20
DOI
https://doi.org/10.1109/acai63924.2024.10899717
Primary Topic
Advanced Graph Neural Networks
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Two-Stage Prompt-Based Entity Representation in Contrastive Learning for Knowledge Graph Completion

Jian Zhao, Zhaoxuan Zhang, Nianmin Yao, Mingyu Li
Advanced Graph Neural Networks
article

Two-Stage Prompt-Based Entity Representation in Contrastive Learning for Knowledge Graph Completion

Jian Zhao, Zhaoxuan Zhang, Nianmin Yao, Mingyu Li
article en

Abstract

The task of Knowledge Graph Completion (KGC) focuses on inferring missing entities automatically. Existing methodologies mainly fall into two categories: structure-based and description-based approaches. Recently, contrastive learning has shown great advantage in description-based KGC. However, this approach necessitates large batch sizes for negative sampling, yet increasing batch size risks introducing false negatives. Furthermore, many contrastive-based methods underutilize the rich semantic content in textual data. To address these issues, leveraging recent research in sentence representation learning and Chain of thought (CoT) in prompt engineering, we proposes a novel description-based KGC method with two-stage prompt-based template. Simultaneously, we proposed a contrastive learning model architecture with <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathbf{infoNCE} -\gamma$</tex> loss. Extensive experiments on three KGC benchmarks validate the superior performance of our approach in KGC.

Dalian University of Technology (CN)
Openalex Percentile: Top 75%
Advanced Graph Neural Networks
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.