Harnessing Large Language Models for Temporal Knowledge Graph Forecasting with Multi-view Prompting

In recent years, Temporal Knowledge Graphs (TKGs) have attracted considerable attention from researchers. An important research direction is forecasting future events in TKGs based on historical information, i.e. TKG forecasting. Existing methods primarily rely on modeling temporal relationships between entity IDs to make predictions, which brings limitations in understanding the entity content and the relationships between entities. Fortunately, the emergence of Large Language Models (LLMs) has brought new insights into solving this problem. In this paper, we propose a novel LLM-enhAnced TKG forEcasting (LATE) model. Specifically, we first design multi-view prompts that enable LLMs to generate comprehensive descriptions for entities as external knowledge. Then, we get the enhanced representations of entities based on the descriptions and we further design a contrastive learning strategy to reinforce this process. Finally, we construct a TKG forecasting model based on self-attention mechanisms and dual-pattern LSTM-based temporal modeling to accomplish the forecasting task. Experiments on three datasets demonstrate the effectiveness and superiority of our model compared with several state-of-the-art baseline methods.

Authors

Institutions

Publication Details

Published
2024-12-27
DOI
https://doi.org/10.1109/icairc64177.2024.10900037
Citations
1
Primary Topic
Advanced Graph Neural Networks
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Harnessing Large Language Models for Temporal Knowledge Graph Forecasting with Multi-view Prompting

Fake Lin, Tong Xu, Da Zhang, J. Chen
1 citations
Advanced Graph Neural Networks
0.35
article

Harnessing Large Language Models for Temporal Knowledge Graph Forecasting with Multi-view Prompting

Fake Lin, Tong Xu, Da Zhang, J. Chen
article en
1 citations

Abstract

In recent years, Temporal Knowledge Graphs (TKGs) have attracted considerable attention from researchers. An important research direction is forecasting future events in TKGs based on historical information, i.e. TKG forecasting. Existing methods primarily rely on modeling temporal relationships between entity IDs to make predictions, which brings limitations in understanding the entity content and the relationships between entities. Fortunately, the emergence of Large Language Models (LLMs) has brought new insights into solving this problem. In this paper, we propose a novel LLM-enhAnced TKG forEcasting (LATE) model. Specifically, we first design multi-view prompts that enable LLMs to generate comprehensive descriptions for entities as external knowledge. Then, we get the enhanced representations of entities based on the descriptions and we further design a contrastive learning strategy to reinforce this process. Finally, we construct a TKG forecasting model based on self-attention mechanisms and dual-pattern LSTM-based temporal modeling to accomplish the forecasting task. Experiments on three datasets demonstrate the effectiveness and superiority of our model compared with several state-of-the-art baseline methods.

University of Science and Technology of China (CN)
Quality Education
Openalex Percentile: Top 29%
Advanced Graph Neural Networks
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.