TG-CENET: an improved reasoning model for temporal knowledge graphs based on contrastive history

With the rapid advancement of the Internet and artificial intelligence technologies, knowledge graphs have demonstrated significant potential in data structuring and knowledge reasoning. In particular, temporal knowledge graphs (TKGs), have attracted increasing attention for their applications in dynamic scenarios. However, traditional TKG representation learning methods often overlook the topological structure among entities and their interactions with neighboring nodes, resulting in limited capacity to model complex historical dependencies and perform global reasoning. To address these challenges, we propose TG-CENET (Transformer‑GNN‑Contrastive Event Network), an enhanced temporal knowledge graph reasoning model that builds upon the historical contrastive learning strategy of CENET. By incorporating a GNN and a Transformer module, TG-CENET improves both structural representation and temporal sequence modeling. Specifically, the GNN component captures structural information from the graph, improving the quality of entity representations by modeling neighborhood relationships. Meanwhile, the Transformer module captures long-term temporal dependencies, enabling the model to reason more effectively over both historical and non-historical events. The effectiveness and performance of the proposed method were evaluated in four representative public datasets, ICEWS14s, ICEWS18, GDELT and YAGO. The results demonstrate that TG-CENET consistently outperforms existing methods in multiple metrics, including Hit@1, Hit@3, Hit@10 and MRR. The proposed method achieves Hit@1, Hit@3, Hit@10 and MRR scores of 0.31, 0.46, 0.62 and 0.41 on the ICEWS14s, 0.19, 0.32, 0.48 and 0.28 on the ICEWS18, 0.14, 0.22, 0.38 and 0.21 on the GDELT, and 0.49, 0.70, 0.83 and 0.61 on the YAGO, respectively. Ablation studies further confirm the complementary benefits of GNN-based structural encoding, Transformer-based temporal reasoning, and contrastive learning. These results highlight the effectiveness and robustness of TG-CENET in modeling complex temporal dynamics, offering a promising direction for advancing TKG reasoning in real-world applications such as event forecasting, financial analysis, and urban disaster management.

Authors

Institutions

Publication Details

Journal
Journal of King Saud University - Computer and Information Sciences
Published
2026-03-17
DOI
https://doi.org/10.1007/s44443-026-00663-0
Primary Topic
Advanced Graph Neural Networks
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

TG-CENET: an improved reasoning model for temporal knowledge graphs based on contrastive history

K. Wu, Lizhi Miao, Yi Ting Huang
Journal of King Saud University - Computer and Information Sciences
Advanced Graph Neural Networks
article

TG-CENET: an improved reasoning model for temporal knowledge graphs based on contrastive history

K. Wu, Lizhi Miao, Yi Ting Huang
article en

Abstract

With the rapid advancement of the Internet and artificial intelligence technologies, knowledge graphs have demonstrated significant potential in data structuring and knowledge reasoning. In particular, temporal knowledge graphs (TKGs), have attracted increasing attention for their applications in dynamic scenarios. However, traditional TKG representation learning methods often overlook the topological structure among entities and their interactions with neighboring nodes, resulting in limited capacity to model complex historical dependencies and perform global reasoning. To address these challenges, we propose TG-CENET (Transformer‑GNN‑Contrastive Event Network), an enhanced temporal knowledge graph reasoning model that builds upon the historical contrastive learning strategy of CENET. By incorporating a GNN and a Transformer module, TG-CENET improves both structural representation and temporal sequence modeling. Specifically, the GNN component captures structural information from the graph, improving the quality of entity representations by modeling neighborhood relationships. Meanwhile, the Transformer module captures long-term temporal dependencies, enabling the model to reason more effectively over both historical and non-historical events. The effectiveness and performance of the proposed method were evaluated in four representative public datasets, ICEWS14s, ICEWS18, GDELT and YAGO. The results demonstrate that TG-CENET consistently outperforms existing methods in multiple metrics, including Hit@1, Hit@3, Hit@10 and MRR. The proposed method achieves Hit@1, Hit@3, Hit@10 and MRR scores of 0.31, 0.46, 0.62 and 0.41 on the ICEWS14s, 0.19, 0.32, 0.48 and 0.28 on the ICEWS18, 0.14, 0.22, 0.38 and 0.21 on the GDELT, and 0.49, 0.70, 0.83 and 0.61 on the YAGO, respectively. Ablation studies further confirm the complementary benefits of GNN-based structural encoding, Transformer-based temporal reasoning, and contrastive learning. These results highlight the effectiveness and robustness of TG-CENET in modeling complex temporal dynamics, offering a promising direction for advancing TKG reasoning in real-world applications such as event forecasting, financial analysis, and urban disaster management.

Journal of King Saud University - Computer and Information Sciences
Nanjing University of Posts and Telecommunications (CN), Beijing Institute of Big Data Research (CN)
Openalex Percentile: Top 23%
Advanced Graph Neural Networks
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.