A Reinforcement Learning-based Knowledge Graph Reasoning Verification Method

To address more complex problems and enhance the effectiveness of reasoning paths, multi-hop reasoning methods utilizing reinforcement learning have gained significant attention recently. Multi-hop reasoning aims to predict missing relationships or identify the correct answer entity by exploring multiple triples in a knowledge graph. However, existing methods often overlook the semantic information of intermediate reasoning paths, which could enhance answer accuracy, resulting in incorrect paths. Additionally, in complex scenarios, the action search space grows exponentially with more reasoning hops, drastically reducing task efficiency. This paper proposes a Reinforcement Path Reasoning Verification (RPRV) method that integrates reinforcement learning techniques. By implementing a hop limitation strategy and incorporating additional path reward signals into the reward function, this method addresses incorrect reasoning paths and improves search efficiency. These adjustments ensure that the model remains close to the initial entity during reasoning, enhancing both answer accuracy and path interpretability. Experimental results demonstrate that the model performs well on three publicly available benchmark datasets, significantly improving knowledge graph reasoning efficiency and prediction accuracy through the path validator.

Authors

Institutions

Publication Details

Published
2024-10-18
DOI
https://doi.org/10.1109/ntci64025.2024.10776074
Primary Topic
Advanced Decision-Making Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Reinforcement Learning-based Knowledge Graph Reasoning Verification Method

Xiaoqin Hu, Tongtong Zhang, Yuwei Cheng, Rui Yang et al.
Advanced Decision-Making Techniques
article

A Reinforcement Learning-based Knowledge Graph Reasoning Verification Method

Xiaoqin Hu, Tongtong Zhang, Yuwei Cheng, Rui Yang, Xiaodong Zhang
article en

Abstract

To address more complex problems and enhance the effectiveness of reasoning paths, multi-hop reasoning methods utilizing reinforcement learning have gained significant attention recently. Multi-hop reasoning aims to predict missing relationships or identify the correct answer entity by exploring multiple triples in a knowledge graph. However, existing methods often overlook the semantic information of intermediate reasoning paths, which could enhance answer accuracy, resulting in incorrect paths. Additionally, in complex scenarios, the action search space grows exponentially with more reasoning hops, drastically reducing task efficiency. This paper proposes a Reinforcement Path Reasoning Verification (RPRV) method that integrates reinforcement learning techniques. By implementing a hop limitation strategy and incorporating additional path reward signals into the reward function, this method addresses incorrect reasoning paths and improves search efficiency. These adjustments ensure that the model remains close to the initial entity during reasoning, enhancing both answer accuracy and path interpretability. Experimental results demonstrate that the model performs well on three publicly available benchmark datasets, significantly improving knowledge graph reasoning efficiency and prediction accuracy through the path validator.

Nanjing Audit University (CN)
Openalex Percentile: Top 64%
Advanced Decision-Making Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.