Knowledge-Augmented Planning and Pruning for Multi-Hop Question Answering

While large language models (LLMs) excel at language understanding and generation, their application to multi-hop knowledge graph question answering (KGQA) faces challenges from structural and semantic mismatches. Current approaches primarily adopt an agent-based paradigm involving planning (decomposing queries), exploration (searching subgraphs), and reflection. However, previous methods suffer from two limitations: For planning, agent-based paradigms heavily rely on LLMs to decompose questions without continuous grounding in KG structures, leading to unanchored subgoal hallucinationsfactually inconsistent reasoning steps; For KG exploration, previous retrieval strategies prioritise isolated entity matching over contextualised relational triplets, resulting in semantically fragmented retrieval that propagates redundant subgraph exploration and semantic drift. To address these challenges, this work proposes a novel KAPP (Knowledge-Augmented Planning and Pruning) framework that synergizes dynamic knowledge grounding with semantic-aware subgraph optimisation. Specifically, KAPP introduces two innovations: a dynamic knowledge-guided planner that interleaves LLM-driven subgoal generation with KG-validated path correction, eliminating hallucinated steps through iterative verification, and a triple-level semantic pruner that evaluates relational relevance via joint question-triplet encoding, preserving contextual coherence while reducing redundant retrievals. Extensive experiments on CWQ and WebQSP benchmarks demonstrate KAPP’s effectiveness, achieving 5.6-7% accuracy gains over existing KG-augmented methods and reducing LLM API calls by $\mathbf{3 2. 4 \%}$.

Authors

Institutions

Publication Details

Published
2025-07-18
DOI
https://doi.org/10.1109/icbase66587.2025.11181419
Primary Topic
AI-based Problem Solving and Planning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Knowledge-Augmented Planning and Pruning for Multi-Hop Question Answering

Xiangyun Meng, Baoyun Peng, Bo Liu, Zhen Dong et al.
AI-based Problem Solving and Planning
article

Knowledge-Augmented Planning and Pruning for Multi-Hop Question Answering

Xiangyun Meng, Baoyun Peng, Bo Liu, Zhen Dong, Xingkong Ma
article en

Abstract

While large language models (LLMs) excel at language understanding and generation, their application to multi-hop knowledge graph question answering (KGQA) faces challenges from structural and semantic mismatches. Current approaches primarily adopt an agent-based paradigm involving planning (decomposing queries), exploration (searching subgraphs), and reflection. However, previous methods suffer from two limitations: For planning, agent-based paradigms heavily rely on LLMs to decompose questions without continuous grounding in KG structures, leading to unanchored subgoal hallucinationsfactually inconsistent reasoning steps; For KG exploration, previous retrieval strategies prioritise isolated entity matching over contextualised relational triplets, resulting in semantically fragmented retrieval that propagates redundant subgraph exploration and semantic drift. To address these challenges, this work proposes a novel KAPP (Knowledge-Augmented Planning and Pruning) framework that synergizes dynamic knowledge grounding with semantic-aware subgraph optimisation. Specifically, KAPP introduces two innovations: a dynamic knowledge-guided planner that interleaves LLM-driven subgoal generation with KG-validated path correction, eliminating hallucinated steps through iterative verification, and a triple-level semantic pruner that evaluates relational relevance via joint question-triplet encoding, preserving contextual coherence while reducing redundant retrievals. Extensive experiments on CWQ and WebQSP benchmarks demonstrate KAPP’s effectiveness, achieving 5.6-7% accuracy gains over existing KG-augmented methods and reducing LLM API calls by $\mathbf{3 2. 4 \%}$.

National University of Defense Technology (CN)
Openalex Percentile: Top 85%
AI-based Problem Solving and Planning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Knowledge-Augmented Planning and Pruning for Multi-Hop Question Answering — Xiangyun Meng, Baoyun Peng, et al. · (2025) | TGRS Research Map | TGRS