Knowledge-Augmented Planning and Pruning for Multi-Hop Question Answering
While large language models (LLMs) excel at language understanding and generation, their application to multi-hop knowledge graph question answering (KGQA) faces challenges from structural and semantic mismatches. Current approaches primarily adopt an agent-based paradigm involving planning (decomposing queries), exploration (searching subgraphs), and reflection. However, previous methods suffer from two limitations: For planning, agent-based paradigms heavily rely on LLMs to decompose questions without continuous grounding in KG structures, leading to unanchored subgoal hallucinationsfactually inconsistent reasoning steps; For KG exploration, previous retrieval strategies prioritise isolated entity matching over contextualised relational triplets, resulting in semantically fragmented retrieval that propagates redundant subgraph exploration and semantic drift. To address these challenges, this work proposes a novel KAPP (Knowledge-Augmented Planning and Pruning) framework that synergizes dynamic knowledge grounding with semantic-aware subgraph optimisation. Specifically, KAPP introduces two innovations: a dynamic knowledge-guided planner that interleaves LLM-driven subgoal generation with KG-validated path correction, eliminating hallucinated steps through iterative verification, and a triple-level semantic pruner that evaluates relational relevance via joint question-triplet encoding, preserving contextual coherence while reducing redundant retrievals. Extensive experiments on CWQ and WebQSP benchmarks demonstrate KAPP’s effectiveness, achieving 5.6-7% accuracy gains over existing KG-augmented methods and reducing LLM API calls by $\mathbf{3 2. 4 \%}$.
Authors
- Xiangyun Meng (ORCID: https://orcid.org/0000-0003-1680-214X)
- Baoyun Peng (ORCID: https://orcid.org/0000-0001-5240-1779)
- Bo Liu (ORCID: https://orcid.org/0000-0002-0894-1054)
- Zhen Dong (ORCID: https://orcid.org/0000-0002-9917-7628)
- Xingkong Ma (ORCID: https://orcid.org/0009-0008-3671-0940)
Institutions
- National University of Defense Technology (CN)
Publication Details
- Published
- 2025-07-18
- DOI
- https://doi.org/10.1109/icbase66587.2025.11181419
- Primary Topic
- AI-based Problem Solving and Planning
- Type
- article
- Field-Weighted Citation Impact
- 0.00