RLG-RAG: Guiding the Knowledge Retrieval and Evaluation in Retrieval-Augmented Generation Framework by Reasoning Logic
The knowledge retrieval, integration, and evaluation processes in the RAG method lack the guidance of reasoning logic, leading to ongoing challenges in maintaining factual consistency. To address these issues, this paper proposes the RLG-RAG framework, which constructs a reasoning graph based on user queries to guide the knowledge retrieval, integration, and evaluation processes. By fully representing the reasoning logic of RAG, RLG-RAG dynamically models and integrates knowledge relationships during retrieval and defines a precise scope of relevant knowledge through sufficiency evaluation. This reduces inference-irrelevant knowledge that large language models may obtain. Experimental analyses on accuracy, factual consistency, and robustness demonstrate that RLG-RAG resists interference and provides accurate, factually consistent answers. The project URL is https://doi.org/10.5281/zenodo.14852250.
Authors
- Yuanzhuo Wang (ORCID: https://orcid.org/0000-0002-6799-1756)
- Kehan Xu (ORCID: https://orcid.org/0009-0002-3800-0818)
- Jingyuan Li (ORCID: https://orcid.org/0009-0008-9384-9455)
- Wei Huang (ORCID: https://orcid.org/0000-0002-4315-8487)
- Kun Zhang (ORCID: https://orcid.org/0009-0002-7984-1082)
Institutions
- Beijing Technology and Business University (CN)
- Chinese Academy of Sciences (CN)
- Tencent (China) (CN)
- Yanshan University (CN)
- Institute of Computing Technology (CN)
Publication Details
- Published
- 2025-05-08
- DOI
- https://doi.org/10.1145/3701716.3715554
- Citations
- 1
- Primary Topic
- Topic Modeling
- Type
- article
- Field-Weighted Citation Impact
- 2.48