Optimizing Question Semantic Space for Dynamic Retrieval-Augmented Multi-hop Question Answering
Retrieval-augmented generation (RAG) is usually integrated into large language models (LLMs) to mitigate hallucinations and knowledge obsolescence.Whereas, conventional onestep retrieve-and-read methods are insufficient for multi-hop question answering, facing challenges of retrieval semantic mismatching and the high cost in handling interdependent subquestions.In this paper, we propose Optimizing Question Semantic Space for Dynamic Retrieval-Augmented Multi-hop Question Answering (Q-DREAM).Q-DREAM consists of three key modules: (1) the Question Decomposition Module (QDM), which decomposes multi-hop questions into fine-grained subquestions; (2) the Subquestion Dependency Optimizer Module (SDOM), which models the interdependent relations of subquestions for better understanding; and (3) the Dynamic Passage Retrieval Module (DPRM), which aligns subquestions with relevant passages by optimizing the semantic embeddings.Experimental results across various benchmarks demonstrate that Q-DREAM significantly outperforms existing RAG methods, achieving state-of-the-art performance in both in-domain and out-of-domain settings.Notably, Q-DREAM also improves retrieval efficiency while maintaining high accuracy compared with recent baselines.
Authors
- Liang He (ORCID: https://orcid.org/0000-0002-4723-5486)
- L.X. Ye
- Qin Chen (ORCID: https://orcid.org/0000-0002-4956-3635)
- Zhikai Lei (ORCID: https://orcid.org/0000-0002-7952-1401)
- Lang Yu (ORCID: https://orcid.org/0000-0002-9083-5313)
- Jie Zhou
Institutions
- East China Normal University (CN)
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.acl-long.871
- Primary Topic
- Topic Modeling
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Natural Science Foundation of Shanghai
- National Natural Science Foundation of China