TreeRAG: Unleashing the Power of Hierarchical Storage for Enhanced Knowledge Retrieval in Long Documents

When confronting long document information retrieval for Query-Focused Summarization(QFS), Traditional Retrieval-Augmented Generation(RAG) frameworks struggle to retrieve all relevant chunks, and the chunking and retrieve strategies of existing frameworks may disrupt the connections between chunks and the integrity of the information.To address these issues, we propose TreeRAG, which employs Tree-Chunking for chunking and embedding in a tree-like structure , coupled with "rootto-leaves" and "leaf-to-roots" retrieve strategy named Bidirectional Traversal Retrieval.This approach effectively preserves the hierarchical structure among chunks and significantly enhances the ability to retrieve while minimizing noise inference.Our experimental results on the Finance, Law, and Medical subsets of the Dragonball dataset demonstrate that TreeRAG achieves significant enhancements in both recall quality and precision compared to traditional and popular existing methods and achieves better performance to corresponding question-answering tasks, marking a new breakthrough in long document knowledge retrieval.