Is RAG Really Dead? Agentic Grep and Hybrid Retrieval on Company Reports

Coding agents have moved from embeddings to plain text search, prompting claims that RAG is dead. We compared three configurations on 150 FinanceBench questions over 368 reports, using one open-weight model (qwen3.6-27b), with the main comparison on the same parsed markdown. Classic RAG searched once before answering. Agentic RAG and Agentic Grep shared an agent loop and could search repeatedly, with hybrid retrieval or grep respectively. Classic RAG answered 117 questions correctly, Agentic Grep 127, and Agentic RAG 133 and 132 over two runs (exact McNemar p = 0.21 and 0.33). Both agents about halved Classic RAG's wrong answers. The step limit mattered: in an earlier run at a ten-step cap, grep scored 121. Most FinanceBench questions name the company and period, letting grep narrow its search by file name. On 32 questions over a mixed library, many needing several documents, Agentic Grep scored 78%, Agentic RAG 84%, and VectoGrid, our product built on Agentic RAG with answer review and set handling, 91%. Our conclusion: Classic RAG is dead, but RAG is not. Agentic RAG answered 15-16 more questions correctly than Classic RAG, and stayed ahead of Agentic Grep throughout, most of all on the mixed library, though neither gap over grep is significant alone.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-07
DOI
https://doi.org/10.5281/zenodo.24043606
Primary Topic
Topic Modeling
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Is RAG Really Dead? Agentic Grep and Hybrid Retrieval on Company Reports

Philippe Vergnet
2 links
Zenodo (CERN European Organization for Nuclear Research)
Topic Modeling
preprint

Is RAG Really Dead? Agentic Grep and Hybrid Retrieval on Company Reports

Philippe Vergnet
preprint en

Abstract

Coding agents have moved from embeddings to plain text search, prompting claims that RAG is dead. We compared three configurations on 150 FinanceBench questions over 368 reports, using one open-weight model (qwen3.6-27b), with the main comparison on the same parsed markdown. Classic RAG searched once before answering. Agentic RAG and Agentic Grep shared an agent loop and could search repeatedly, with hybrid retrieval or grep respectively. Classic RAG answered 117 questions correctly, Agentic Grep 127, and Agentic RAG 133 and 132 over two runs (exact McNemar p = 0.21 and 0.33). Both agents about halved Classic RAG's wrong answers. The step limit mattered: in an earlier run at a ten-step cap, grep scored 121. Most FinanceBench questions name the company and period, letting grep narrow its search by file name. On 32 questions over a mixed library, many needing several documents, Agentic Grep scored 78%, Agentic RAG 84%, and VectoGrid, our product built on Agentic RAG with answer review and set handling, 91%. Our conclusion: Classic RAG is dead, but RAG is not. Agentic RAG answered 15-16 more questions correctly than Classic RAG, and stayed ahead of Agentic Grep throughout, most of all on the mixed library, though neither gap over grep is significant alone.

Zenodo (CERN European Organization for Nuclear Research)
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon