Nothing Left Behind: Finding Evidence from a Large Randomized Evaluation Corpus
Many AI systems need to find every relevant items in a large collection and then organize what they found. The standard way to do this is to tag each item with labels from a curated vocabulary and search on those labels. Those labels are useful for organizing results, but searching on them misses items that do not fit a label and returns too much when labels are broad. We compare this approach with an embedding-based approach: find candidates by meaning using text embeddings, then have a language model keep only the relevant ones. In a corpus of 7,354 randomized trials, label search found 45% of the evidence a systematic review would include, while the new approach found 92%, at a cost per query that rises with search depth. These results support a two-stage architecture that combines broad candidate retrieval with query-specific evidence filtering.
Authors
- Satvik Garg (ORCID: https://orcid.org/0000-0002-2936-9333)
- Piriyakorn Piriyatamwong (ORCID: https://orcid.org/0009-0004-0852-2759)
- Riccardo Orlando
- Abelardo Carlos Martínez Lorenzo
- Linxi Wang
- Giuliano Martinelli
- Samuel Paul Fraiberger
Publication Details
- Journal
- arXiv (Cornell University)
- Published
- 2026-10-27
- DOI
- https://doi.org/10.48550/arxiv.2610.36910
- Primary Topic
- Information Retrieval and Search Behavior
- Type
- preprint