Gosling Grows Up: Retrieval with Learned Dense and Sparse Representations Using Anserini
The Anserini IR toolkit has come a long way since efforts began in 2015. Although the goals of the project - to bridge research and practice in information retrieval, and to provide reproducible, easy-to-use baselines - have remained constant, the world has changed quite a bit. We discuss how Anserini has evolved in response to this changing environment, the most significant of which is the advent of transformer-based retrieval models that did not exist when the project started. The bi-encoder architecture provides a framework for understanding retrieval models based on dense and sparse vector representations, and offers a reference for conveying the capabilities of our toolkit. Anserini provides end-to-end first-stage retrieval based on single-vector learned dense and sparse representations, directly building on the open-source Lucene search library and the ONNX runtime. This minimal design accelerates the pace of research and fosters reproducibility, enabling ''two-click reproductions''. By better aligning research and practice, we increase the potential real-world impact of research innovations.
Authors
- Jheng-Hong Yang (ORCID: https://orcid.org/0000-0001-5469-312X)
- Xueguang Ma (ORCID: https://orcid.org/0000-0003-3430-4910)
- Jasper Xian (ORCID: https://orcid.org/0009-0004-2740-6120)
- Carlos Lassance (ORCID: https://orcid.org/0000-0002-7754-6656)
- Jimmy Lin (ORCID: https://orcid.org/0000-0002-0661-7189)
- Tommaso Teofili (ORCID: https://orcid.org/0000-0002-4372-0273)
- Aiwang Chen
- Ronak Pradeep (ORCID: https://orcid.org/0000-0001-6296-601X)
- Ben Zhong (ORCID: https://orcid.org/0009-0006-8671-3547)
- Vincent Zhong
Institutions
- University of Waterloo (CA)
- Genetic Information Research Institute (US)
- Coherent (United States) (US)
Publication Details
- Published
- 2025-07-13
- DOI
- https://doi.org/10.1145/3726302.3730281
- Primary Topic
- Topic Modeling
- Type
- article
- Field-Weighted Citation Impact
- 0.00