Q-Filters: Leveraging Query-Key Geometry for Efficient Key-Value Cache Compression
This work was granted access to the HPC resources of IDRIS under the allocation 2024-AD011013680R2 made by GENCI.
Authors
- Nathan Godey (ORCID: https://orcid.org/0000-0001-8319-8128)
- Alessio Devoto
- Yu Zhao
- Benoît Sagot
- Pasquale Minervini
- Éric de la Clergerie
Publication Details
- Journal
- SPIRE - Sciences Po Institutional REpository
- Published
- 2025-04-27
- Primary Topic
- Distributed systems and fault tolerance
- Type
- article
- Field-Weighted Citation Impact
- 0.00