High Performance or Low Memory? An Updatable Learned Index Framework for Time-Space Tradeoff
The first generation of learned indexes inherently achieved lower space overhead than traditional index structures, establishing this advantage as one of the pivotal research directions in index optimization. However, in their pursuit of peak performance, designers often significantly increase space overhead, which becomes infeasible in scenarios with limited storage space. Furthermore, the design of current learned indexes optimized for time-space tradeoff is flawed, as they collapse catastrophically under prevalent dense or duplicate insertion workloads. To address these challenges, we first quantitatively analyze the time-space correlation characteristics of learned indexes from a theoretical perspective and identify the core influencing factors. Based on this, time-space cost minimization function models are established and an updatable learned index framework, LIFT, is constructed. Furthermore, LIFT incorporates specifically designed structural adjustment mechanisms to effectively counter existing poisoning attacks, significantly enhancing index robustness without increasing time-space cost. Evaluation results demonstrate that LIFT consistently achieves the optimal time-space tradeoff across various workloads and datasets, outperforming all other state-of-the-art indexes.
Authors
- Jiake Ge (ORCID: https://orcid.org/0000-0003-4644-0733)
- Xin Wang (ORCID: https://orcid.org/0000-0001-9651-0651)
- Yunpeng Chai (ORCID: https://orcid.org/0000-0002-3286-9259)
- Peng Yi (ORCID: https://orcid.org/0009-0007-5369-6821)
- Hui Wang (ORCID: https://orcid.org/0009-0001-6397-203X)
- Lei Liang (ORCID: https://orcid.org/0009-0000-9700-5809)
Institutions
- Tianjin University (CN)
- Renmin University of China (CN)
Publication Details
- Journal
- Proceedings of the ACM on Management of Data
- Published
- 2025-12-04
- DOI
- https://doi.org/10.1145/3769800
- Primary Topic
- Adversarial Robustness in Machine Learning
- Type
- article
- Field-Weighted Citation Impact
- 0.00