ShapeShifter: Workload-Aware Adaptive Evolving Index Structures Based on Learned Models
In real-world tasks like data management and Web search, index operations often exhibit strong skewness, unlike standard benchmarks with uniform data distribution. While learned indexes improve query and update efficiency, they typically fail to address the skewed workload access, often prioritizing a single performance metric at the cost of overall index effectiveness. Additionally, the full reliance on learned models can increase vulnerability to attacks, compromising system stability. To address these challenges, we propose ShapeShifter, an adaptive evolutionary structure based on traditional indexes, capable of dynamically adjusting node structures according to the workload. ShapeShifter introduces a node evolution strategy with workload-skew-aware policies to adaptively adjust and optimize the partial index structure, leveraging a hybrid mechanism that combines traditional and learned structures for robust performance and optimal time-space tradeoff under skewed workloads and extreme data conditions. The evaluation results show that ShapeShifter achieves the optimal tradeoff while maintaining robustness.
Authors
- Jiake Ge (ORCID: https://orcid.org/0000-0003-4644-0733)
- Xin Wang (ORCID: https://orcid.org/0000-0001-9651-0651)
- Lei Liang (ORCID: https://orcid.org/0009-0000-9700-5809)
- Peng Yi (ORCID: https://orcid.org/0009-0007-5369-6821)
- Hui Wang (ORCID: https://orcid.org/0009-0001-6397-203X)
Institutions
- Tianjin University (CN)
Publication Details
- Published
- 2025-04-22
- DOI
- https://doi.org/10.1145/3696410.3714681
- Citations
- 1
- Primary Topic
- Advanced Data Storage Technologies
- Type
- article
- Field-Weighted Citation Impact
- 1.49
Funders
- Ant Group
- National Natural Science Foundation of China