Robust ANN Searching for Dynamic Vector Streams without Rebuilding Index
Graph-based approximate nearest neighbour (ANN) algorithms have dominated vector indexing recently. However, some of them do not support incremental vector addition, while most of them do not support in-place deletion. Therefore, additional rebuilding overhead is required to keep the index updated. We propose HSG (Hybrid Stride Graph) to enable the vector index to accept dynamic vector streams. Inspired by the K-ANN graph and NSG, HSG constructs the index with short and long edges simultaneously without any preprocessing or prior dataset knowledge. Finally, HSG is evaluated against three well-known datasets and the experimental results indicate that HSG can deliver acceptable QPS with an excellent recall guarantee.
Authors
- Wenhong Tian (ORCID: https://orcid.org/0000-0002-5551-9796)
- Hengwei Bian (ORCID: https://orcid.org/0009-0003-8749-1702)
- Ruini Xue (ORCID: https://orcid.org/0000-0003-1802-5188)
- Jingxuan Su (ORCID: https://orcid.org/0000-0001-7441-794X)
- Lingwei Chao
Institutions
- University of Electronic Science and Technology of China (CN)
Publication Details
- Published
- 2024-11-01
- DOI
- https://doi.org/10.1109/iccbd-ai65562.2024.00053
- Primary Topic
- Machine Learning and Algorithms
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China