Robust ANN Searching for Dynamic Vector Streams without Rebuilding Index

Graph-based approximate nearest neighbour (ANN) algorithms have dominated vector indexing recently. However, some of them do not support incremental vector addition, while most of them do not support in-place deletion. Therefore, additional rebuilding overhead is required to keep the index updated. We propose HSG (Hybrid Stride Graph) to enable the vector index to accept dynamic vector streams. Inspired by the K-ANN graph and NSG, HSG constructs the index with short and long edges simultaneously without any preprocessing or prior dataset knowledge. Finally, HSG is evaluated against three well-known datasets and the experimental results indicate that HSG can deliver acceptable QPS with an excellent recall guarantee.

Authors

Institutions

Publication Details

Published
2024-11-01
DOI
https://doi.org/10.1109/iccbd-ai65562.2024.00053
Primary Topic
Machine Learning and Algorithms
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Robust ANN Searching for Dynamic Vector Streams without Rebuilding Index

Wenhong Tian, Hengwei Bian, Ruini Xue, Jingxuan Su et al.
Machine Learning and Algorithms
article

Robust ANN Searching for Dynamic Vector Streams without Rebuilding Index

Wenhong Tian, Hengwei Bian, Ruini Xue, Jingxuan Su, Lingwei Chao
article en

Abstract

Graph-based approximate nearest neighbour (ANN) algorithms have dominated vector indexing recently. However, some of them do not support incremental vector addition, while most of them do not support in-place deletion. Therefore, additional rebuilding overhead is required to keep the index updated. We propose HSG (Hybrid Stride Graph) to enable the vector index to accept dynamic vector streams. Inspired by the K-ANN graph and NSG, HSG constructs the index with short and long edges simultaneously without any preprocessing or prior dataset knowledge. Finally, HSG is evaluated against three well-known datasets and the experimental results indicate that HSG can deliver acceptable QPS with an excellent recall guarantee.

University of Electronic Science and Technology of China (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 74%
Machine Learning and Algorithms
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.