Elastic Index Selection for Label-Hybrid AKNN Search

Real-world vector embeddings often carry additional label attributes, such as keywords and tags. In this context, label-hybrid approximate k -nearest neighbor (AKNN) search retrieves the top- k approximate nearest vectors to a query, subject to the constraint that their labels fully contain the query-label set. A naive solution builds a separate index for every query-label set, but the exponential growth of such sets makes this approach storage-prohibitive. To overcome this, we propose selectively indexing only a subset of query-label sets while still ensuring efficient processing for all queries. This is made possible by a key insight into label containment: an index built for a label set L can also serve any query whose label set L' is a superset of L , with query cost bounded by the elastic factor—the ratio between the number of vectors matching L and those matching L' . We formalize the index-selection task as a constrained optimization problem that chooses which label sets to index to satisfy space and query efficiency constraints. We prove the problem is NP-complete and propose efficient greedy algorithms for its efficiency- and space-constrained variants. Extensive experiments on real-world datasets show that our method achieves 10X-800X speedups over state-of-the-art techniques. Moreover, our approach is index-agnostic and can be seamlessly integrated into existing vector database systems.

Authors

Institutions

Publication Details

Journal
Proceedings of the VLDB Endowment
Published
2025-12-01
DOI
https://doi.org/10.14778/3785297.3785304
Primary Topic
Data Management and Algorithms
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Elastic Index Selection for Label-Hybrid AKNN Search

Ming Yang, Raymond Chi-Wing Wong, Wentao Li, Wei Wang et al.
Proceedings of the VLDB Endowment
Data Management and Algorithms
article

Elastic Index Selection for Label-Hybrid AKNN Search

Ming Yang, Raymond Chi-Wing Wong, Wentao Li, Wei Wang, Wenxuan Xia
article en

Abstract

Real-world vector embeddings often carry additional label attributes, such as keywords and tags. In this context, label-hybrid approximate k -nearest neighbor (AKNN) search retrieves the top- k approximate nearest vectors to a query, subject to the constraint that their labels fully contain the query-label set. A naive solution builds a separate index for every query-label set, but the exponential growth of such sets makes this approach storage-prohibitive. To overcome this, we propose selectively indexing only a subset of query-label sets while still ensuring efficient processing for all queries. This is made possible by a key insight into label containment: an index built for a label set L can also serve any query whose label set L' is a superset of L , with query cost bounded by the elastic factor—the ratio between the number of vectors matching L and those matching L' . We formalize the index-selection task as a constrained optimization problem that chooses which label sets to index to satisfy space and query efficiency constraints. We prove the problem is NP-complete and propose efficient greedy algorithms for its efficiency- and space-constrained variants. Extensive experiments on real-world datasets show that our method achieves 10X-800X speedups over state-of-the-art techniques. Moreover, our approach is index-agnostic and can be seamlessly integrated into existing vector database systems.

Proceedings of the VLDB EndowmentVol. 19(4)
University of Leicester (GB), Hong Kong University of Science and Technology (HK), University of Hong Kong (HK)
Openalex Percentile: Top 25%
Data Management and Algorithms
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.