Using Bloom Filter to Represent Large Dynamic Dataset
The Bloom filter is a time-and space-efficient data structure for representing large datasets. In the era of big data, this structure proves particularly valuable for resource-constrained data indexing. However, conventional Bloom filters exhibit poor scalability. When handling dynamically expanding datasets where the volume grows rapidly, standard Bloom filters demonstrate degraded performance once the element count surpasses their predefined capacity. This paper introduces a novel Bloom filter-based algorithm and corresponding data structure to address this limitation. We detail the algorithmic architecture and provide theoretical analyses, followed by experimental evaluations comparing our approach with established baseline methods. The results indicate that our design effectively manages large-scale data expansion and significantly outperforms standard Bloom filters in scalable dataset scenarios.
Authors
- Zhu Wang (ORCID: https://orcid.org/0000-0002-0699-2456)
Institutions
- Sany (China) (CN)
Publication Details
- Published
- 2025-05-09
- DOI
- https://doi.org/10.1109/ddcls66240.2025.11065990
- Primary Topic
- Caching and Content Delivery
- Type
- article
- Field-Weighted Citation Impact
- 0.00