Using Bloom Filter to Represent Large Dynamic Dataset

The Bloom filter is a time-and space-efficient data structure for representing large datasets. In the era of big data, this structure proves particularly valuable for resource-constrained data indexing. However, conventional Bloom filters exhibit poor scalability. When handling dynamically expanding datasets where the volume grows rapidly, standard Bloom filters demonstrate degraded performance once the element count surpasses their predefined capacity. This paper introduces a novel Bloom filter-based algorithm and corresponding data structure to address this limitation. We detail the algorithmic architecture and provide theoretical analyses, followed by experimental evaluations comparing our approach with established baseline methods. The results indicate that our design effectively manages large-scale data expansion and significantly outperforms standard Bloom filters in scalable dataset scenarios.

Authors

Institutions

Publication Details

Published
2025-05-09
DOI
https://doi.org/10.1109/ddcls66240.2025.11065990
Primary Topic
Caching and Content Delivery
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Using Bloom Filter to Represent Large Dynamic Dataset

Zhu Wang
Caching and Content Delivery
article

Using Bloom Filter to Represent Large Dynamic Dataset

Zhu Wang
article en

Abstract

The Bloom filter is a time-and space-efficient data structure for representing large datasets. In the era of big data, this structure proves particularly valuable for resource-constrained data indexing. However, conventional Bloom filters exhibit poor scalability. When handling dynamically expanding datasets where the volume grows rapidly, standard Bloom filters demonstrate degraded performance once the element count surpasses their predefined capacity. This paper introduces a novel Bloom filter-based algorithm and corresponding data structure to address this limitation. We detail the algorithmic architecture and provide theoretical analyses, followed by experimental evaluations comparing our approach with established baseline methods. The results indicate that our design effectively manages large-scale data expansion and significantly outperforms standard Bloom filters in scalable dataset scenarios.

Sany (China) (CN)
Openalex Percentile: Top 82%
Caching and Content Delivery
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.