SandwichSketch: A More Accurate Sketch for Frequent Object Mining in Data Streams
Frequent object mining has gained considerable interest in the research community and can be split into frequent item mining and frequent set mining depending on the type of object. While existing sketch-based algorithms have made significant progress in addressing these two tasks concurrently, they also possess notable limitations. They either support only software platforms with low throughput or compromise accuracy for faster processing speed and better hardware compatibility. In this paper, we make a substantial stride towards supporting frequent object mining by designing SandwichSketch, which draws inspiration from sandwich making and proposes two techniques including the double fidelity enhancement and hierarchical hot locking to guarantee high fidelity on both two tasks. We implement SandwichSketch on three platforms (CPU, Redis, and FPGA) and show that it enhances accuracy by <inline-formula><tex-math notation="LaTeX">$38.4\times$</tex-math></inline-formula> and <inline-formula><tex-math notation="LaTeX">$5\times$</tex-math></inline-formula> for two tasks on three real-world datasets, respectively. Additionally, it supports a distributed measurement scenario with less than a 0.01% decrease in Average Relative Error (ARE) when the number of nodes increases from 1 to 16.
Authors
- Ruijie Miao (ORCID: https://orcid.org/0000-0002-7266-8064)
- Yuhan Wu (ORCID: https://orcid.org/0000-0001-7115-5390)
- Ruwen Zhang (ORCID: https://orcid.org/0000-0002-6102-9195)
- Zihan Jiang (ORCID: https://orcid.org/0000-0003-1160-1058)
- Tong Yang (ORCID: https://orcid.org/0000-0003-2402-5854)
- Zhuochen Fan (ORCID: https://orcid.org/0000-0003-0042-1828)
- Ruixin Wang (ORCID: https://orcid.org/0000-0002-5236-2228)
- Sha Wang (ORCID: https://orcid.org/0009-0008-9922-1431)
- Kaicheng Yang
- Bui Cui
Institutions
- National University of Defense Technology (CN)
- Peking University (CN)
- Peng Cheng Laboratory (CN)
Publication Details
- Journal
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/tkde.2025.3607691
- Primary Topic
- Data Stream Mining Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00