Learning-Augmented Frequency Estimation in Sliding Windows

We show how to utilize machine learning approaches to improve sliding window algorithms for approximate frequency estimation problems, under the “algorithms with predictions” framework. In this dynamic environment, previous learning-augmented algorithms are less effective, since properties in sliding window resolution can differ significantly from the properties of the entire stream. Our focus is on the benefits of predicting and filtering out items with large next arrival times – that is, there is a large gap until their next appearance – from the stream, which we show improves the memory-accuracy tradeoffs significantly. We provide theorems that provide insight into how and by how much our technique can improve the sliding window algorithm, as well as experimental results using real-world data sets. Our work demonstrates that predictors can be useful in the challenging sliding window setting.

Authors

Institutions

Publication Details

Published
2024-10-28
DOI
https://doi.org/10.1109/icnp61940.2024.10858536
Primary Topic
Textile materials and evaluations
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Learning-Augmented Frequency Estimation in Sliding Windows

Ibrahim Sabek, Michael Mitzenmacher, Rana Shahout
Textile materials and evaluations
article

Learning-Augmented Frequency Estimation in Sliding Windows

Ibrahim Sabek, Michael Mitzenmacher, Rana Shahout
article en

Abstract

We show how to utilize machine learning approaches to improve sliding window algorithms for approximate frequency estimation problems, under the “algorithms with predictions” framework. In this dynamic environment, previous learning-augmented algorithms are less effective, since properties in sliding window resolution can differ significantly from the properties of the entire stream. Our focus is on the benefits of predicting and filtering out items with large next arrival times – that is, there is a large gap until their next appearance – from the stream, which we show improves the memory-accuracy tradeoffs significantly. We provide theorems that provide insight into how and by how much our technique can improve the sliding window algorithm, as well as experimental results using real-world data sets. Our work demonstrates that predictors can be useful in the challenging sliding window setting.

University of Southern California (US), California Southern University (US), Harvard University Press (US)
National Science Foundation
Openalex Percentile: Top 79%
Textile materials and evaluations
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Learning-Augmented Frequency Estimation in Sliding Windows — Ibrahim Sabek, Michael Mitzenmacher, et al. · (2024) | TGRS Research Map | TGRS