Short-Lived High-Volume Bandits

When Thousands of Items Arrive Every Hour: A New Approach to Online Experimentation Researchers have reported a new approach to address a key challenge for online platforms. In a new paper in Operations Research, Jia et al. introduced the Short-lived High-volume Bandits (SLHVB) framework. This models modern platforms where thousands of items—such as ads, stories, or interface designs—arrive each hour but remain available only briefly. The study develops a near-optimal online learning policy that balances exploration and exploitation. Theoretical analysis shows the algorithm achieves nearly the minimal possible loss as the number of user impressions grows. The team tested the policy in a large-scale field experiment with Glance, a leading lock-screen content platform. The policy increased viewing duration by 4.32% and click-through rates by 7.48% compared to the platform’s existing deep-learning-based recommender system.

Authors

Institutions

Publication Details

Journal
Operations Research
Published
2026-04-21
DOI
https://doi.org/10.1287/opre.2023.0557
Primary Topic
Advanced Bandit Algorithms Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Short-Lived High-Volume Bandits

Andrew Li, R. Ravi, Paul Duff, Su Jia et al.
Operations Research
Advanced Bandit Algorithms Research
article

Short-Lived High-Volume Bandits

Andrew Li, R. Ravi, Paul Duff, Su Jia, Nishant Oli, Ian Anderson
article en

Abstract

When Thousands of Items Arrive Every Hour: A New Approach to Online Experimentation Researchers have reported a new approach to address a key challenge for online platforms. In a new paper in Operations Research, Jia et al. introduced the Short-lived High-volume Bandits (SLHVB) framework. This models modern platforms where thousands of items—such as ads, stories, or interface designs—arrive each hour but remain available only briefly. The study develops a near-optimal online learning policy that balances exploration and exploitation. Theoretical analysis shows the algorithm achieves nearly the minimal possible loss as the number of user impressions grows. The team tested the policy in a large-scale field experiment with Glance, a leading lock-screen content platform. The policy increased viewing duration by 4.32% and click-through rates by 7.48% compared to the platform’s existing deep-learning-based recommender system.

Operations Research
Amazon (United States) (US), Healthcare Global Enterprises (IN), Carnegie Mellon University (US)
Openalex Percentile: Top 8%
Advanced Bandit Algorithms Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.