Combinatorial Logistic Bandits

Combinatorial multi-armed bandit (CMAB) is a fundamental online learning framework that can optimize cumulative rewards in networked systems under uncertainty. Real-world applications like content delivery and channel allocation often feature binary base arm rewards and nonlinear total reward functions. This paper introduces combinatorial logistic bandits (CLogB), a contextual CMAB framework with the base arm reward modeled as a nonlinear logistic function of the context, and the feedback is governed by a general arm-triggering process. We study CLogB with smooth reward functions, covering applications such as online content delivery, online multi-LLM selection, and dynamic channel allocation. Our first algorithm, CLogUCB, uses a variance-agnostic exploration bonus and achieves a regret bound of Õ( d√(κ KT) ), where d is the feature dimension, κ reflects logistic model nonlinearity, K is the maximum number of triggered arms, and Õ ignores logarithmic factors. This improves on prior results by Õ( √κ ). We further propose VA-CLogUCB, a variance-adaptive enhancement achieving regret bounds of Õ( d√(KT) ) under standard smoothness conditions and Õ( d√T ) under stronger variance conditions, removing dependence on K . For time-invariant feature maps, we enhance computational efficiency by avoiding nonconvex optimization while maintaining Õ(d√T) regret. Experiments on synthetic and real-world datasets validate the superior performance of our algorithms, demonstrating their effectiveness and scalability for real-world networked systems.

Authors

Institutions

Publication Details

Journal
ACM SIGMETRICS Performance Evaluation Review
Published
2025-06-16
DOI
https://doi.org/10.1145/3744970.3727279
Primary Topic
Advanced Bandit Algorithms Research
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Combinatorial Logistic Bandits

Mohammad Hajiesmaili, John C. S. Lui, Xuchuang Wang, Xiangxiang Dai et al.
ACM SIGMETRICS Performance Evaluation Review
Advanced Bandit Algorithms Research
article

Combinatorial Logistic Bandits

Mohammad Hajiesmaili, John C. S. Lui, Xuchuang Wang, Xiangxiang Dai, Xutong Liu
article en

Abstract

Combinatorial multi-armed bandit (CMAB) is a fundamental online learning framework that can optimize cumulative rewards in networked systems under uncertainty. Real-world applications like content delivery and channel allocation often feature binary base arm rewards and nonlinear total reward functions. This paper introduces combinatorial logistic bandits (CLogB), a contextual CMAB framework with the base arm reward modeled as a nonlinear logistic function of the context, and the feedback is governed by a general arm-triggering process. We study CLogB with smooth reward functions, covering applications such as online content delivery, online multi-LLM selection, and dynamic channel allocation. Our first algorithm, CLogUCB, uses a variance-agnostic exploration bonus and achieves a regret bound of Õ( d√(κ KT) ), where d is the feature dimension, κ reflects logistic model nonlinearity, K is the maximum number of triggered arms, and Õ ignores logarithmic factors. This improves on prior results by Õ( √κ ). We further propose VA-CLogUCB, a variance-adaptive enhancement achieving regret bounds of Õ( d√(KT) ) under standard smoothness conditions and Õ( d√T ) under stronger variance conditions, removing dependence on K . For time-invariant feature maps, we enhance computational efficiency by avoiding nonconvex optimization while maintaining Õ(d√T) regret. Experiments on synthetic and real-world datasets validate the superior performance of our algorithms, demonstrating their effectiveness and scalability for real-world networked systems.

ACM SIGMETRICS Performance Evaluation ReviewVol. 53(1)
Chinese University of Hong Kong (HK), University of Massachusetts Amherst (US)
Research Grants Council, University Grants Committee
Openalex Percentile: Top 84%
Advanced Bandit Algorithms Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.