Bandit Multiclass PAC Learning - Corrected Lower Bounds, Exact Families, and a Confidence Direct-Sum Phenomenon

We study realizable multiclass PAC learning with bandit feedback: the learner observes an i.i.d. instance, predicts one of $K$ labels, and learns only whether the prediction was correct. Hanneke, Meng, Moran, and Shaeiri (arXiv:2605.25678) characterized the optimal sample complexity via the bandit DS dimension $\mathrm{BDS}(\mathcal{H})$ up to logarithmic factors, and asked whether every class admits sample complexity $O((\mathrm{BDS}+\log(1/\delta))/\epsilon)$. We give a fine-grained resolution of this landscape. First, we show that the published lower bound $\Omega((\mathrm{BDS}+\log(1/\delta))/\epsilon)$ is incorrect as stated: we exhibit explicit classes with $\mathrm{BDS}=K-1$ whose sample complexity is exponentially smaller, and locate two independent gaps in the published proof. We repair the lower-bound theory around a new anchored dimension $\mathrm{aBDS}(\mathcal{H})\le\mathrm{BDS}(\mathcal{H})$, proving a constant-free three-part lower bound. On the upper-bound side we remove the ambient label count $K$ entirely, proving $O((B\log^3 B+B\log(1/\delta))/\epsilon)$ for $B=\mathrm{BDS}(\mathcal{H})$, plus a constant-confidence bound via a new fiberization lemma; for two natural families we determine the sample complexity up to constant factors, with no logarithmic slack. Finally, we answer the open question in the negative under its uniform-constant reading and show the failure is intrinsic: for an explicit affine multiplexer class we establish the full confidence profile $\Theta((n\min{n,\log(1/\delta)}+\log(1/\delta))/\epsilon)$ — a confidence direct-sum regime in which a multiplicative $\log(1/\delta)$ cost is information-theoretically necessary, followed by a rank-saturation phase transition. Moreover, two classes with identical dimension profiles can have polynomially different sample complexities, so no characterization by these dimensions alone can be accurate to polylogarithmic factors. We also explain why these results are consistent with additive-confidence list-PAC guarantees combined with the ListCascade bridge.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-09-01
DOI
https://doi.org/10.5281/zenodo.22217764
Primary Topic
Advanced Bandit Algorithms Research
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Bandit Multiclass PAC Learning - Corrected Lower Bounds, Exact Families, and a Confidence Direct-Sum Phenomenon

Guangjian Zhang
Zenodo (CERN European Organization for Nuclear Research)
Advanced Bandit Algorithms Research
preprint

Bandit Multiclass PAC Learning - Corrected Lower Bounds, Exact Families, and a Confidence Direct-Sum Phenomenon

Guangjian Zhang
preprint en

Abstract

We study realizable multiclass PAC learning with bandit feedback: the learner observes an i.i.d. instance, predicts one of $K$ labels, and learns only whether the prediction was correct. Hanneke, Meng, Moran, and Shaeiri (arXiv:2605.25678) characterized the optimal sample complexity via the bandit DS dimension $\mathrm{BDS}(\mathcal{H})$ up to logarithmic factors, and asked whether every class admits sample complexity $O((\mathrm{BDS}+\log(1/\delta))/\epsilon)$. We give a fine-grained resolution of this landscape. First, we show that the published lower bound $\Omega((\mathrm{BDS}+\log(1/\delta))/\epsilon)$ is incorrect as stated: we exhibit explicit classes with $\mathrm{BDS}=K-1$ whose sample complexity is exponentially smaller, and locate two independent gaps in the published proof. We repair the lower-bound theory around a new anchored dimension $\mathrm{aBDS}(\mathcal{H})\le\mathrm{BDS}(\mathcal{H})$, proving a constant-free three-part lower bound. On the upper-bound side we remove the ambient label count $K$ entirely, proving $O((B\log^3 B+B\log(1/\delta))/\epsilon)$ for $B=\mathrm{BDS}(\mathcal{H})$, plus a constant-confidence bound via a new fiberization lemma; for two natural families we determine the sample complexity up to constant factors, with no logarithmic slack. Finally, we answer the open question in the negative under its uniform-constant reading and show the failure is intrinsic: for an explicit affine multiplexer class we establish the full confidence profile $\Theta((n\min{n,\log(1/\delta)}+\log(1/\delta))/\epsilon)$ — a confidence direct-sum regime in which a multiplicative $\log(1/\delta)$ cost is information-theoretically necessary, followed by a rank-saturation phase transition. Moreover, two classes with identical dimension profiles can have polynomially different sample complexities, so no characterization by these dimensions alone can be accurate to polylogarithmic factors. We also explain why these results are consistent with additive-confidence list-PAC guarantees combined with the ListCascade bridge.

Zenodo (CERN European Organization for Nuclear Research)
UNSW Sydney (AU)
Quality Education
Advanced Bandit Algorithms Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.