Two-sided disjunctions and the formal semi-supervised criterion of Blum–Balcan: a counting lemma, two learners, and what remains open

Blum and Balcan (Open Problems in Efficient Semi-Supervised PAC Learning, COLT 2007) asked for an efficient semi-supervised algorithm for two-sided disjunctions whose number of labelled examples is polynomial in log|CD,χ(ε)|, 1/ε and 1/δ, for every distribution consistent with the compatibility notion. Taking the class to be all pairs of monotone disjunctions, including the empty disjunction, and using one ε for labelled and unlabelled error as in the formal definition, we prove a hitting-set lemma: log2|CD,χ(ε)| ≥ ⌊εn⌋ for every such distribution. Consequently, classical supervised elimination already meets the stated criterion. A second counting lemma sharpens the label bound and gives a stopping rule from unlabelled data. Since no unlabelled data is needed to classify, the formal criterion is satisfied degenerately; this does not show that unlabelled data helps. Without the empty disjunction the hitting-set lemma fails, and only the second bound survives with an extra ln n. For the cover-based strengthening we give a family with ε-cover of size 4 on which elimination-type rules need Θ(n log min(n,1/ε)) labels; that version remains open. Files: manuscript (PDF), LaTeX source, and a single Python 3 verification script (standard library only). Contact: [email protected]

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-28
DOI
https://doi.org/10.5281/zenodo.23718907
Primary Topic
Machine Learning and Algorithms
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Two-sided disjunctions and the formal semi-supervised criterion of Blum–Balcan: a counting lemma, two learners, and what remains open

Grisha Pochuev
3 links
Zenodo (CERN European Organization for Nuclear Research)
Machine Learning and Algorithms
preprint

Two-sided disjunctions and the formal semi-supervised criterion of Blum–Balcan: a counting lemma, two learners, and what remains open

Grisha Pochuev
preprint en

Abstract

Blum and Balcan (Open Problems in Efficient Semi-Supervised PAC Learning, COLT 2007) asked for an efficient semi-supervised algorithm for two-sided disjunctions whose number of labelled examples is polynomial in log|CD,χ(ε)|, 1/ε and 1/δ, for every distribution consistent with the compatibility notion. Taking the class to be all pairs of monotone disjunctions, including the empty disjunction, and using one ε for labelled and unlabelled error as in the formal definition, we prove a hitting-set lemma: log2|CD,χ(ε)| ≥ ⌊εn⌋ for every such distribution. Consequently, classical supervised elimination already meets the stated criterion. A second counting lemma sharpens the label bound and gives a stopping rule from unlabelled data. Since no unlabelled data is needed to classify, the formal criterion is satisfied degenerately; this does not show that unlabelled data helps. Without the empty disjunction the hitting-set lemma fails, and only the second bound survives with an extra ln n. For the cover-based strengthening we give a family with ε-cover of size 4 on which elimination-type rules need Θ(n log min(n,1/ε)) labels; that version remains open. Files: manuscript (PDF), LaTeX source, and a single Python 3 verification script (standard library only). Contact: [email protected]

Zenodo (CERN European Organization for Nuclear Research)
Machine Learning and Algorithms
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon