Almost exact recovery in noisy semi-supervised learning

Abstract Graph-based semi-supervised learning methods combine the graph structure and labeled data to classify unlabeled data. In this work, we study the effect of a noisy oracle on classification. In particular, we derive the maximum a posteriori (MAP) estimator for clustering a degree corrected stochastic block model when a noisy oracle reveals a fraction of the labels. We then propose an algorithm derived from a continuous relaxation of the MAP, and we establish its consistency. Numerical experiments show that our approach achieves promising performance on synthetic and real data sets, even in the case of very noisy labeled data.

Authors

Institutions

Publication Details

Journal
Probability in the Engineering and Informational Sciences
Published
2024-11-11
DOI
https://doi.org/10.1017/s0269964824000135
Citations
1
Primary Topic
Machine Learning and Data Classification
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Almost exact recovery in noisy semi-supervised learning

Maximilien Dreveton, Konstantin Avrachenkov
1 citations
Probability in the Engineering and Informational Sciences
Machine Learning and Data Classification
article

Almost exact recovery in noisy semi-supervised learning

Maximilien Dreveton, Konstantin Avrachenkov
article en
1 citations

Abstract

Abstract Graph-based semi-supervised learning methods combine the graph structure and labeled data to classify unlabeled data. In this work, we study the effect of a noisy oracle on classification. In particular, we derive the maximum a posteriori (MAP) estimator for clustering a degree corrected stochastic block model when a noisy oracle reveals a fraction of the labels. We then propose an algorithm derived from a continuous relaxation of the MAP, and we establish its consistency. Numerical experiments show that our approach achieves promising performance on synthetic and real data sets, even in the case of very noisy labeled data.

Probability in the Engineering and Informational SciencesVol. 39(1)
École Polytechnique Fédérale de Lausanne (CH)
University of Cambridge
Openalex Percentile: Top 100%
Machine Learning and Data Classification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.