Model-independent label-noise detection by feature geometry: pooled vs. local estimators

Confident Learning detects label errors using a classifier trained on the same noisy labels it audits, coupling the auditor to the data it checks. Estimating P(y|x) from feature-space geometry breaks this coupling, and SimiFeat established such training-free detection with local k-nearest-neighbour posteriors. We ask a narrower question: does pooling the geometry into bagged cluster posteriors (a "forest-of-means") beat local k-NN? A prerequisite observation shapes the comparison. The detector that turns a posterior into a flag matters independently of the estimator: for geometric posteriors a per-class voting rule beats Confident-Learning pruning, so any estimator comparison must hold the detector fixed. SimiFeat is stronger overall, but pooling overtakes it at high (>=40%) and feature-dependent noise, where a local neighbourhood is itself corrupted while a pooled region of hundreds of points is not; we confirm this crossover on real human noise (CIFAR-10N, ~40%: F1 0.930 vs. 0.915). The pooled estimator is thus a complement to SimiFeat scoped to high, feature-dependent noise, not a replacement.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-07-27
DOI
https://doi.org/10.5281/zenodo.21627001
Primary Topic
Machine Learning and Data Classification
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Model-independent label-noise detection by feature geometry: pooled vs. local estimators

Daniel Hough
Zenodo (CERN European Organization for Nuclear Research)
Machine Learning and Data Classification
preprint

Model-independent label-noise detection by feature geometry: pooled vs. local estimators

Daniel Hough
preprint en

Abstract

Confident Learning detects label errors using a classifier trained on the same noisy labels it audits, coupling the auditor to the data it checks. Estimating P(y|x) from feature-space geometry breaks this coupling, and SimiFeat established such training-free detection with local k-nearest-neighbour posteriors. We ask a narrower question: does pooling the geometry into bagged cluster posteriors (a "forest-of-means") beat local k-NN? A prerequisite observation shapes the comparison. The detector that turns a posterior into a flag matters independently of the estimator: for geometric posteriors a per-class voting rule beats Confident-Learning pruning, so any estimator comparison must hold the detector fixed. SimiFeat is stronger overall, but pooling overtakes it at high (>=40%) and feature-dependent noise, where a local neighbourhood is itself corrupted while a pooled region of hundreds of points is not; we confirm this crossover on real human noise (CIFAR-10N, ~40%: F1 0.930 vs. 0.915). The pooled estimator is thus a complement to SimiFeat scoped to high, feature-dependent noise, not a replacement.

Zenodo (CERN European Organization for Nuclear Research)
Machine Learning and Data Classification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.