Kolmogorov–Arnold Networks as Implicit Regularizers: Noise Robustness and Interpretability for Stellar Classification

This paper tests whether Kolmogorov–Arnold Networks (KAN 2.0) are genuinely more noise-robust than Multi-Layer Perceptrons (MLP) and XGBoost for stellar classification (star/galaxy/quasar, 100,000 SDSS DR17 objects). A naive comparison suggests so: KAN retains +9 percentage points over MLP at SNR=5. But equalizing baseline accuracy via weight decay eliminates the gap — a properly regularized MLP matches KAN to within 1 p.p. at all SNR levels, both with and without spectroscopic redshift. The same holds on an independent DESI DR1 sample with different photometric bands. KAN's robustness thus traces to implicit regularization by C²-smooth B-spline activations, not to architecture. Per-class analysis (20 trials) shows that stars degrade fastest (F1: 0.97→0.75 at SNR=5), while QSOs remain stable. KAN's native feature importance and SHAP on MLP produce different rankings (Spearman ρ=−0.37), capturing complementary aspects of the classification. Colour-index features (u−g, g−r, r−i, i−z) widen KAN's relative advantage, and a hybrid pipeline routing uncertain MLP predictions to KAN improves low-SNR accuracy. KAN is best understood as a convenient auto-regularizer whose genuine advantage is built-in interpretability.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-05-27
DOI
https://doi.org/10.5281/zenodo.20412613
Primary Topic
Gaussian Processes and Bayesian Inference
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Kolmogorov–Arnold Networks as Implicit Regularizers: Noise Robustness and Interpretability for Stellar Classification

Kristian Sestak
Zenodo (CERN European Organization for Nuclear Research)
Gaussian Processes and Bayesian Inference
preprint

Kolmogorov–Arnold Networks as Implicit Regularizers: Noise Robustness and Interpretability for Stellar Classification

Kristian Sestak
preprint en

Abstract

This paper tests whether Kolmogorov–Arnold Networks (KAN 2.0) are genuinely more noise-robust than Multi-Layer Perceptrons (MLP) and XGBoost for stellar classification (star/galaxy/quasar, 100,000 SDSS DR17 objects). A naive comparison suggests so: KAN retains +9 percentage points over MLP at SNR=5. But equalizing baseline accuracy via weight decay eliminates the gap — a properly regularized MLP matches KAN to within 1 p.p. at all SNR levels, both with and without spectroscopic redshift. The same holds on an independent DESI DR1 sample with different photometric bands. KAN's robustness thus traces to implicit regularization by C²-smooth B-spline activations, not to architecture. Per-class analysis (20 trials) shows that stars degrade fastest (F1: 0.97→0.75 at SNR=5), while QSOs remain stable. KAN's native feature importance and SHAP on MLP produce different rankings (Spearman ρ=−0.37), capturing complementary aspects of the classification. Colour-index features (u−g, g−r, r−i, i−z) widen KAN's relative advantage, and a hybrid pipeline routing uncertain MLP predictions to KAN improves low-SNR accuracy. KAN is best understood as a convenient auto-regularizer whose genuine advantage is built-in interpretability.

Zenodo (CERN European Organization for Nuclear Research)
Gaussian Processes and Bayesian Inference
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.