Pre-registration (second protocol) of a replication of the neural scaling exponent claim of Kolmogorov-Arnold Networks with large training sets (arXiv 2404.19756)

Frozen pre-registration (2 Nov 2026) of a second private replication of the claim that KANs trained with LBFGS and grid extension reach a test-RMSE-versus-parameter-count exponent close to 4 on smooth toy functions where MLPs do clearly worse (Liu et al., arXiv 2404.19756; code KindXiaoming/pykan, commit ecde4ec3). It replaces a first protocol (doi:10.5281/zenodo.23856253) that returned Inconclusive because its training sets were too small and its MLP comparison family too sparse. Three scored functions, training sets at least ten times the largest parameter count, an analytically generated MLP family covering the KAN parameter window, a pre-registered training-success gate, an interpolation control, 20 seeds per function, pre-set bounds (KAN slope lower bound 3.0; KAN minus MLP slope above 1.0), known-answer and negative controls. Contains the decision code with its planted-effect table, harness, MLP-family generator, cost estimate and the run kernel. Deposited before any confirmatory run. Outcome wording: Replicated / Did not replicate / Inconclusive under protocol X.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-02
DOI
https://doi.org/10.5281/zenodo.23873698
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Pre-registration (second protocol) of a replication of the neural scaling exponent claim of Kolmogorov-Arnold Networks with large training sets (arXiv 2404.19756)

John Goodman
1 links
Zenodo (CERN European Organization for Nuclear Research)
Neural Networks and Applications
article

Pre-registration (second protocol) of a replication of the neural scaling exponent claim of Kolmogorov-Arnold Networks with large training sets (arXiv 2404.19756)

John Goodman
article en

Abstract

Frozen pre-registration (2 Nov 2026) of a second private replication of the claim that KANs trained with LBFGS and grid extension reach a test-RMSE-versus-parameter-count exponent close to 4 on smooth toy functions where MLPs do clearly worse (Liu et al., arXiv 2404.19756; code KindXiaoming/pykan, commit ecde4ec3). It replaces a first protocol (doi:10.5281/zenodo.23856253) that returned Inconclusive because its training sets were too small and its MLP comparison family too sparse. Three scored functions, training sets at least ten times the largest parameter count, an analytically generated MLP family covering the KAN parameter window, a pre-registered training-success gate, an interpolation control, 20 seeds per function, pre-set bounds (KAN slope lower bound 3.0; KAN minus MLP slope above 1.0), known-answer and negative controls. Contains the decision code with its planted-effect table, harness, MLP-family generator, cost estimate and the run kernel. Deposited before any confirmatory run. Outcome wording: Replicated / Did not replicate / Inconclusive under protocol X.

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 17%
Neural Networks and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon