AutoResearch Lite: a reproducible paper-inspired experiment runner (Adam mechanism reproduction and convergence-speed comparison)

A dependency-free experiment runner that turns a paper's research question into a configuration-driven, verifiable experiment task. The bundled reproduction maps the first/second moment estimates and bias correction of Adam (Kingma & Ba, arXiv:1412.6980) into runnable Python and compares them against fixed-learning-rate SGD under fixed seeds and epoch budgets. A second experiment measures convergence speed (epochs to reach a target training loss) against SGD with heavy-ball momentum, AdaGrad and RMSProp, with every optimizer family tuned by the same coarse learning-rate sweep. In that experiment Adam is not the fastest; the negative result is reported in full. Every reported number is pinned in an expected-values file with explicit tolerances and checked by one command that also runs the unit tests, and the checking harness is validated against deliberately broken implementations (negative controls). The repository also ships a task contract that expresses the reproduction as a repeatable, scoreable task for an automated research loop.

Publication Details

Journal
DROPS (Schloss Dagstuhl – Leibniz Center for Informatics)
Published
2026-09-28
DOI
https://doi.org/10.5281/zenodo.23003626
Citations
49,999
Primary Topic
Stochastic Gradient Optimization Techniques
Type
article
Field-Weighted Citation Impact
3652.29

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

AutoResearch Lite: a reproducible paper-inspired experiment runner (Adam mechanism reproduction and convergence-speed comparison)

49,999 citations
DROPS (Schloss Dagstuhl – Leibniz Center for Informatics)
Stochastic Gradient Optimization Techniques
3652.29
article

AutoResearch Lite: a reproducible paper-inspired experiment runner (Adam mechanism reproduction and convergence-speed comparison)

article en
49,999 citations

Abstract

A dependency-free experiment runner that turns a paper's research question into a configuration-driven, verifiable experiment task. The bundled reproduction maps the first/second moment estimates and bias correction of Adam (Kingma & Ba, arXiv:1412.6980) into runnable Python and compares them against fixed-learning-rate SGD under fixed seeds and epoch budgets. A second experiment measures convergence speed (epochs to reach a target training loss) against SGD with heavy-ball momentum, AdaGrad and RMSProp, with every optimizer family tuned by the same coarse learning-rate sweep. In that experiment Adam is not the fastest; the negative result is reported in full. Every reported number is pinned in an expected-values file with explicit tolerances and checked by one command that also runs the unit tests, and the checking harness is validated against deliberately broken implementations (negative controls). The repository also ships a task contract that expresses the reproduction as a repeatable, scoreable task for an automated research loop.

DROPS (Schloss Dagstuhl – Leibniz Center for Informatics)
National Science Foundation, U.S. Department of Energy, Maryland Advanced Research Computing Center, Division of Emerging Frontiers in Research and Innovation, Army Research Office
Openalex Percentile: Top 0%
Stochastic Gradient Optimization Techniques
3652.29
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

AutoResearch Lite: a reproducible paper-inspired experiment runner (Adam mechanism reproduction and convergence-speed comparison) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) (2026) | TGRS Research Map | TGRS