AutoResearch Lite: a reproducible paper-inspired experiment runner (Adam mechanism reproduction and convergence-speed comparison)
A dependency-free experiment runner that turns a paper's research question into a configuration-driven, verifiable experiment task. The bundled reproduction maps the first/second moment estimates and bias correction of Adam (Kingma & Ba, arXiv:1412.6980) into runnable Python and compares them against fixed-learning-rate SGD under fixed seeds and epoch budgets. A second experiment measures convergence speed (epochs to reach a target training loss) against SGD with heavy-ball momentum, AdaGrad and RMSProp, with every optimizer family tuned by the same coarse learning-rate sweep. In that experiment Adam is not the fastest; the negative result is reported in full. Every reported number is pinned in an expected-values file with explicit tolerances and checked by one command that also runs the unit tests, and the checking harness is validated against deliberately broken implementations (negative controls). The repository also ships a task contract that expresses the reproduction as a repeatable, scoreable task for an automated research loop.
Publication Details
- Journal
- DROPS (Schloss Dagstuhl – Leibniz Center for Informatics)
- Published
- 2026-09-28
- DOI
- https://doi.org/10.5281/zenodo.23003626
- Citations
- 49,999
- Primary Topic
- Stochastic Gradient Optimization Techniques
- Type
- article
- Field-Weighted Citation Impact
- 3652.29
Funders
- National Science Foundation
- U.S. Department of Energy
- Maryland Advanced Research Computing Center
- Division of Emerging Frontiers in Research and Innovation
- Army Research Office