SpinGlassBench: Exact References Expose Hidden Errors in Neural Samplers and Free-Energy Estimators
Exact ground truth for neural samplers and free-energy estimators. Learned samplers (autoregressive networks, discrete diffusion, GFlowNets) are often evaluated on systems where nobody knows the right answer. SpinGlassBench uses the Sherrington-Kirkpatrick (SK) spin glass, where the exact ground truth is computable by exhaustive Gray-code enumeration up to n = 28 spins (268,435,456 states per instance) and in the infinite-volume limit via the Parisi formula and the Aizenman-Lebowitz-Ruelle (ALR) high-temperature theorem. This release package contains:- SpinGlassBench_Manuscript.pdf: Full 20-page manuscript draft.- SpinGlassBench_Supplementary_Material.pdf: Detailed mathematical derivations, ablations, and extensive tables.- spinglassbench_code.zip: Full reproducible codebase (Rust Gray-code enumeration engine, PyTorch training harness, evaluation scripts, and test suite).- spinglassbench_benchmark_data.zip: 1,400 disordered instances, exact partition functions, reference ledger, and full benchmark records across classical (PT-TI, SA-TI, AIS, SMC, PA) and learned samplers (VAN-MADE, discrete diffusion, GFlowNet, transformer).- Checkpoints & Audits: Traced verification of released checkpoints from MDNS, MetaDNS, and LEAPS exposing numerical precision and discretization errors.
Authors
- Karthik Gangadharaiah (ORCID: https://orcid.org/0009-0009-1713-8624)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-11-05
- DOI
- https://doi.org/10.5281/zenodo.23984331
- Primary Topic
- Markov Chains and Monte Carlo Methods
- Type
- preprint