False Confidence in Generative Samplers: Exact Physical References Expose Hidden Errors and Diagnostic Blindness

Learned samplers are increasingly proposed for equilibrium sampling and free energies in chemistry, and they are usually judged by self-normalized diagnostics such as the effective sample size (ESS). We show with an elementary proposition that these diagnostics are structurally invariant to the Boltzmann mass α of unvisited basins: conditioned on not proposing a basin, the importance weights follow the law of the truncated system, so the ESS stays high while the free energy shifts by −kBT log(1 − α) and the nominal deltamethod interval contracts around the biased value, yielding asymptotically zero coverage. In a toy double well where one basin holds 49.9% of the mass, a proposal putting mass 10−6 on that basin achieves a median ESS of 98% but covers the exact logZ in 0% of 400 runs. On exactly enumerated Sherrington-Kirkpatrick instances (n = 24), nominal 95% intervals from masked diffusion and a GFlowNet cover the truth in only 8% and 47% of runs at β = 2, while classical estimators and an autoregressive network (VAN-MADE) stay near 95%. A reverse check that scores the proposal on draws from an independent reference sampler flags the dropped basin where the forward Jensen gap is blind. We demonstrate this on a continuous molecular model: a RealNVP Boltzmann generator trained on the alanine dipeptide Ramachandran landscape drops the C7ax basin (8.1% mass), reporting a median ESS of 79% with only 10% coverage, while the reverse check detects the omission (Grev = 11.7 nats). Finally, we size the bound on macromolecular systems (chignolin, Trpcage, LJ38), contrasting single-trajectory kinetic trapping with converged Anton and NMR equilibrium baselines to show that dropped macroscopic states shift free energies by 0.68 to 1.02 kcal/mol, exceeding lead-optimization thresholds.

Authors

Publication Details

Journal
ChemRxiv
Published
2026-11-06
DOI
https://doi.org/10.26434/chemrxiv.15011779/v1
Primary Topic
Markov Chains and Monte Carlo Methods
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

False Confidence in Generative Samplers: Exact Physical References Expose Hidden Errors and Diagnostic Blindness

Karthik Gangadharaiah
1 links
ChemRxiv
Markov Chains and Monte Carlo Methods
preprint

False Confidence in Generative Samplers: Exact Physical References Expose Hidden Errors and Diagnostic Blindness

Karthik Gangadharaiah
preprint en

Abstract

Learned samplers are increasingly proposed for equilibrium sampling and free energies in chemistry, and they are usually judged by self-normalized diagnostics such as the effective sample size (ESS). We show with an elementary proposition that these diagnostics are structurally invariant to the Boltzmann mass α of unvisited basins: conditioned on not proposing a basin, the importance weights follow the law of the truncated system, so the ESS stays high while the free energy shifts by −kBT log(1 − α) and the nominal deltamethod interval contracts around the biased value, yielding asymptotically zero coverage. In a toy double well where one basin holds 49.9% of the mass, a proposal putting mass 10−6 on that basin achieves a median ESS of 98% but covers the exact logZ in 0% of 400 runs. On exactly enumerated Sherrington-Kirkpatrick instances (n = 24), nominal 95% intervals from masked diffusion and a GFlowNet cover the truth in only 8% and 47% of runs at β = 2, while classical estimators and an autoregressive network (VAN-MADE) stay near 95%. A reverse check that scores the proposal on draws from an independent reference sampler flags the dropped basin where the forward Jensen gap is blind. We demonstrate this on a continuous molecular model: a RealNVP Boltzmann generator trained on the alanine dipeptide Ramachandran landscape drops the C7ax basin (8.1% mass), reporting a median ESS of 79% with only 10% coverage, while the reverse check detects the omission (Grev = 11.7 nats). Finally, we size the bound on macromolecular systems (chignolin, Trpcage, LJ38), contrasting single-trajectory kinetic trapping with converged Anton and NMR equilibrium baselines to show that dropped macroscopic states shift free energies by 0.68 to 1.02 kcal/mol, exceeding lead-optimization thresholds.

ChemRxiv
Markov Chains and Monte Carlo Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon