Concentration of discrepancy-based approximate Bayesian computation via Rademacher complexity

There has been an increasing interest on summary-free solutions for approximate Bayesian computation (abc) that replace distances among summaries with discrepancies between the empirical distributions of the observed data and the synthetic samples generated under the proposed parameter values. The success of these strategies has motivated theoretical studies on the limiting properties of the induced posteriors. However, there is still the lack of a theoretical framework for summary-free abc that (i) is unified, instead of discrepancy-specific, (ii) does not necessarily require to constrain the analysis to data generating processes and statistical models meeting specific regularity conditions, but rather facilitates the derivation of limiting properties that hold uniformly, and (iii) relies on verifiable assumptions that provide more explicit concentration bounds clarifying which factors govern the limiting behavior of the abc posterior. We address this gap via a novel theoretical framework that introduces the concept of Rademacher complexity in the analysis of the limiting properties for discrepancy-based abc posteriors, including in non-i.i.d. and misspecified settings. This yields a unified theory that relies on constructive arguments and provides more informative asymptotic results and uniform concentration bounds, even in those settings not covered by current studies. These key advancements are obtained by relating the asymptotic properties of summary-free abc posteriors to the behavior of the Rademacher complexity associated with the chosen discrepancy within the family of integral probability semimetrics (ips). The ips class extends summary-based distances, and also includes the widely implemented Wasserstein distance and maximum mean discrepancy (mmd), among others. As clarified in specialized theoretical analyses of popular ips discrepancies and via illustrative simulations, this new perspective improves the understanding of summary-free abc.

Authors

Institutions

Publication Details

Journal
The Annals of Statistics
Published
2025-02-01
DOI
https://doi.org/10.1214/24-aos2453
Citations
3
Primary Topic
Markov Chains and Monte Carlo Methods
Type
article
Field-Weighted Citation Impact
7.89
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Concentration of discrepancy-based approximate Bayesian computation via Rademacher complexity

Sirio Legramanti, Daniele Durante, Pierre Alquier
3 citations
The Annals of Statistics
Markov Chains and Monte Carlo Methods
7.89
article

Concentration of discrepancy-based approximate Bayesian computation via Rademacher complexity

Sirio Legramanti, Daniele Durante, Pierre Alquier
article en
3 citations

Abstract

There has been an increasing interest on summary-free solutions for approximate Bayesian computation (abc) that replace distances among summaries with discrepancies between the empirical distributions of the observed data and the synthetic samples generated under the proposed parameter values. The success of these strategies has motivated theoretical studies on the limiting properties of the induced posteriors. However, there is still the lack of a theoretical framework for summary-free abc that (i) is unified, instead of discrepancy-specific, (ii) does not necessarily require to constrain the analysis to data generating processes and statistical models meeting specific regularity conditions, but rather facilitates the derivation of limiting properties that hold uniformly, and (iii) relies on verifiable assumptions that provide more explicit concentration bounds clarifying which factors govern the limiting behavior of the abc posterior. We address this gap via a novel theoretical framework that introduces the concept of Rademacher complexity in the analysis of the limiting properties for discrepancy-based abc posteriors, including in non-i.i.d. and misspecified settings. This yields a unified theory that relies on constructive arguments and provides more informative asymptotic results and uniform concentration bounds, even in those settings not covered by current studies. These key advancements are obtained by relating the asymptotic properties of summary-free abc posteriors to the behavior of the Rademacher complexity associated with the chosen discrepancy within the family of integral probability semimetrics (ips). The ips class extends summary-based distances, and also includes the widely implemented Wasserstein distance and maximum mean discrepancy (mmd), among others. As clarified in specialized theoretical analyses of popular ips discrepancies and via illustrative simulations, this new perspective improves the understanding of summary-free abc.

The Annals of StatisticsVol. 53(1)
University of Bergamo (IT), École Supérieure des Sciences Économiques et Commerciales (FR), Decision Sciences (United States) (US), Bocconi University (IT)
Reduced inequalities
Openalex Percentile: Top 3%
Markov Chains and Monte Carlo Methods
7.89
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.