Bayesian computation with generative diffusion models by Multilevel Monte Carlo
Generative diffusion models have recently emerged as a powerful strategy to perform stochastic sampling in Bayesian inverse problems, delivering remarkably accurate solutions for a wide range of challenging applications. However, diffusion models often require a large number of neural function evaluations per sample in order to deliver accurate posterior samples. As a result, using diffusion models as stochastic samplers for Monte Carlo integration in Bayesian computation can be highly computationally expensive, particularly in applications that require a substantial number of Monte Carlo samples for conducting uncertainty quantification analyses. This cost is especially high in large-scale inverse problems such as computational imaging, which rely on large neural networks that are expensive to evaluate. With quantitative imaging applications in mind, this paper presents a Multilevel Monte Carlo strategy that significantly reduces the cost of Bayesian computation with diffusion models. This is achieved by exploiting cost-accuracy trade-offs inherent to diffusion models to carefully couple models of different levels of accuracy in a manner that significantly reduces the overall cost of the calculation, without reducing the final accuracy. The proposed approach achieves a [Formula: see text]-to-[Formula: see text] reduction in computational cost with respect to standard techniques across three benchmark imaging problems.This article is part of the theme issue 'Generative modelling meets Bayesian inference: a new paradigm for inverse problems'.
Authors
- Abdul-Lateef Haji-Ali (ORCID: https://orcid.org/0000-0002-6243-0335)
- Konstantinos C. Zygalakis (ORCID: https://orcid.org/0000-0002-3860-9167)
- Luke Shaw (ORCID: https://orcid.org/0000-0001-5663-1520)
- Marcelo Pereyra (ORCID: https://orcid.org/0000-0001-6438-6772)
Institutions
- Universitat Jaume I (ES)
- Heriot-Watt University (GB)
- University of Edinburgh (GB)
Publication Details
- Journal
- Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences
- Published
- 2025-06-19
- DOI
- https://doi.org/10.1098/rsta.2024.0333
- Primary Topic
- Gaussian Processes and Bayesian Inference
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Ministerio de Ciencia e Innovación
- Engineering and Physical Sciences Research Council