Bayesian computation with generative diffusion models by Multilevel Monte Carlo

Generative diffusion models have recently emerged as a powerful strategy to perform stochastic sampling in Bayesian inverse problems, delivering remarkably accurate solutions for a wide range of challenging applications. However, diffusion models often require a large number of neural function evaluations per sample in order to deliver accurate posterior samples. As a result, using diffusion models as stochastic samplers for Monte Carlo integration in Bayesian computation can be highly computationally expensive, particularly in applications that require a substantial number of Monte Carlo samples for conducting uncertainty quantification analyses. This cost is especially high in large-scale inverse problems such as computational imaging, which rely on large neural networks that are expensive to evaluate. With quantitative imaging applications in mind, this paper presents a Multilevel Monte Carlo strategy that significantly reduces the cost of Bayesian computation with diffusion models. This is achieved by exploiting cost-accuracy trade-offs inherent to diffusion models to carefully couple models of different levels of accuracy in a manner that significantly reduces the overall cost of the calculation, without reducing the final accuracy. The proposed approach achieves a [Formula: see text]-to-[Formula: see text] reduction in computational cost with respect to standard techniques across three benchmark imaging problems.This article is part of the theme issue 'Generative modelling meets Bayesian inference: a new paradigm for inverse problems'.

Authors

Institutions

Publication Details

Journal
Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences
Published
2025-06-19
DOI
https://doi.org/10.1098/rsta.2024.0333
Primary Topic
Gaussian Processes and Bayesian Inference
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Bayesian computation with generative diffusion models by Multilevel Monte Carlo

Abdul-Lateef Haji-Ali, Konstantinos C. Zygalakis, Luke Shaw, Marcelo Pereyra
Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences
Gaussian Processes and Bayesian Inference
article

Bayesian computation with generative diffusion models by Multilevel Monte Carlo

Abdul-Lateef Haji-Ali, Konstantinos C. Zygalakis, Luke Shaw, Marcelo Pereyra
article en

Abstract

Generative diffusion models have recently emerged as a powerful strategy to perform stochastic sampling in Bayesian inverse problems, delivering remarkably accurate solutions for a wide range of challenging applications. However, diffusion models often require a large number of neural function evaluations per sample in order to deliver accurate posterior samples. As a result, using diffusion models as stochastic samplers for Monte Carlo integration in Bayesian computation can be highly computationally expensive, particularly in applications that require a substantial number of Monte Carlo samples for conducting uncertainty quantification analyses. This cost is especially high in large-scale inverse problems such as computational imaging, which rely on large neural networks that are expensive to evaluate. With quantitative imaging applications in mind, this paper presents a Multilevel Monte Carlo strategy that significantly reduces the cost of Bayesian computation with diffusion models. This is achieved by exploiting cost-accuracy trade-offs inherent to diffusion models to carefully couple models of different levels of accuracy in a manner that significantly reduces the overall cost of the calculation, without reducing the final accuracy. The proposed approach achieves a [Formula: see text]-to-[Formula: see text] reduction in computational cost with respect to standard techniques across three benchmark imaging problems.This article is part of the theme issue 'Generative modelling meets Bayesian inference: a new paradigm for inverse problems'.

Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering SciencesVol. 383(2299)
Universitat Jaume I (ES), Heriot-Watt University (GB), University of Edinburgh (GB)
Ministerio de Ciencia e Innovación, Engineering and Physical Sciences Research Council
Openalex Percentile: Top 93%
Gaussian Processes and Bayesian Inference
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.