Contraction rate estimates of stochastic gradient kinetic Langevin integrators

In previous work, we introduced a method for determining convergence rates for integration methods for the kinetic Langevin equation for M-▽Lipschitz m-log-concave densities [Leimkuhler et al., SIAM J. Numer. Anal. 62 (2024) 1226–1258]. In this article, we exploit this method to treat several additional schemes including the method of Brunger, Brooks and Karplus (BBK) and stochastic position/velocity Verlet. We introduce a randomized midpoint scheme for kinetic Langevin dynamics, inspired by the recent scheme of Bou-Rabee and Marsden [arXiv:2211.11003, 2022]. We also extend our approach to stochastic gradient variants of these schemes under minimal extra assumptions. We provide convergence rates of O(m/M), with explicit stepsize restriction, which are of the same order as the stability thresholds for Gaussian targets and are valid for a large interval of the friction parameter. We compare the contraction rate estimates of many kinetic Langevin integrators from molecular dynamics and machine learning. Finally, we present numerical experiments for a Bayesian logistic regression example.

Publication Details

Journal
Springer Link (Chiba Institute of Technology)
Published
2024-12-04
DOI
https://doi.org/10.1051/m2an/2024038/pdf
Primary Topic
Markov Chains and Monte Carlo Methods
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Contraction rate estimates of stochastic gradient kinetic Langevin integrators

Springer Link (Chiba Institute of Technology)
Markov Chains and Monte Carlo Methods
article

Contraction rate estimates of stochastic gradient kinetic Langevin integrators

article en

Abstract

In previous work, we introduced a method for determining convergence rates for integration methods for the kinetic Langevin equation for M-▽Lipschitz m-log-concave densities [Leimkuhler et al., SIAM J. Numer. Anal. 62 (2024) 1226–1258]. In this article, we exploit this method to treat several additional schemes including the method of Brunger, Brooks and Karplus (BBK) and stochastic position/velocity Verlet. We introduce a randomized midpoint scheme for kinetic Langevin dynamics, inspired by the recent scheme of Bou-Rabee and Marsden [arXiv:2211.11003, 2022]. We also extend our approach to stochastic gradient variants of these schemes under minimal extra assumptions. We provide convergence rates of O(m/M), with explicit stepsize restriction, which are of the same order as the stability thresholds for Gaussian targets and are valid for a large interval of the friction parameter. We compare the contraction rate estimates of many kinetic Langevin integrators from molecular dynamics and machine learning. Finally, we present numerical experiments for a Bayesian logistic regression example.

Springer Link (Chiba Institute of Technology)
Engineering and Physical Sciences Research Council
Openalex Percentile: Top 71%
Markov Chains and Monte Carlo Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.