Contraction rate estimates of stochastic gradient kinetic Langevin integrators
In previous work, we introduced a method for determining convergence rates for integration methods for the kinetic Langevin equation for M-▽Lipschitz m-log-concave densities [Leimkuhler et al., SIAM J. Numer. Anal. 62 (2024) 1226–1258]. In this article, we exploit this method to treat several additional schemes including the method of Brunger, Brooks and Karplus (BBK) and stochastic position/velocity Verlet. We introduce a randomized midpoint scheme for kinetic Langevin dynamics, inspired by the recent scheme of Bou-Rabee and Marsden [arXiv:2211.11003, 2022]. We also extend our approach to stochastic gradient variants of these schemes under minimal extra assumptions. We provide convergence rates of O(m/M), with explicit stepsize restriction, which are of the same order as the stability thresholds for Gaussian targets and are valid for a large interval of the friction parameter. We compare the contraction rate estimates of many kinetic Langevin integrators from molecular dynamics and machine learning. Finally, we present numerical experiments for a Bayesian logistic regression example.
Publication Details
- Journal
- Springer Link (Chiba Institute of Technology)
- Published
- 2024-12-04
- DOI
- https://doi.org/10.1051/m2an/2024038/pdf
- Primary Topic
- Markov Chains and Monte Carlo Methods
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Engineering and Physical Sciences Research Council