Fast Linear Solvers via AI-Tuned Markov Chain Monte Carlo-based Matrix Inversion
Large, sparse linear systems are pervasive in modern science and engineering, and Krylov subspace solvers are an established means of solving them. Yet convergence can be slow for ill-conditioned matrices, so practical deployments usually require preconditioners. Markov chain Monte Carlo (MCMC)-based matrix inversion can generate such preconditioners and accelerate Krylov iterations, but its effectiveness depends on parameters whose optima vary across matrices; manual or grid search is costly. We present an AI-driven framework recommending MCMC parameters for a given linear system. A graph neural surrogate predicts preconditioning speed from A and MCMC parameters. A Bayesian acquisition function then chooses the parameter sets most likely to minimise iterations. On a previously unseen ill-conditioned system, the framework achieves better preconditioning with 50% of the search budget of conventional methods, yielding about a 10% reduction in iterations to convergence. These results suggest a route for incorporating MCMC-based preconditioners into large-scale systems.
Authors
- Tomasz Nowicki (ORCID: https://orcid.org/0000-0002-8260-0231)
- Vassil Alexandrov (ORCID: https://orcid.org/0000-0002-4889-1207)
- Olha Ivanyshyn (ORCID: https://orcid.org/0000-0002-1727-9461)
- Vassilis Kalantzis (ORCID: https://orcid.org/0000-0002-4614-6422)
- Yingdong Lu (ORCID: https://orcid.org/0000-0002-3672-0865)
- Lior Horesh (ORCID: https://orcid.org/0000-0001-6350-0238)
- Shashanka Ubaru (ORCID: https://orcid.org/0000-0001-6942-7158)
- Won Kyung Lee (ORCID: https://orcid.org/0000-0003-3465-6094)
- Soumyadip Ghosh (ORCID: https://orcid.org/0009-0005-1642-1891)
- A. Lebedev (ORCID: https://orcid.org/0009-0008-4946-2974)
Institutions
- IBM Research - Thomas J. Watson Research Center (US)
Publication Details
- Published
- 2025-11-07
- DOI
- https://doi.org/10.1145/3731599.3767543
- Citations
- 1
- Primary Topic
- Tensor decomposition and applications
- Type
- article
- Field-Weighted Citation Impact
- 1.53