FMint-SDE: A Multimodal Foundation Model for Accelerating Numerical Simulation of SDEs via Error Correction

Abstract. Fast and accurate simulation of dynamical systems is a fundamental challenge across scientific and engineering domains. Traditional numerical integrators often face a trade-off between accuracy and computational efficiency, while existing neural network–based approaches typically require training a separate model for each case. To overcome these limitations, we introduce a novel multimodal foundation model for large-scale simulations of differential equations: FMint-SDE (Foundation Model based on Initialization for stochastic differential equations). Based on a decoder-only transformer with in-context learning, FMint-SDE leverages numerical and textual modalities to learn a universal error-correction scheme. It is trained using prompted sequences of coarse solutions generated by conventional solvers, enabling broad generalization across diverse systems. We evaluate our models on a suite of challenging SDE benchmarks spanning applications in molecular dynamics, mechanical systems, finance, and biology. Experimental results show that our approach achieves a superior accuracy-efficiency tradeoff compared to classical solvers, underscoring the potential of FMint-SDE as a general-purpose simulation tool for dynamical systems. Reproducibility of computational results. This paper has been awarded the “SIAM Reproducibility Badge: Code and Data Available” as a recognition that the authors have followed reproducibility principles valued by SISC and the scientific computing community. Code and data that allow readers to reproduce the results in this paper are available at https://github.com/margotyjx/FMint-SDE and in the supplementary materials ( M181717_Supplementary_Materials_1.pdf [7.87MB], FMint-SDE-main.zip [206KB]), linked from the main article webpage. [Formula: see text]

Authors

Institutions

Publication Details

Journal
SIAM Journal on Scientific Computing
Published
2026-11-16
DOI
https://doi.org/10.1137/25m1817170
Primary Topic
Numerical Solvers for Ordinary Differential Equations
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

FMint-SDE: A Multimodal Foundation Model for Accelerating Numerical Simulation of SDEs via Error Correction

Jiaxin Yuan, Maria Cameron, Haizhao Yang
2 links
SIAM Journal on Scientific Computing
Numerical Solvers for Ordinary Differential Equations
article

FMint-SDE: A Multimodal Foundation Model for Accelerating Numerical Simulation of SDEs via Error Correction

Jiaxin Yuan, Maria Cameron, Haizhao Yang
article en

Abstract

Abstract. Fast and accurate simulation of dynamical systems is a fundamental challenge across scientific and engineering domains. Traditional numerical integrators often face a trade-off between accuracy and computational efficiency, while existing neural network–based approaches typically require training a separate model for each case. To overcome these limitations, we introduce a novel multimodal foundation model for large-scale simulations of differential equations: FMint-SDE (Foundation Model based on Initialization for stochastic differential equations). Based on a decoder-only transformer with in-context learning, FMint-SDE leverages numerical and textual modalities to learn a universal error-correction scheme. It is trained using prompted sequences of coarse solutions generated by conventional solvers, enabling broad generalization across diverse systems. We evaluate our models on a suite of challenging SDE benchmarks spanning applications in molecular dynamics, mechanical systems, finance, and biology. Experimental results show that our approach achieves a superior accuracy-efficiency tradeoff compared to classical solvers, underscoring the potential of FMint-SDE as a general-purpose simulation tool for dynamical systems. Reproducibility of computational results. This paper has been awarded the “SIAM Reproducibility Badge: Code and Data Available” as a recognition that the authors have followed reproducibility principles valued by SISC and the scientific computing community. Code and data that allow readers to reproduce the results in this paper are available at https://github.com/margotyjx/FMint-SDE and in the supplementary materials ( M181717_Supplementary_Materials_1.pdf [7.87MB], FMint-SDE-main.zip [206KB]), linked from the main article webpage. [Formula: see text]

SIAM Journal on Scientific ComputingVol. 48(6)
University of Maryland, College Park (US)
National Science Foundation, U.S. Department of Energy, Defense Advanced Research Projects Agency, Multidisciplinary University Research Initiative, Office of Naval Research, Advanced Scientific Computing Research, Air Force Office of Scientific Research
Numerical Solvers for Ordinary Differential Equations
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon