Training stiff neural ordinary differential equations with implicit single-step methods

Stiff systems of ordinary differential equations (ODEs) are pervasive in many science and engineering fields, yet standard neural ODE approaches struggle to learn them. This limitation is the main barrier to the widespread adoption of neural ODEs. In this paper, we propose an approach based on single-step implicit schemes to enable neural ODEs to handle stiffness and demonstrate that our implicit neural ODE method can learn stiff dynamics. This work addresses a key limitation in current neural ODE methods, paving the way for their use in a wider range of scientific problems.

Authors

Institutions

Publication Details

Journal
Chaos An Interdisciplinary Journal of Nonlinear Science
Published
2024-12-01
DOI
https://doi.org/10.1063/5.0243382
Citations
6
Primary Topic
Model Reduction and Neural Networks
Type
article
Field-Weighted Citation Impact
1.69

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Training stiff neural ordinary differential equations with implicit single-step methods

Linda Petzold, Colby Fronk
6 citations
Chaos An Interdisciplinary Journal of Nonlinear Science
Model Reduction and Neural Networks
1.69
article

Training stiff neural ordinary differential equations with implicit single-step methods

Linda Petzold, Colby Fronk
article en
6 citations

Abstract

Stiff systems of ordinary differential equations (ODEs) are pervasive in many science and engineering fields, yet standard neural ODE approaches struggle to learn them. This limitation is the main barrier to the widespread adoption of neural ODEs. In this paper, we propose an approach based on single-step implicit schemes to enable neural ODEs to handle stiffness and demonstrate that our implicit neural ODE method can learn stiff dynamics. This work addresses a key limitation in current neural ODE methods, paving the way for their use in a wider range of scientific problems.

Chaos An Interdisciplinary Journal of Nonlinear ScienceVol. 34(12)
University of California, Santa Barbara (US)
National Science Foundation, China Scholarship Council, University of California, Santa Barbara, University of California, San Diego, Materials Research Science and Engineering Center, Harvard University, Office of the President, University of California, National Institute of Biomedical Imaging and Bioengineering, Division of Materials Research, California NanoSystems Institute
Openalex Percentile: Top 15%
Model Reduction and Neural Networks
1.69
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Training stiff neural ordinary differential equations with implicit single-step methods — Linda Petzold, Colby Fronk · Chaos An Interdisciplinary Journal of Nonlinear Science (2024) | TGRS Research Map | TGRS