Energetic Variational Neural Network Discretizations of Gradient Flows

.We present a structure-preserving Eulerian algorithm for solving \(L^2\)-gradient flows and a structure-preserving Lagrangian algorithm for solving generalized diffusions. Both algorithms employ neural networks as tools for spatial discretization. Unlike most existing methods that construct numerical discretizations based on the strong or weak form of the underlying PDE, the proposed schemes are constructed based on the energy-dissipation law directly. This guarantees the monotonic decay of the system's free energy, which avoids unphysical states of solutions and is crucial for the long-term stability of numerical computations. To address challenges arising from nonlinear neural network discretization, we perform temporal discretizations on these variational systems before spatial discretizations. This approach is computationally memory-efficient when implementing neural network-based algorithms. The proposed neural network-based schemes are mesh-free, allowing us to solve gradient flows in high dimensions. Various numerical experiments are presented to demonstrate the accuracy and energy stability of the proposed numerical schemes.Keywordsstructure-preservinggradient flowsneural networksenergy stabilityLagrangian schemesMSC codes35K3535K5549J4065M0665M12

Authors

Institutions

Publication Details

Journal
SIAM Journal on Scientific Computing
Published
2024-08-05
DOI
https://doi.org/10.1137/22m1529427
Citations
7
Primary Topic
Model Reduction and Neural Networks
Type
article
Field-Weighted Citation Impact
1.97

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Energetic Variational Neural Network Discretizations of Gradient Flows

Zhiliang Xu, Chun Liu, Ziqing Hu, Yiwei Wang
7 citations
SIAM Journal on Scientific Computing
Model Reduction and Neural Networks
1.97
article

Energetic Variational Neural Network Discretizations of Gradient Flows

Zhiliang Xu, Chun Liu, Ziqing Hu, Yiwei Wang
article en
7 citations

Abstract

.We present a structure-preserving Eulerian algorithm for solving \(L^2\)-gradient flows and a structure-preserving Lagrangian algorithm for solving generalized diffusions. Both algorithms employ neural networks as tools for spatial discretization. Unlike most existing methods that construct numerical discretizations based on the strong or weak form of the underlying PDE, the proposed schemes are constructed based on the energy-dissipation law directly. This guarantees the monotonic decay of the system's free energy, which avoids unphysical states of solutions and is crucial for the long-term stability of numerical computations. To address challenges arising from nonlinear neural network discretization, we perform temporal discretizations on these variational systems before spatial discretizations. This approach is computationally memory-efficient when implementing neural network-based algorithms. The proposed neural network-based schemes are mesh-free, allowing us to solve gradient flows in high dimensions. Various numerical experiments are presented to demonstrate the accuracy and energy stability of the proposed numerical schemes.Keywordsstructure-preservinggradient flowsneural networksenergy stabilityLagrangian schemesMSC codes35K3535K5549J4065M0665M12

SIAM Journal on Scientific ComputingVol. 46(4)
University of Notre Dame (US), Illinois Institute of Technology (US)
National Science Foundation
Openalex Percentile: Top 14%
Model Reduction and Neural Networks
1.97
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.