From Numerical Schemes to Neural Network Architectures: A Physics-Informed Framework for Differential Equations

Physics-informed neural networks usually incorporate differential equations primarily through the loss function, while the neural architecture itself is selected independently of the underlying numerical structure. This work develops a scheme-induced approach in which an analytically modified numerical method defines the computational architecture, while selected elements of the numerical scheme are made trainable and refined using physics-informed loss functions. The specific contribution is the formulation and systematic investigation of a class of scheme-parameterized low-fidelity physics-informed neural networks (LF-PINNs) for evolutionary PDEs. In the implementation studied here, a compact parameter network directly controls the coefficient of a generalized θ-scheme, while the implicit update is represented by a fixed number of Picard iterations. The approach is evaluated on six one-dimensional PDE benchmark configurations against conventional, hard-constrained, and adaptively weighted PINNs. The nine-parameter LF-PINN achieves competitive accuracy on several benchmark problems, while its trainable parameter remains explicitly connected to a coefficient of the underlying numerical scheme. The results also show that performance is problem-dependent and that a small number of trainable parameters does not necessarily imply lower computational cost. Stability, ablation, computational-cost, and generalization analyses further characterize the properties and limitations of the scheme-induced construction.

Authors

Institutions

Publication Details

Journal
Machine Learning and Knowledge Extraction
Published
2026-10-13
DOI
https://doi.org/10.3390/make8100329
Primary Topic
Model Reduction and Neural Networks
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

From Numerical Schemes to Neural Network Architectures: A Physics-Informed Framework for Differential Equations

Dmitriy A. Tarkhov, Tatiana V. Lazovskaya, Galina F. Malykhina, I.A. Velikorechanin
Machine Learning and Knowledge Extraction
Model Reduction and Neural Networks
article

From Numerical Schemes to Neural Network Architectures: A Physics-Informed Framework for Differential Equations

Dmitriy A. Tarkhov, Tatiana V. Lazovskaya, Galina F. Malykhina, I.A. Velikorechanin
article en

Abstract

Physics-informed neural networks usually incorporate differential equations primarily through the loss function, while the neural architecture itself is selected independently of the underlying numerical structure. This work develops a scheme-induced approach in which an analytically modified numerical method defines the computational architecture, while selected elements of the numerical scheme are made trainable and refined using physics-informed loss functions. The specific contribution is the formulation and systematic investigation of a class of scheme-parameterized low-fidelity physics-informed neural networks (LF-PINNs) for evolutionary PDEs. In the implementation studied here, a compact parameter network directly controls the coefficient of a generalized θ-scheme, while the implicit update is represented by a fixed number of Picard iterations. The approach is evaluated on six one-dimensional PDE benchmark configurations against conventional, hard-constrained, and adaptively weighted PINNs. The nine-parameter LF-PINN achieves competitive accuracy on several benchmark problems, while its trainable parameter remains explicitly connected to a coefficient of the underlying numerical scheme. The results also show that performance is problem-dependent and that a small number of trainable parameters does not necessarily imply lower computational cost. Stability, ablation, computational-cost, and generalization analyses further characterize the properties and limitations of the scheme-induced construction.

Machine Learning and Knowledge ExtractionVol. 8(10)
Moscow Institute of Physics and Technology (RU), Peter the Great St. Petersburg Polytechnic University (RU)
Openalex Percentile: Top 13%
Model Reduction and Neural Networks
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.