AsPINN: Adaptive symmetry-recomposition physics-informed neural networks

Physics-informed neural networks (PINNs) have shown promise for solving partial differential equations (PDEs). However, PINNs’ loss, the regularization terms, can only guarantee that the prediction results conform to the physical constraints in the average sense, which results in PINNs’ inability to strictly adhere to implied physical laws such as conservation laws and symmetries. This limits the optimization speed and accuracy of PINNs. Although some feature-enhanced PINNs attempt to address this issue by adding explicit constraints, their generality is limited due to specific question settings. To overcome this limitation, our study proposes the adaptive symmetry-recomposition PINN (AsPINN). By analyzing the parameter-sharing patterns of fully connected PINNs, specific network structures are developed to provide predictions with strict symmetry constraints. These structures are incorporated into diverse subnetworks to provide constrained intermediate outputs, then a specialized multi-head attention mechanism is attached to evaluate and composite them into final predictions adaptively. Thus, AsPINN maintains precise constraints while addressing the inability of individual structural subnetworks’ generality. This method is then applied to address several physically significant PDEs, including both forward and inverse problems . The numerical results demonstrates AsPINN’s mathematical consistency and generality, offering advantages in terms of optimization speed and accuracy with a reduced number of trainable parameters. The results also manifest that AsPINN mitigates the impact of ill-conditioned data.

Authors

Institutions

Publication Details

Journal
Computer Methods in Applied Mechanics and Engineering
Published
2024-09-27
DOI
https://doi.org/10.1016/j.cma.2024.117405
Citations
4
Primary Topic
Model Reduction and Neural Networks
Type
article
Field-Weighted Citation Impact
1.12

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AsPINN: Adaptive symmetry-recomposition physics-informed neural networks

Xunshi Yan, Yang Liu, Ziti Liu, Liu Wen et al.
4 citations
Computer Methods in Applied Mechanics and Engineering
Model Reduction and Neural Networks
1.12
article

AsPINN: Adaptive symmetry-recomposition physics-informed neural networks

Xunshi Yan, Yang Liu, Ziti Liu, Liu Wen, Shuaiqi Guo, Chen-An Zhang
article en
4 citations

Abstract

Physics-informed neural networks (PINNs) have shown promise for solving partial differential equations (PDEs). However, PINNs’ loss, the regularization terms, can only guarantee that the prediction results conform to the physical constraints in the average sense, which results in PINNs’ inability to strictly adhere to implied physical laws such as conservation laws and symmetries. This limits the optimization speed and accuracy of PINNs. Although some feature-enhanced PINNs attempt to address this issue by adding explicit constraints, their generality is limited due to specific question settings. To overcome this limitation, our study proposes the adaptive symmetry-recomposition PINN (AsPINN). By analyzing the parameter-sharing patterns of fully connected PINNs, specific network structures are developed to provide predictions with strict symmetry constraints. These structures are incorporated into diverse subnetworks to provide constrained intermediate outputs, then a specialized multi-head attention mechanism is attached to evaluate and composite them into final predictions adaptively. Thus, AsPINN maintains precise constraints while addressing the inability of individual structural subnetworks’ generality. This method is then applied to address several physically significant PDEs, including both forward and inverse problems . The numerical results demonstrates AsPINN’s mathematical consistency and generality, offering advantages in terms of optimization speed and accuracy with a reduced number of trainable parameters. The results also manifest that AsPINN mitigates the impact of ill-conditioned data.

Computer Methods in Applied Mechanics and EngineeringVol. 432
Chinese Academy of Sciences (CN), Institute of Mechanics (CN), University of Chinese Academy of Sciences (CN), Tsinghua University (CN)
Chinese Academy of Sciences, Youth Innovation Promotion Association of the Chinese Academy of Sciences
Openalex Percentile: Top 23%
Model Reduction and Neural Networks
1.12
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.