Impact of collocation point sampling techniques on PINN performance in groundwater flow predictions

Physics-Informed Neural Networks (PINNs) represent a promising methodology for addressing partial differential equations in scientific computing. This study examines optimization strategies for PINNs in groundwater flow modeling, concentrating on two main aspects: the distribution of collocation points and training strategies. By examining both point spatial distribution and dynamic resampling approaches, we show how collocation points arrangements can improve solution accuracy, particularly for problems with localized features such as source/sink terms represented by Dirac delta functions. We introduce and analyze the Chebyshev-exponential (ChebEx) distribution for collocation points, as well as non-adaptive resampling strategies used during training. In an explainable AI (XAI) setting our findings show that a ChebEx distribution of points improves accuracy over uniform sampling, especially near source terms. We also demonstrate that periodic resampling of collocation points improves training stability. These findings contribute to a better understanding of PINNs optimization and help to broaden our understanding of how spatial point selection influences PINN training dynamics and solution quality, but more research is needed for heterogeneous media and complex boundary conditions. While our implementation focuses on one-dimensional groundwater flow with homogeneous boundary conditions, the methodologies presented here could be applied to a variety of physical systems governed by partial differential equations (PDEs), including heat transfer, fluid dynamics, and electromagnetic fields. • Point selection strategies are effective at capturing complex groundwater features. • Significant accuracy gains were demonstrated through improved point distributions. • Efficacy of new neural network training strategies. • How Resampling training techniques affect neural network performance in PINN.

Authors

Institutions

Publication Details

Journal
Journal of Computational Mathematics and Data Science
Published
2024-12-07
DOI
https://doi.org/10.1016/j.jcmds.2024.100107
Citations
5
Primary Topic
Groundwater flow and contamination studies
Type
article
Field-Weighted Citation Impact
1.03

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Impact of collocation point sampling techniques on PINN performance in groundwater flow predictions

Salvatore Cuomo, Vincenzo Schiano Di Cola, Vittorio Bauduin
5 citations
Journal of Computational Mathematics and Data Science
Groundwater flow and contamination studies
1.03
article

Impact of collocation point sampling techniques on PINN performance in groundwater flow predictions

Salvatore Cuomo, Vincenzo Schiano Di Cola, Vittorio Bauduin
article en
5 citations

Abstract

Physics-Informed Neural Networks (PINNs) represent a promising methodology for addressing partial differential equations in scientific computing. This study examines optimization strategies for PINNs in groundwater flow modeling, concentrating on two main aspects: the distribution of collocation points and training strategies. By examining both point spatial distribution and dynamic resampling approaches, we show how collocation points arrangements can improve solution accuracy, particularly for problems with localized features such as source/sink terms represented by Dirac delta functions. We introduce and analyze the Chebyshev-exponential (ChebEx) distribution for collocation points, as well as non-adaptive resampling strategies used during training. In an explainable AI (XAI) setting our findings show that a ChebEx distribution of points improves accuracy over uniform sampling, especially near source terms. We also demonstrate that periodic resampling of collocation points improves training stability. These findings contribute to a better understanding of PINNs optimization and help to broaden our understanding of how spatial point selection influences PINN training dynamics and solution quality, but more research is needed for heterogeneous media and complex boundary conditions. While our implementation focuses on one-dimensional groundwater flow with homogeneous boundary conditions, the methodologies presented here could be applied to a variety of physical systems governed by partial differential equations (PDEs), including heat transfer, fluid dynamics, and electromagnetic fields. • Point selection strategies are effective at capturing complex groundwater features. • Significant accuracy gains were demonstrated through improved point distributions. • Efficacy of new neural network training strategies. • How Resampling training techniques affect neural network performance in PINN.

Journal of Computational Mathematics and Data ScienceVol. 14
Fondazione Roma (IT), University of Naples Federico II (IT)
Università degli Studi di Napoli Federico II, Consiglio Nazionale delle Ricerche, Università degli Studi della Campania Luigi Vanvitelli
Clean water and sanitation
Openalex Percentile: Top 26%
Groundwater flow and contamination studies
1.03
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.