How Much Physics Should a Neural Network Know? Thermodynamics‐Informed Neural Networks for Rock Constitutive Modeling With Epistemic Uncertainty

Abstract Machine learning offers a flexible route to constitutive modeling, with two emergent questions for geoscience applications: what level of thermodynamic constraint should be embedded in the network architecture, and how should predictive uncertainty be quantified when extrapolating from laboratory to field conditions? We address both challenges by presenting two complementary frameworks, NICE‐M (Neural Integration for Constitutive Equations, Modified) and Thermodynamics of Irreversible Processes Informed Neural Network (TIP‐INN), that learn the scalar thermodynamic potentials of Generalized Standard Materials via convex neural networks coupled with a Neural Ordinary Differential Equation integrator. NICE‐M enforces soft thermodynamic admissibility by learning the Helmholtz free energy alone. TIP‐INN enforces hard consistency by learning both the free energy and the dual dissipation potential, guaranteeing non‐negative dissipation by construction. We systematically evaluate these architectures on analytical viscoelastic and elastoplastic models, as well as complex experimental rock deformation data sets. While both frameworks produce highly accurate stress predictions, TIP‐INN recovers more accurate underlying thermodynamic potentials and material properties, particularly for out‐of‐distribution extrapolations. To systematically quantify epistemic uncertainty, we augment both architectures with an Epistemic Neural Network (Epinet) that provides calibrated uncertainty estimates without the cost of full Bayesian inference, flagging predictions outside the training distribution. This integrated framework provides a path toward deploying learned constitutive models in geophysical simulations where reliability under extrapolation is essential.

Authors

Institutions

Publication Details

Journal
Journal of Geophysical Research Machine Learning and Computation
Published
2026-09-18
DOI
https://doi.org/10.1029/2026jh001463
Primary Topic
Model Reduction and Neural Networks
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

How Much Physics Should a Neural Network Know? Thermodynamics‐Informed Neural Networks for Rock Constitutive Modeling With Epistemic Uncertainty

B. K. Holtzman, Tushar Mittal, Seth Saltiel, Kangan Li
Journal of Geophysical Research Machine Learning and Computation
Model Reduction and Neural Networks
article

How Much Physics Should a Neural Network Know? Thermodynamics‐Informed Neural Networks for Rock Constitutive Modeling With Epistemic Uncertainty

B. K. Holtzman, Tushar Mittal, Seth Saltiel, Kangan Li
article en

Abstract

Abstract Machine learning offers a flexible route to constitutive modeling, with two emergent questions for geoscience applications: what level of thermodynamic constraint should be embedded in the network architecture, and how should predictive uncertainty be quantified when extrapolating from laboratory to field conditions? We address both challenges by presenting two complementary frameworks, NICE‐M (Neural Integration for Constitutive Equations, Modified) and Thermodynamics of Irreversible Processes Informed Neural Network (TIP‐INN), that learn the scalar thermodynamic potentials of Generalized Standard Materials via convex neural networks coupled with a Neural Ordinary Differential Equation integrator. NICE‐M enforces soft thermodynamic admissibility by learning the Helmholtz free energy alone. TIP‐INN enforces hard consistency by learning both the free energy and the dual dissipation potential, guaranteeing non‐negative dissipation by construction. We systematically evaluate these architectures on analytical viscoelastic and elastoplastic models, as well as complex experimental rock deformation data sets. While both frameworks produce highly accurate stress predictions, TIP‐INN recovers more accurate underlying thermodynamic potentials and material properties, particularly for out‐of‐distribution extrapolations. To systematically quantify epistemic uncertainty, we augment both architectures with an Epistemic Neural Network (Epinet) that provides calibrated uncertainty estimates without the cost of full Bayesian inference, flagging predictions outside the training distribution. This integrated framework provides a path toward deploying learned constitutive models in geophysical simulations where reliability under extrapolation is essential.

Journal of Geophysical Research Machine Learning and ComputationVol. 3(5)
Pennsylvania State University (US), Lamont-Doherty Earth Observatory (US), Cornell University (US), Columbia University (US)
U.S. Department of Energy, Office of Science, Basic Energy Sciences
Openalex Percentile: Top 10%
Model Reduction and Neural Networks
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.