Exploring the latent space of Physically Recurrent Neural Networks in the low data regime

Surrogate models that combine conventional machine learning with physical constraints have gained traction in recent years.While these models are linked to better explainability and generalization properties than purely data-driven models, they often lack versatility for multiscale applications, particularly FE, where computational costs are extreme.In FE, the macroscopic constitutive behavior is associated to the homogenized response of a Representative Volume Element (RVE) at a lower scale.This eliminates the need for explicit constitutive laws at the macroscale, but solving a nested finite element problem at each integration point remains a major computational bottleneck.To address this issue, we introduced the Physically Recurrent Neural Network (PRNN) [1], a hybrid surrogate model that embeds constitutive models within an encoder-decoder architecture to predict the homogenized response of heterogeneous materials with time and path dependence.This approach yields excellent generalization properties with minimal training data across various applications involving several constitutive model combinations in small and finite strain regimes [1][2][3].Here, we shift our focus to understanding and illustrating how modifications in the decoder can shape the relation between our latent space and micromodel quantities without explicit training.These changes are also evaluated in terms of accuracy, with particular emphasis on the performance in the low-data regime.

Authors

Institutions

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.23967/data-driven.2025.018
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Exploring the latent space of Physically Recurrent Neural Networks in the low data regime

M. A. G. Maia, F.D. van der Meer, Ivandro José de Freitas Rocha, A. van Gils
Neural Networks and Applications
article

Exploring the latent space of Physically Recurrent Neural Networks in the low data regime

M. A. G. Maia, F.D. van der Meer, Ivandro José de Freitas Rocha, A. van Gils
article en

Abstract

Surrogate models that combine conventional machine learning with physical constraints have gained traction in recent years.While these models are linked to better explainability and generalization properties than purely data-driven models, they often lack versatility for multiscale applications, particularly FE, where computational costs are extreme.In FE, the macroscopic constitutive behavior is associated to the homogenized response of a Representative Volume Element (RVE) at a lower scale.This eliminates the need for explicit constitutive laws at the macroscale, but solving a nested finite element problem at each integration point remains a major computational bottleneck.To address this issue, we introduced the Physically Recurrent Neural Network (PRNN) [1], a hybrid surrogate model that embeds constitutive models within an encoder-decoder architecture to predict the homogenized response of heterogeneous materials with time and path dependence.This approach yields excellent generalization properties with minimal training data across various applications involving several constitutive model combinations in small and finite strain regimes [1][2][3].Here, we shift our focus to understanding and illustrating how modifications in the decoder can shape the relation between our latent space and micromodel quantities without explicit training.These changes are also evaluated in terms of accuracy, with particular emphasis on the performance in the low-data regime.

Delft University of Technology (NL)
Openalex Percentile: Top 90%
Neural Networks and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Exploring the latent space of Physically Recurrent Neural Networks in the low data regime — M. A. G. Maia, F.D. van der Meer, et al. · (2025) | TGRS Research Map | TGRS