Slim multi-scale convolutional autoencoder-based reduced-order models for interpretable features of a complex dynamical system

In recent years, data-driven deep learning models have gained significant importance in the analysis of turbulent dynamical systems. Within the context of reduced-order models, convolutional autoencoders (CAEs) pose a universally applicable alternative to conventional approaches. They can learn nonlinear transformations directly from data, without prior knowledge of the system. However, the features generated by such models lack interpretability. Thus, the resulting model is a black-box that effectively reduces the complexity of the system but does not provide insights into the meaning of the latent features. To address this critical issue, we introduce a novel interpretable CAE approach for high-dimensional fluid flow data that maintains the reconstruction quality of conventional CAEs and allows for feature interpretation. Our method can be easily integrated into any existing CAE architecture with minor modifications of the training process. We compare our approach to Proper Orthogonal Decomposition (POD) and two existing methods for interpretable CAEs. We apply all methods to three different experimental turbulent Rayleigh–Bénard convection datasets with varying complexity. Our results show that the proposed method is lightweight, easy to train, and achieves relative reconstruction performance improvements of up to 6.4% over POD for 64 modes. The relative improvement increases to up to 229.8% as the number of modes decreases. In addition, our method delivers interpretable features similar to those of POD and is significantly less resource-intensive than existing CAE approaches, using less than 2% of the parameters. These approaches either trade interpretability for reconstruction performance or only provide interpretability to a limited extent.

Authors

Institutions

Publication Details

Journal
APL Machine Learning
Published
2025-02-26
DOI
https://doi.org/10.1063/5.0244416
Citations
1
Primary Topic
Model Reduction and Neural Networks
Type
article
Field-Weighted Citation Impact
1.32

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Slim multi-scale convolutional autoencoder-based reduced-order models for interpretable features of a complex dynamical system

Jörg Schumacher, Mohammad Sharifi Ghazijahani, Philipp Pfeffer, Patrick Mäder et al.
1 citations
APL Machine Learning
Model Reduction and Neural Networks
1.32
article

Slim multi-scale convolutional autoencoder-based reduced-order models for interpretable features of a complex dynamical system

Jörg Schumacher, Mohammad Sharifi Ghazijahani, Philipp Pfeffer, Patrick Mäder, Christian Cierpka, Philipp Teutsch
article en
1 citations

Abstract

In recent years, data-driven deep learning models have gained significant importance in the analysis of turbulent dynamical systems. Within the context of reduced-order models, convolutional autoencoders (CAEs) pose a universally applicable alternative to conventional approaches. They can learn nonlinear transformations directly from data, without prior knowledge of the system. However, the features generated by such models lack interpretability. Thus, the resulting model is a black-box that effectively reduces the complexity of the system but does not provide insights into the meaning of the latent features. To address this critical issue, we introduce a novel interpretable CAE approach for high-dimensional fluid flow data that maintains the reconstruction quality of conventional CAEs and allows for feature interpretation. Our method can be easily integrated into any existing CAE architecture with minor modifications of the training process. We compare our approach to Proper Orthogonal Decomposition (POD) and two existing methods for interpretable CAEs. We apply all methods to three different experimental turbulent Rayleigh–Bénard convection datasets with varying complexity. Our results show that the proposed method is lightweight, easy to train, and achieves relative reconstruction performance improvements of up to 6.4% over POD for 64 modes. The relative improvement increases to up to 229.8% as the number of modes decreases. In addition, our method delivers interpretable features similar to those of POD and is significantly less resource-intensive than existing CAE approaches, using less than 2% of the parameters. These approaches either trade interpretability for reconstruction performance or only provide interpretability to a limited extent.

APL Machine LearningVol. 3(1)
Technische Universität Ilmenau (DE), New York University (US), Friedrich Schiller University Jena (DE)
Carl-Zeiss-Stiftung, Technische Universität Ilmenau, Bundesministerium für Umwelt, Naturschutz, nukleare Sicherheit und Verbraucherschutz
Openalex Percentile: Top 22%
Model Reduction and Neural Networks
1.32
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.