BAYESIAN3 ACTIVE LEARNING FOR REGULARIZED ARBITRARY MULTIELEMENT POLYNOMIAL CHAOS USING INFORMATION THEORY

Machine learning, surrogate modeling, and uncertainty quantification pose challenges in data-poor applications that arise due to limited availability of measurement data or with computationally expensive models. Specialized models, derived from Gaussian process emulators (GPEs) or polynomial chaos expansions (PCEs), are often used when only limited numbers of training points are available. The PCE (or its data-driven version, the arbitrary polynomial chaos) is based on a global representation informed by the distributions of model parameters, whereas GPEs rely on a local kernel and additionally assess the uncertainty of the surrogate itself. Oscillation-mitigating localizations of the PCE result in increased degrees of freedom (DoF), requiring more training samples. As applications such as Bayesian inference (BI) require highly accurate surrogates, even specialized models like PCE or GPE require a substantial amount of training data. Bayesian<sup>3</sup> active learning (B<sup>3</sup>AL) on GPEs, based on information theory (IT), can reduce the necessary number of training samples for BI. IT-based ideas for B<sup>3</sup>AL are not yet directly transferable to the PCE family, as this family lacks awareness of surrogate uncertainty by design. In the present work, we introduce a Bayesian regularized version of localized arbitrary polynomial chaos to build surrogate models. Equipped with Gaussian emulator properties, our fully adaptive framework is enhanced with B<sup>3</sup> AL methods designed to achieve reliable surrogate models for BI while efficiently selecting training samples via IT. The effectiveness of the proposed methodology is demonstrated by comprehensive evaluations on several numerical examples.

Authors

Institutions

Publication Details

Journal
International Journal for Uncertainty Quantification
Published
2024-09-10
DOI
https://doi.org/10.1615/int.j.uncertaintyquantification.2024052675
Primary Topic
Fault Detection and Control Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

BAYESIAN3 ACTIVE LEARNING FOR REGULARIZED ARBITRARY MULTIELEMENT POLYNOMIAL CHAOS USING INFORMATION THEORY

Maria Fernanda Morales Oreamuno, Sergey Oladyshkin, Ilja Kröker, Rebecca Kohlhaas et al.
International Journal for Uncertainty Quantification
Fault Detection and Control Systems
article

BAYESIAN3 ACTIVE LEARNING FOR REGULARIZED ARBITRARY MULTIELEMENT POLYNOMIAL CHAOS USING INFORMATION THEORY

Maria Fernanda Morales Oreamuno, Sergey Oladyshkin, Ilja Kröker, Rebecca Kohlhaas, Wolfgang Nowak, Nils Wildt, Tim Brünnette
article en

Abstract

Machine learning, surrogate modeling, and uncertainty quantification pose challenges in data-poor applications that arise due to limited availability of measurement data or with computationally expensive models. Specialized models, derived from Gaussian process emulators (GPEs) or polynomial chaos expansions (PCEs), are often used when only limited numbers of training points are available. The PCE (or its data-driven version, the arbitrary polynomial chaos) is based on a global representation informed by the distributions of model parameters, whereas GPEs rely on a local kernel and additionally assess the uncertainty of the surrogate itself. Oscillation-mitigating localizations of the PCE result in increased degrees of freedom (DoF), requiring more training samples. As applications such as Bayesian inference (BI) require highly accurate surrogates, even specialized models like PCE or GPE require a substantial amount of training data. Bayesian<sup>3</sup> active learning (B<sup>3</sup>AL) on GPEs, based on information theory (IT), can reduce the necessary number of training samples for BI. IT-based ideas for B<sup>3</sup>AL are not yet directly transferable to the PCE family, as this family lacks awareness of surrogate uncertainty by design. In the present work, we introduce a Bayesian regularized version of localized arbitrary polynomial chaos to build surrogate models. Equipped with Gaussian emulator properties, our fully adaptive framework is enhanced with B<sup>3</sup> AL methods designed to achieve reliable surrogate models for BI while efficiently selecting training samples via IT. The effectiveness of the proposed methodology is demonstrated by comprehensive evaluations on several numerical examples.

International Journal for Uncertainty QuantificationVol. 15(3)
University of Stuttgart (DE)
Reduced inequalities
Openalex Percentile: Top 84%
Fault Detection and Control Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.