Surrogate-Based Bayesian Calibration Methods for Chaotic Systems: A Comparison of Traditional and Nontraditional Approaches

Abstract. Parameter calibration is essential for reducing uncertainty and improving predictive fidelity in physics-based models, yet it is often limited by the high computational cost of model evaluations. Bayesian calibration methods provide a principled framework for combining prior information with data while rigorously quantifying uncertainty. In this work, we compare four emulator-based Bayesian calibration strategies—Calibrate–Emulate–Sample (CES), History Matching (HM), Bayesian Optimal Experimental Design (BOED), and a goal-oriented extension of BOED (GBOED)—using the Lorenz ’96 multiscale system and a two-layer quasi-geostrophic (QG) model as test cases. The proposed GBOED formulation explicitly targets information gain with respect to the calibration posterior, aligning design decisions with downstream inference. We assess methods using accuracy and uncertainty quantification metrics, convergence behavior under increasing computational budgets, and practical considerations such as implementation complexity and robustness. For the Lorenz ’96 system, CES, HM, and GBOED all yield strong calibration performance, even with limited numbers of model evaluations, while standard BOED generally underperforms in this setting. Differences among the strongest methods are modest, particularly as computational budgets increase. For the QG system, all methods produce reasonable posterior estimates, and convergence behavior is more consistent, reflecting smoother parameter–statistic relationships and improved identifiability. Overall, our results indicate that multiple emulator-based calibration strategies can perform comparably well when applied appropriately, with method selection often guided more by computational and practical considerations than by accuracy alone. These findings highlight both the limitations of standard BOED for calibration and the promise of goal-oriented and iterative approaches for efficient Bayesian inference in complex dynamical systems.

Authors

Institutions

Publication Details

Journal
SIAM/ASA Journal on Uncertainty Quantification
Published
2026-11-16
DOI
https://doi.org/10.1137/25m1783618
Citations
2
Primary Topic
Probabilistic and Robust Engineering Design
Type
article
Field-Weighted Citation Impact
3.17

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Surrogate-Based Bayesian Calibration Methods for Chaotic Systems: A Comparison of Traditional and Nontraditional Approaches

Atlanta Chakraborty, Maike Holthuijzen, Elizabeth H. Krath
2 citations
SIAM/ASA Journal on Uncertainty Quantification
Probabilistic and Robust Engineering Design
3.17
article

Surrogate-Based Bayesian Calibration Methods for Chaotic Systems: A Comparison of Traditional and Nontraditional Approaches

Atlanta Chakraborty, Maike Holthuijzen, Elizabeth H. Krath
article en
2 citations

Abstract

Abstract. Parameter calibration is essential for reducing uncertainty and improving predictive fidelity in physics-based models, yet it is often limited by the high computational cost of model evaluations. Bayesian calibration methods provide a principled framework for combining prior information with data while rigorously quantifying uncertainty. In this work, we compare four emulator-based Bayesian calibration strategies—Calibrate–Emulate–Sample (CES), History Matching (HM), Bayesian Optimal Experimental Design (BOED), and a goal-oriented extension of BOED (GBOED)—using the Lorenz ’96 multiscale system and a two-layer quasi-geostrophic (QG) model as test cases. The proposed GBOED formulation explicitly targets information gain with respect to the calibration posterior, aligning design decisions with downstream inference. We assess methods using accuracy and uncertainty quantification metrics, convergence behavior under increasing computational budgets, and practical considerations such as implementation complexity and robustness. For the Lorenz ’96 system, CES, HM, and GBOED all yield strong calibration performance, even with limited numbers of model evaluations, while standard BOED generally underperforms in this setting. Differences among the strongest methods are modest, particularly as computational budgets increase. For the QG system, all methods produce reasonable posterior estimates, and convergence behavior is more consistent, reflecting smoother parameter–statistic relationships and improved identifiability. Overall, our results indicate that multiple emulator-based calibration strategies can perform comparably well when applied appropriately, with method selection often guided more by computational and practical considerations than by accuracy alone. These findings highlight both the limitations of standard BOED for calibration and the promise of goal-oriented and iterative approaches for efficient Bayesian inference in complex dynamical systems.

SIAM/ASA Journal on Uncertainty QuantificationVol. 14(4)
University of Michigan (US), Sandia National Laboratories (US)
U.S. Department of Energy, University of Michigan, National Energy Research Scientific Computing Center, Office of Science, National Nuclear Security Administration, Sandia National Laboratories, Lawrence Berkeley National Laboratory
Openalex Percentile: Top 13%
Probabilistic and Robust Engineering Design
3.17
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon