Surrogate-Based Bayesian Calibration Methods for Chaotic Systems: A Comparison of Traditional and Nontraditional Approaches
Abstract. Parameter calibration is essential for reducing uncertainty and improving predictive fidelity in physics-based models, yet it is often limited by the high computational cost of model evaluations. Bayesian calibration methods provide a principled framework for combining prior information with data while rigorously quantifying uncertainty. In this work, we compare four emulator-based Bayesian calibration strategies—Calibrate–Emulate–Sample (CES), History Matching (HM), Bayesian Optimal Experimental Design (BOED), and a goal-oriented extension of BOED (GBOED)—using the Lorenz ’96 multiscale system and a two-layer quasi-geostrophic (QG) model as test cases. The proposed GBOED formulation explicitly targets information gain with respect to the calibration posterior, aligning design decisions with downstream inference. We assess methods using accuracy and uncertainty quantification metrics, convergence behavior under increasing computational budgets, and practical considerations such as implementation complexity and robustness. For the Lorenz ’96 system, CES, HM, and GBOED all yield strong calibration performance, even with limited numbers of model evaluations, while standard BOED generally underperforms in this setting. Differences among the strongest methods are modest, particularly as computational budgets increase. For the QG system, all methods produce reasonable posterior estimates, and convergence behavior is more consistent, reflecting smoother parameter–statistic relationships and improved identifiability. Overall, our results indicate that multiple emulator-based calibration strategies can perform comparably well when applied appropriately, with method selection often guided more by computational and practical considerations than by accuracy alone. These findings highlight both the limitations of standard BOED for calibration and the promise of goal-oriented and iterative approaches for efficient Bayesian inference in complex dynamical systems.
Authors
- Atlanta Chakraborty (ORCID: https://orcid.org/0000-0001-6679-6054)
- Maike Holthuijzen (ORCID: https://orcid.org/0000-0002-6870-3314)
- Elizabeth H. Krath (ORCID: https://orcid.org/0000-0002-5411-3006)
Institutions
- University of Michigan (US)
- Sandia National Laboratories (US)
Publication Details
- Journal
- SIAM/ASA Journal on Uncertainty Quantification
- Published
- 2026-11-16
- DOI
- https://doi.org/10.1137/25m1783618
- Citations
- 2
- Primary Topic
- Probabilistic and Robust Engineering Design
- Type
- article
- Field-Weighted Citation Impact
- 3.17
Funders
- U.S. Department of Energy
- University of Michigan
- National Energy Research Scientific Computing Center
- Office of Science
- National Nuclear Security Administration
- Sandia National Laboratories
- Lawrence Berkeley National Laboratory