Bayesian optimization based on Expected P-box Improvement and application in HEG Shock Tunnel Cylindrical Model Experiment

The design of acquisition functions is a key research focus in Bayesian optimization. Recent studies have highlighted the importance of accounting for the impact of candidate sample points on surrogate model uncertainty. To address this need, we introduce probability box (P-box) as a metric, which comprehensively captures surrogate model uncertainty. We propose a novel Gaussian process regression (GPR)-based P-box estimation method, overcoming the computational inefficiency of traditional double-loop sampling. Further, we develop two acquisition functions based on Expected P-box Improvement, tailored for distinct objectives: (1) Global Expected P-box Improvement (GEPBI), which maximizes global P-box changes to improve surrogate model accuracy, and (2) Boundary Expected P-box Improvement (BEPBI), which targets P-box boundary changes to efficiently locate the global optimum. To address computational inefficiency in high-dimensional problems, we use the multi-start stochastic gradient ascent algorithm to calculate GEPBI and BEPBI. The proposed acquisition functions are validated on three test functions and an engineering black-box problem: the HEG shock tunnel cylindrical model experiment. GEPBI outperforms Posterior Variance (PV) and Expected Integrated Error Reduction (EIER) in accuracy for a multimodal function. BEPBI surpasses Expected Improvement (EI), Lower Confidence Bound (LCB) and Knowledge Gradient (KG) in global optimum for a function with numerous local optima. Their advantages are more pronounced when initial samples are biased. Both methods demonstrate significant advantages in handling high-dimensional complex functions and engineering black-box problems. • GPR-based P-box model is proposed to quantify surrogate model uncertainty. • Two novel EPBI acquisition functions (GEPBI and BEPBI) are proposed. • EPBI considers the impact of candidate points on the posterior of the surrogate model. • GEPBI significantly improves surrogate model accuracy, while BEPBI excels in locating optimal values. • Multi-start stochastic gradient ascent enhances the computational efficiency of GEPBI and BEPBI.

Authors

Institutions

Publication Details

Journal
Results in Engineering
Published
2025-10-17
DOI
https://doi.org/10.1016/j.rineng.2025.107618
Primary Topic
Probabilistic and Robust Engineering Design
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Bayesian optimization based on Expected P-box Improvement and application in HEG Shock Tunnel Cylindrical Model Experiment

Jiangtao Chen, Jiaqi Liu, Xinyu Sun, Liang Yan et al.
Results in Engineering
Probabilistic and Robust Engineering Design
article

Bayesian optimization based on Expected P-box Improvement and application in HEG Shock Tunnel Cylindrical Model Experiment

Jiangtao Chen, Jiaqi Liu, Xinyu Sun, Liang Yan, Xiaojun Duan
article en

Abstract

The design of acquisition functions is a key research focus in Bayesian optimization. Recent studies have highlighted the importance of accounting for the impact of candidate sample points on surrogate model uncertainty. To address this need, we introduce probability box (P-box) as a metric, which comprehensively captures surrogate model uncertainty. We propose a novel Gaussian process regression (GPR)-based P-box estimation method, overcoming the computational inefficiency of traditional double-loop sampling. Further, we develop two acquisition functions based on Expected P-box Improvement, tailored for distinct objectives: (1) Global Expected P-box Improvement (GEPBI), which maximizes global P-box changes to improve surrogate model accuracy, and (2) Boundary Expected P-box Improvement (BEPBI), which targets P-box boundary changes to efficiently locate the global optimum. To address computational inefficiency in high-dimensional problems, we use the multi-start stochastic gradient ascent algorithm to calculate GEPBI and BEPBI. The proposed acquisition functions are validated on three test functions and an engineering black-box problem: the HEG shock tunnel cylindrical model experiment. GEPBI outperforms Posterior Variance (PV) and Expected Integrated Error Reduction (EIER) in accuracy for a multimodal function. BEPBI surpasses Expected Improvement (EI), Lower Confidence Bound (LCB) and Knowledge Gradient (KG) in global optimum for a function with numerous local optima. Their advantages are more pronounced when initial samples are biased. Both methods demonstrate significant advantages in handling high-dimensional complex functions and engineering black-box problems. • GPR-based P-box model is proposed to quantify surrogate model uncertainty. • Two novel EPBI acquisition functions (GEPBI and BEPBI) are proposed. • EPBI considers the impact of candidate points on the posterior of the surrogate model. • GEPBI significantly improves surrogate model accuracy, while BEPBI excels in locating optimal values. • Multi-start stochastic gradient ascent enhances the computational efficiency of GEPBI and BEPBI.

Results in EngineeringVol. 28
National University of Defense Technology (CN), China Aerodynamics Research and Development Center (CN), China Academy of Launch Vehicle Technology (CN)
Openalex Percentile: Top 71%
Probabilistic and Robust Engineering Design
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.