Autoencoder-enhanced joint dimensionality reduction for constrained Bayesian optimisation

Abstract Bayesian Optimisation (BO) is a sample-efficient method for optimising expensive black-box functions, making it particularly suitable for engineering problems where gradients are unavailable and evaluating the objective or constraints is computationally costly. However, such problems often involve high-dimensional inputs and a large number of constraints, posing significant challenges for standard BO frameworks. While prior research has addressed scalability with respect to high-dimensional inputs in constrained settings, efficiently handling large numbers of constraints, i.e. high-dimensional outputs, remains an open problem. This work introduces A utoencoder- E nhanced Joint Dimensionality R eduction for C o nstrained BO (AERO-BO), a framework that performs dimensionality reduction in both the input (design variable) and output (objective and constraint) spaces via autoencoders. These autoencoders are trained online, requiring no pre-training, and their respective latent representations are connected through Gaussian Processes, which serve as surrogate models during optimisation. By operating in a joint latent space, AERO-BO enables scalable and efficient optimisation in settings with hundreds of design variables and thousands of black-box constraints.

Authors

Institutions

Publication Details

Journal
Machine Learning Science and Technology
Published
2025-10-02
DOI
https://doi.org/10.1088/2632-2153/ae0efe
Primary Topic
Gaussian Processes and Bayesian Inference
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Autoencoder-enhanced joint dimensionality reduction for constrained Bayesian optimisation

Saullo G. P. Castro, Hauke F. Maathuis, Roeland DeBreuker
Machine Learning Science and Technology
Gaussian Processes and Bayesian Inference
article

Autoencoder-enhanced joint dimensionality reduction for constrained Bayesian optimisation

Saullo G. P. Castro, Hauke F. Maathuis, Roeland DeBreuker
article en

Abstract

Abstract Bayesian Optimisation (BO) is a sample-efficient method for optimising expensive black-box functions, making it particularly suitable for engineering problems where gradients are unavailable and evaluating the objective or constraints is computationally costly. However, such problems often involve high-dimensional inputs and a large number of constraints, posing significant challenges for standard BO frameworks. While prior research has addressed scalability with respect to high-dimensional inputs in constrained settings, efficiently handling large numbers of constraints, i.e. high-dimensional outputs, remains an open problem. This work introduces A utoencoder- E nhanced Joint Dimensionality R eduction for C o nstrained BO (AERO-BO), a framework that performs dimensionality reduction in both the input (design variable) and output (objective and constraint) spaces via autoencoders. These autoencoders are trained online, requiring no pre-training, and their respective latent representations are connected through Gaussian Processes, which serve as surrogate models during optimisation. By operating in a joint latent space, AERO-BO enables scalable and efficient optimisation in settings with hundreds of design variables and thousands of black-box constraints.

Machine Learning Science and TechnologyVol. 6(4)
Delft University of Technology (NL)
Openalex Percentile: Top 86%
Gaussian Processes and Bayesian Inference
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Autoencoder-enhanced joint dimensionality reduction for constrained Bayesian optimisation — Saullo G. P. Castro, Hauke F. Maathuis, et al. · Machine Learning Science and Technology (2025) | TGRS Research Map | TGRS