Trust‐region filter algorithms utilizing Hessian information for gray‐box optimization
Abstract Optimizing industrial processes often involves gray‐box models that couple algebraic glass‐box equations with black‐box components lacking analytic derivatives. Such systems challenge derivative‐based solvers. The classical trust‐region filter (TRF) algorithm provides a robust framework but requires extensive parameter tuning and numerous black‐box evaluations. This work introduces four Hessian‐informed TRF variants that use projected positive definite Hessians for automatic step scaling and minimal tuning, combined with both low‐fidelity (linear, quadratic) and high‐fidelity (Taylor series, Gaussian process) surrogates for local black‐box approximation. Tested on 25 gray‐box benchmarks and five engineering case studies, the new variants achieved up to order‐of‐magnitude reductions in iterations and black‐box evaluations, with reduced sensitivity to tuning parameters relative to the classical TRF algorithm. High‐fidelity surrogates solved 92%–100% of problems, compared with 72%–84% for low‐fidelity surrogates. The developed TRF methods also outperformed classical derivative‐free optimization solvers. Results show that new variants offer robust, scalable alternatives for gray‐box optimization.
Authors
- Michael Short (ORCID: https://orcid.org/0000-0002-9719-3368)
- Gul Hameed (ORCID: https://orcid.org/0000-0002-2069-5132)
- Ehecatl Antonio del Rio‐Chanona (ORCID: https://orcid.org/0000-0003-0274-2852)
- Lorenz T. Biegler (ORCID: https://orcid.org/0000-0003-3875-4441)
- Tao Chen (ORCID: https://orcid.org/0000-0001-5025-5472)
Institutions
- University of Surrey (GB)
- Imperial College London (GB)
- Carnegie Mellon University (US)
Publication Details
- Journal
- AIChE Journal
- Published
- 2026-01-27
- DOI
- https://doi.org/10.1002/aic.70236
- Primary Topic
- Advanced Multi-Objective Optimization Algorithms
- Type
- article
- Field-Weighted Citation Impact
- 0.00