Analytical benchmark problems and methodological framework for the assessment and comparison of multifidelity optimization methods

Abstract As engineering systems increase in complexity and performance demands intensify, Multidisciplinary Design Optimization (MDO) methodologies are becoming essential for integrating models from multiple disciplines to optimize complex multi-physics systems. Within this context, major challenges remain in selecting appropriate disciplinary fidelity levels, and how to couple them effectively. Multifidelity methods offer a promising path forward by strategically combining information sources of varying fidelity - whether computational or experimental - to enable efficient and scalable design exploration and optimization. Despite the development of numerous multifidelity methods, their comparative performance remains difficult to assess due to the absence of standardized benchmark frameworks capable of evaluating performance across diverse optimization tasks. To address this gap, this paper introduces a comprehensive benchmarking framework that includes: (i) a suite of analytical benchmark optimization problems designed to stress-test and validate multifidelity methods; (ii) a set of assessment metrics for quantifying and comparing performance over measurable objectives; and (iii) the classification, evaluation, and comparison of several families of multifidelity optimization methods and frameworks using the proposed benchmarks to identify their respective strengths and weaknesses in real-world scenarios. The proposed benchmark problems are analytically defined functions carefully selected to capture mathematical challenges commonly encountered in real-world applications, including high dimensionality, multimodality, discontinuities, and noise. Their closed-form nature ensures computational efficiency, high reproducibility, and a clear separation of algorithmic behavior from numerical artifacts. The accompanying performance metrics support the systematic evaluation of multifidelity methods, measuring both optimization effectiveness and global approximation accuracy. By providing a rigorous, reproducible, and accessible benchmarking framework, this work aims to enable the broader community to understand, compare, and advance multifidelity optimization methods for complex problems in science and engineering.

Authors

Institutions

Publication Details

Journal
Archives of Computational Methods in Engineering
Published
2025-11-10
DOI
https://doi.org/10.1007/s11831-025-10392-8
Primary Topic
Advanced Multi-Objective Optimization Algorithms
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Analytical benchmark problems and methodological framework for the assessment and comparison of multifidelity optimization methods

Francesco Di Fiore, Edmondo Minisci, Hayriye Pehlivan Solak, Andrew S. Thelen et al.
Archives of Computational Methods in Engineering
Advanced Multi-Objective Optimization Algorithms
article

Analytical benchmark problems and methodological framework for the assessment and comparison of multifidelity optimization methods

Francesco Di Fiore, Edmondo Minisci, Hayriye Pehlivan Solak, Andrew S. Thelen, Philip Beran, Domenico Quagliarella, Melike Nikbay, Matteo Diez, Simone Ficini, Laura Mainini, Markus P. Rumpfkeil, Andrea Serani, Riccardo Pellegrini, Dean E. Bryson, S. Yildiz
article en

Abstract

Abstract As engineering systems increase in complexity and performance demands intensify, Multidisciplinary Design Optimization (MDO) methodologies are becoming essential for integrating models from multiple disciplines to optimize complex multi-physics systems. Within this context, major challenges remain in selecting appropriate disciplinary fidelity levels, and how to couple them effectively. Multifidelity methods offer a promising path forward by strategically combining information sources of varying fidelity - whether computational or experimental - to enable efficient and scalable design exploration and optimization. Despite the development of numerous multifidelity methods, their comparative performance remains difficult to assess due to the absence of standardized benchmark frameworks capable of evaluating performance across diverse optimization tasks. To address this gap, this paper introduces a comprehensive benchmarking framework that includes: (i) a suite of analytical benchmark optimization problems designed to stress-test and validate multifidelity methods; (ii) a set of assessment metrics for quantifying and comparing performance over measurable objectives; and (iii) the classification, evaluation, and comparison of several families of multifidelity optimization methods and frameworks using the proposed benchmarks to identify their respective strengths and weaknesses in real-world scenarios. The proposed benchmark problems are analytically defined functions carefully selected to capture mathematical challenges commonly encountered in real-world applications, including high dimensionality, multimodality, discontinuities, and noise. Their closed-form nature ensures computational efficiency, high reproducibility, and a clear separation of algorithmic behavior from numerical artifacts. The accompanying performance metrics support the systematic evaluation of multifidelity methods, measuring both optimization effectiveness and global approximation accuracy. By providing a rigorous, reproducible, and accessible benchmarking framework, this work aims to enable the broader community to understand, compare, and advance multifidelity optimization methods for complex problems in science and engineering.

Archives of Computational Methods in EngineeringVol. 33(2)
École Centrale de Nantes (FR), Roma Tre University (IT), University of Dayton (US), Politecnico di Torino (IT), University of Strathclyde (GB), Wright-Patterson Air Force Base (US), Italian Aerospace Research Centre (IT), Institute of Marine Engineering (IT), National Research Council (IT), American Institute of Aeronautics and Astronautics (US), Imperial College London (GB), Istanbul Technical University (TR), Massachusetts Institute of Technology (US)
U.S. Air Force, Office of Naval Research, Air Force Office of Scientific Research, Air Force Research Laboratory, Office of Naval Research Global
Openalex Percentile: Top 65%
Advanced Multi-Objective Optimization Algorithms
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.