Multilayer Perceptron Grouping and Sparse Gaussian Process-Based Surrogate-Assisted Evolutionary Algorithm for Expensive Multiobjective Optimization

Gaussian processes (GPs) have attracted considerable attention in assisting evolutionary algorithms (EAs) to solve computationally expensive optimization problems (EOPs) because they can directly provide information about the uncertainty of their predictions. However, the computational complexity of GPs grows cubically as the amount of data increases, which severely limits their computational efficiency in high-dimensional expensive multiobjective optimization problems (EMOPs). To address this limitation, we propose a surrogate-assisted evolutionary algorithm (SAEA) that integrates multilayer perceptron (MLP) grouping with sparse GPs, referred to as MLPSGP-SAEA. First, the MLP grouping selects a subspace from the original space by evaluating the impact of each decision variable on the objective functions. Then, for each objective function, a sparse GP model is employed, and the locations of pseudo-input points are optimized to enhance computational efficiency while improving model accuracy. Moreover, an adaptive sparse and diverse (ASD) infill criterion is proposed, based on the characteristics of the sparse GP model predictive distribution, to better balance exploration and exploitation. Finally, extensive experiments are conducted on four benchmark suites and an aerodynamic design optimization problem. The experimental results demonstrate that MLPSGP-SAEA exhibits significant competitive advantages over the state-of-the-art SAEAs.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Cybernetics
Published
2025-11-27
DOI
https://doi.org/10.1109/tcyb.2025.3634364
Primary Topic
Advanced Multi-Objective Optimization Algorithms
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multilayer Perceptron Grouping and Sparse Gaussian Process-Based Surrogate-Assisted Evolutionary Algorithm for Expensive Multiobjective Optimization

Jeng‐Shyang Pan, Jia Zhao, Jianpo Li, Lingping Kong et al.
IEEE Transactions on Cybernetics
Advanced Multi-Objective Optimization Algorithms
article

Multilayer Perceptron Grouping and Sparse Gaussian Process-Based Surrogate-Assisted Evolutionary Algorithm for Expensive Multiobjective Optimization

Jeng‐Shyang Pan, Jia Zhao, Jianpo Li, Lingping Kong, Yunfeng Peng, Shu‐Chuan Chu
article en

Abstract

Gaussian processes (GPs) have attracted considerable attention in assisting evolutionary algorithms (EAs) to solve computationally expensive optimization problems (EOPs) because they can directly provide information about the uncertainty of their predictions. However, the computational complexity of GPs grows cubically as the amount of data increases, which severely limits their computational efficiency in high-dimensional expensive multiobjective optimization problems (EMOPs). To address this limitation, we propose a surrogate-assisted evolutionary algorithm (SAEA) that integrates multilayer perceptron (MLP) grouping with sparse GPs, referred to as MLPSGP-SAEA. First, the MLP grouping selects a subspace from the original space by evaluating the impact of each decision variable on the objective functions. Then, for each objective function, a sparse GP model is employed, and the locations of pseudo-input points are optimized to enhance computational efficiency while improving model accuracy. Moreover, an adaptive sparse and diverse (ASD) infill criterion is proposed, based on the characteristics of the sparse GP model predictive distribution, to better balance exploration and exploitation. Finally, extensive experiments are conducted on four benchmark suites and an aerodynamic design optimization problem. The experimental results demonstrate that MLPSGP-SAEA exhibits significant competitive advantages over the state-of-the-art SAEAs.

IEEE Transactions on CyberneticsVol. 56(4)
Jiangxi University of Water Resources and Electric Power (CN), VSB - Technical University of Ostrava (CZ), Northeast Electric Power University (CN), Nanjing University of Information Science and Technology (CN)
Openalex Percentile: Top 63%
Advanced Multi-Objective Optimization Algorithms
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.