Automated Neural Network Architecture Design and Hyperparameter Adjustment Integrating Distribution-Based Optimization Strategy

Collaborative design and optimization of neural network structure and hyperparameter is the key to improving the efficiency of deep learning model. Conventional methods such as manual tuning and grid search often consume large computational resources and have limited efficiency when facing complex parameter combinations. In this paper, an automated scheme based on probability distribution modeling is developed to realize the synchronous optimization of network architecture design and hyperparameter tuning. The method innovatively transforms various parameters into dynamically adjusted probability distributions and drives the evolution of distribution morphology through a continuous iterative performance feedback mechanism. Based on the intelligent exploration strategy of unified probability space, this scheme can effectively overcome the dimensional disaster problem of traditional methods in high-dimensional configuration space, and can quickly locate the high-performance model configuration under limited computational resources. Comparative experiments on cifar 10, Fashion-MNIST, and IMDB show that the proposed scheme is significantly superior to manual design, grid search, and Bayesian optimization in classification accuracy, model stability, and computing power utilization. This achievement provides a new technical direction for the field of machine learning, and its basic mechanism can be extended to many fields such as image recognition and text processing, which has practical value in promoting the efficiency of intelligent algorithm development.

Authors

Institutions

Publication Details

Journal
Applied and Computational Engineering
Published
2025-05-15
DOI
https://doi.org/10.54254/2755-2721/2025.22721
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Automated Neural Network Architecture Design and Hyperparameter Adjustment Integrating Distribution-Based Optimization Strategy

Linhe Sun
Applied and Computational Engineering
Neural Networks and Applications
article

Automated Neural Network Architecture Design and Hyperparameter Adjustment Integrating Distribution-Based Optimization Strategy

Linhe Sun
article en

Abstract

Collaborative design and optimization of neural network structure and hyperparameter is the key to improving the efficiency of deep learning model. Conventional methods such as manual tuning and grid search often consume large computational resources and have limited efficiency when facing complex parameter combinations. In this paper, an automated scheme based on probability distribution modeling is developed to realize the synchronous optimization of network architecture design and hyperparameter tuning. The method innovatively transforms various parameters into dynamically adjusted probability distributions and drives the evolution of distribution morphology through a continuous iterative performance feedback mechanism. Based on the intelligent exploration strategy of unified probability space, this scheme can effectively overcome the dimensional disaster problem of traditional methods in high-dimensional configuration space, and can quickly locate the high-performance model configuration under limited computational resources. Comparative experiments on cifar 10, Fashion-MNIST, and IMDB show that the proposed scheme is significantly superior to manual design, grid search, and Bayesian optimization in classification accuracy, model stability, and computing power utilization. This achievement provides a new technical direction for the field of machine learning, and its basic mechanism can be extended to many fields such as image recognition and text processing, which has practical value in promoting the efficiency of intelligent algorithm development.

Applied and Computational EngineeringVol. 147(1)
Universiti Putra Malaysia (MY)
Openalex Percentile: Top 95%
Neural Networks and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.