GPR-132 Hyperparameter Optimization in Neural Network Using Binary Search Algorithm

Hyperparameter searching is a crucial process for every neural network training. However, this process is notably time-consuming due to the vast number of possible combinations and the influence these hyperparameters have on each other. The common approach is using grid search to exhaust all the options, which is computationally very expensive. In this research, we propose a new algorithm for this problem that is inspired by binary search and returns a significant improvement in time efficiency.

Publication Details

Journal
DigitalCommons - Kennesaw State University (Kennesaw State University)
Published
2024-11-20
Primary Topic
Machine Learning and Data Classification
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

GPR-132 Hyperparameter Optimization in Neural Network Using Binary Search Algorithm

DigitalCommons - Kennesaw State University (Kennesaw State University)
Machine Learning and Data Classification
article

GPR-132 Hyperparameter Optimization in Neural Network Using Binary Search Algorithm

article en

Abstract

Hyperparameter searching is a crucial process for every neural network training. However, this process is notably time-consuming due to the vast number of possible combinations and the influence these hyperparameters have on each other. The common approach is using grid search to exhaust all the options, which is computationally very expensive. In this research, we propose a new algorithm for this problem that is inspired by binary search and returns a significant improvement in time efficiency.

DigitalCommons - Kennesaw State University (Kennesaw State University)
Openalex Percentile: Top 55%
Machine Learning and Data Classification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

GPR-132 Hyperparameter Optimization in Neural Network Using Binary Search Algorithm · DigitalCommons - Kennesaw State University (Kennesaw State University) (2024) | TGRS Research Map | TGRS