The Impact of Varying Batch Sizes on the Deep Neural Network Algorithms Performance

Batch size is one of the determining factors in the quantity of sample data used in one iterative model training in deep learning. One of the key factors influencing the effectiveness of hyperparameters and model training results. Group size is very important in selection because the right group size will influence the effectiveness and performance of the training. Choosing a batch size that is too small or large can affect accuracy and performance. Deep Neural Network (DNN) algorithm is a form of artificial neural network consisting of several deep layers. There are several batch sizes used in data processing. Optimal performance for batch size is obtained when using a batch size of 64, as it yields the highest average AUC value of 0.815. Furthermore, the optimal configuration was achieved with a batch size of 64 and 6 hidden layers, utilizing a combination of Leaky-ReLV and Sigmoid activation functions, resulting in an AUC value of 0.83.

Authors

Institutions

Publication Details

Published
2024-11-21
DOI
https://doi.org/10.1109/elticom64085.2024.10865356
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Impact of Varying Batch Sizes on the Deep Neural Network Algorithms Performance

Syahril Efendi, Poltak Sihombing, Fahmi Fahmi, Naemah Muharakah
Advanced Neural Network Applications
article

The Impact of Varying Batch Sizes on the Deep Neural Network Algorithms Performance

Syahril Efendi, Poltak Sihombing, Fahmi Fahmi, Naemah Muharakah
article en

Abstract

Batch size is one of the determining factors in the quantity of sample data used in one iterative model training in deep learning. One of the key factors influencing the effectiveness of hyperparameters and model training results. Group size is very important in selection because the right group size will influence the effectiveness and performance of the training. Choosing a batch size that is too small or large can affect accuracy and performance. Deep Neural Network (DNN) algorithm is a form of artificial neural network consisting of several deep layers. There are several batch sizes used in data processing. Optimal performance for batch size is obtained when using a batch size of 64, as it yields the highest average AUC value of 0.815. Furthermore, the optimal configuration was achieved with a batch size of 64 and 6 hidden layers, utilizing a combination of Leaky-ReLV and Sigmoid activation functions, resulting in an AUC value of 0.83.

Universitas Sumatera Utara (ID)
Openalex Percentile: Top 73%
Advanced Neural Network Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

The Impact of Varying Batch Sizes on the Deep Neural Network Algorithms Performance — Syahril Efendi, Poltak Sihombing, et al. · (2024) | TGRS Research Map | TGRS