bs-scheduler: A Batch Size Scheduler library compatible with PyTorch DataLoaders

Deep learning models involve computationally intensive training experiments. Increasing the batch size improves the training speed and hardware efficiency by enabling deep neural networks to ingest and process more data in parallel. Inspired by learning rate adaptation policies that yield good results, methods that gradually adjust the batch size have been developed. These methods enhance hardware efficiency without compromising generalization performance. Despite their potential, such methods have not gained widespread popularity or adoption: unlike widely used learning rate policies, for which there is built-in support in most of the deep learning frameworks, the use of batch size adaptation policies requires custom implementations. We introduce an open-source package that implements batch size adaptation policies, which can be seamlessly integrated into deep learning training pipelines. This facilitates more efficient experimentation and accelerates research workflows.

Authors

Institutions

Publication Details

Journal
SoftwareX
Published
2025-04-22
DOI
https://doi.org/10.1016/j.softx.2025.102162
Citations
1
Primary Topic
Parallel Computing and Optimization Techniques
Type
article
Field-Weighted Citation Impact
2.27
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

bs-scheduler: A Batch Size Scheduler library compatible with PyTorch DataLoaders

George Valentin Stoica, Mihaela Breaban
1 citations
SoftwareX
Parallel Computing and Optimization Techniques
2.27
article

bs-scheduler: A Batch Size Scheduler library compatible with PyTorch DataLoaders

George Valentin Stoica, Mihaela Breaban
article en
1 citations

Abstract

Deep learning models involve computationally intensive training experiments. Increasing the batch size improves the training speed and hardware efficiency by enabling deep neural networks to ingest and process more data in parallel. Inspired by learning rate adaptation policies that yield good results, methods that gradually adjust the batch size have been developed. These methods enhance hardware efficiency without compromising generalization performance. Despite their potential, such methods have not gained widespread popularity or adoption: unlike widely used learning rate policies, for which there is built-in support in most of the deep learning frameworks, the use of batch size adaptation policies requires custom implementations. We introduce an open-source package that implements batch size adaptation policies, which can be seamlessly integrated into deep learning training pipelines. This facilitates more efficient experimentation and accelerates research workflows.

SoftwareXVol. 30
Alexandru Ioan Cuza University (RO)
Openalex Percentile: Top 16%
Parallel Computing and Optimization Techniques
2.27
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.