Efficient neural language model training system design based on machine learning
To address the problem of low computational resource scheduling efficiency in large-scale deep learning training, a distributed training system is designed with a three-layer architecture to achieve high-efficiency computational resource scheduling. The system introduces hybrid precision training and dynamic batch processing optimization strategies, achieving a training throughput of 14,000 samples per second on an 8-GPU cluster. Experimental tests show that the system performs exceptionally well in terms of training efficiency and resource utilization, with a GPU utilization rate of 94.5% and an inference latency of 32ms, providing a practical reference for large-scale model training deployment.
Authors
- Zifeng Liu (ORCID: https://orcid.org/0009-0005-5833-2141)
- Wenjie Su
- Zhaowen Wang (ORCID: https://orcid.org/0009-0002-0180-760X)
- Dong Xu (ORCID: https://orcid.org/0000-0002-4809-0514)
- Ge Wang (ORCID: https://orcid.org/0000-0002-2656-7705)
- Kun Deng (ORCID: https://orcid.org/0000-0003-3637-1690)
- Yeeun Lee (ORCID: https://orcid.org/0009-0002-7647-490X)
Institutions
- Minzu University of China (CN)
- Beijing University of Chemical Technology (CN)
- Communication University of China (CN)
- Renmin University of China (CN)
Publication Details
- Published
- 2025-07-24
- DOI
- https://doi.org/10.1117/12.3069177
- Primary Topic
- Educational Technology and Assessment
- Type
- article
- Field-Weighted Citation Impact
- 0.00