Distributed Deep Learning Framework Based on Cloud Oss for Efficient Model Synchronization

With the rapid development of deep learning technology, training deep neural networks (DNN) under limited computational resources has become a hot topic, especially in fields like computer vision and natural language processing. Traditional distributed training often relies on centralized parameter servers, which can lead to communication bottlenecks, limiting system performance. To address the issue, this paper proposes a distributed training framework based on cloud Object Storage Service (OSS), utilizing OSS for parameter synchronization and avoiding the bottlenecks associated with traditional parameter server models. Experimental results show that the OSS-based framework achieves faster convergence speed, higher training efficiency, and shorter training time compared to traditional distributed training frameworks. Specifically, the OSS framework reduces training time by approximately 30% and demonstrates better flexibility and scalability across different worker configurations, effectively enhancing performance in large-scale distributed training tasks. The significance of this study lies in providing an efficient and scalable solution for training deep neural networks under limited computational resources.

Publication Details

Journal
Springer Link (Chiba Institute of Technology)
Published
2025-09-08
DOI
https://doi.org/10.1051/itmconf/20257803012/pdf
Primary Topic
Geochemistry and Geologic Mapping
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Distributed Deep Learning Framework Based on Cloud Oss for Efficient Model Synchronization

Springer Link (Chiba Institute of Technology)
Geochemistry and Geologic Mapping
article

Distributed Deep Learning Framework Based on Cloud Oss for Efficient Model Synchronization

article en

Abstract

With the rapid development of deep learning technology, training deep neural networks (DNN) under limited computational resources has become a hot topic, especially in fields like computer vision and natural language processing. Traditional distributed training often relies on centralized parameter servers, which can lead to communication bottlenecks, limiting system performance. To address the issue, this paper proposes a distributed training framework based on cloud Object Storage Service (OSS), utilizing OSS for parameter synchronization and avoiding the bottlenecks associated with traditional parameter server models. Experimental results show that the OSS-based framework achieves faster convergence speed, higher training efficiency, and shorter training time compared to traditional distributed training frameworks. Specifically, the OSS framework reduces training time by approximately 30% and demonstrates better flexibility and scalability across different worker configurations, effectively enhancing performance in large-scale distributed training tasks. The significance of this study lies in providing an efficient and scalable solution for training deep neural networks under limited computational resources.

Springer Link (Chiba Institute of Technology)
Openalex Percentile: Top 44%
Geochemistry and Geologic Mapping
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Distributed Deep Learning Framework Based on Cloud Oss for Efficient Model Synchronization · Springer Link (Chiba Institute of Technology) (2025) | TGRS Research Map | TGRS