Server-edge Device Based Efficient Deep Learning Network Retraining Framework

Despite the excellent performance of deep learning, there are two constraints when it is applied to industrial applications: the size of the network and the ability to adapt to unseen data. Recently, attempts have been made to mitigate these issues using a server-edge–device-based environment. In this study, we proposed a server-edge–device-based efficient retraining framework. First, the difficulty score of the unseen data, which was not used in the current training and had no annotation information, was estimated using a deep learning model in the edge device. Thereafter, the filtered unseen data based on the difficulty score were predicted using the labeling model in the server. Finally, retraining and network compression were performed to enhance the performance of the edge model for unseen data. Extensive experiments show that our framework can improve the recognition performance for unseen data and reduce the retraining time by less than three times compared to using the entire dataset, with a performance gap of less than 1%. Using the proposed framework, systematic efficiency can also be achieved by minimizing the data transfer between the server and edge devices.

Authors

Publication Details

Journal
Journal of Institute of Control Robotics and Systems
Published
2024-10-16
DOI
https://doi.org/10.5302/j.icros.2024.24.0173
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Server-edge Device Based Efficient Deep Learning Network Retraining Framework

Eunho Lee, Yeongju Lee, Youngbae Hwang, Donghyeon Lee
Journal of Institute of Control Robotics and Systems
Neural Networks and Applications
article

Server-edge Device Based Efficient Deep Learning Network Retraining Framework

Eunho Lee, Yeongju Lee, Youngbae Hwang, Donghyeon Lee
article en

Abstract

Despite the excellent performance of deep learning, there are two constraints when it is applied to industrial applications: the size of the network and the ability to adapt to unseen data. Recently, attempts have been made to mitigate these issues using a server-edge–device-based environment. In this study, we proposed a server-edge–device-based efficient retraining framework. First, the difficulty score of the unseen data, which was not used in the current training and had no annotation information, was estimated using a deep learning model in the edge device. Thereafter, the filtered unseen data based on the difficulty score were predicted using the labeling model in the server. Finally, retraining and network compression were performed to enhance the performance of the edge model for unseen data. Extensive experiments show that our framework can improve the recognition performance for unseen data and reduce the retraining time by less than three times compared to using the entire dataset, with a performance gap of less than 1%. Using the proposed framework, systematic efficiency can also be achieved by minimizing the data transfer between the server and edge devices.

Journal of Institute of Control Robotics and SystemsVol. 30(10)
Openalex Percentile: Top 84%
Neural Networks and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.