Compression Algorithm of Convolutional Neural Network Model

The exponential growth of data requires powerful analytical methods and processing tools, and deep learning demonstrates powerful analytical and predictive capabilities. CNN is excellent model in the field of deep learning, enabling powerful feature abstraction and image understanding that goes beyond the accuracy of recognition using the human eye. However, while the CNN model is constantly approaching the precision limit, the network depth and model parameters have multiplied, and the huge memory consumption and excessive storage occupation cannot be applied on many embedded and mobile devices. This paper constructs a compression algorithm model, including convolution layer, filter and pruning algorithm, and focuses on structured pruning and filter importance calculation. Using MNIST data set, the LeNet-5 model was trained by parameter pruning according to different pruning ratios, and the model compression was realized. The application of the research results in this paper can significantly reduce the redundant parameters in the network model, thus achieving the purpose of reducing the computing cost and storage space, and promoting the development of deep learning.

Authors

Institutions

Publication Details

Published
2025-01-10
DOI
https://doi.org/10.1109/citsc64390.2025.00061
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Compression Algorithm of Convolutional Neural Network Model

Lishuang Zhao, Yanchun Liu
Neural Networks and Applications
article

Compression Algorithm of Convolutional Neural Network Model

Lishuang Zhao, Yanchun Liu
article en

Abstract

The exponential growth of data requires powerful analytical methods and processing tools, and deep learning demonstrates powerful analytical and predictive capabilities. CNN is excellent model in the field of deep learning, enabling powerful feature abstraction and image understanding that goes beyond the accuracy of recognition using the human eye. However, while the CNN model is constantly approaching the precision limit, the network depth and model parameters have multiplied, and the huge memory consumption and excessive storage occupation cannot be applied on many embedded and mobile devices. This paper constructs a compression algorithm model, including convolution layer, filter and pruning algorithm, and focuses on structured pruning and filter importance calculation. Using MNIST data set, the LeNet-5 model was trained by parameter pruning according to different pruning ratios, and the model compression was realized. The application of the research results in this paper can significantly reduce the redundant parameters in the network model, thus achieving the purpose of reducing the computing cost and storage space, and promoting the development of deep learning.

Bohai University (CN)
Social Science Foundation of Liaoning Province
Openalex Percentile: Top 97%
Neural Networks and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.