YOLO V8 Network Lightweight Method Based on Pruning and Quantization

With the development of deep learning, convolutional neural networks have been widely used as core algorithms in fields such as computer vision, natural language processing, and speech processing, surpassing the performance of traditional algorithms. However, its complex structure and massive computational load make many algorithms dependent on GPU implementation, which limits its application on mobile devices with limited resources and high real-time requirements. This article explores in detail the lightweighting process of the YOLO v8 model, aiming to optimize its performance in resource constrained environments by combining BN layer scale factor pruning and int8 quantization techniques under the TensorRT framework. Firstly, using the scale factor in the BN layer as an evaluation criterion, redundant channels in the network are identified, effectively reducing the number of model parameters and computational requirements; Then deploy the model in NVIDIA's TensorRT framework for int8 quantization. This process compresses the floating-point operations of the model into low bit int8 operations, significantly reducing computational complexity and memory usage; And validated through COCO dataset experiments during the process. The results show that YOLO v8, after pruning and quantization, can achieve a compression ratio of 64.2% with a loss detection accuracy of about 4%. This study provides a comprehensive solution for the efficient deployment of deep learning models, especially in application scenarios that require balancing performance and resource efficiency, which has important practical significance. Future work will focus on further optimizing pruning and quantization strategies to adapt to a wider range of network architectures and application requirements.

Authors

Publication Details

Journal
Mathematical Modeling and Algorithm Application
Published
2024-11-28
DOI
https://doi.org/10.54097/4qsv1565
Citations
6
Primary Topic
Optical Systems and Laser Technology
Type
article
Field-Weighted Citation Impact
1.25
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

YOLO V8 Network Lightweight Method Based on Pruning and Quantization

Yu Cheng
6 citations
Mathematical Modeling and Algorithm Application
Optical Systems and Laser Technology
1.25
article

YOLO V8 Network Lightweight Method Based on Pruning and Quantization

Yu Cheng
article en
6 citations

Abstract

With the development of deep learning, convolutional neural networks have been widely used as core algorithms in fields such as computer vision, natural language processing, and speech processing, surpassing the performance of traditional algorithms. However, its complex structure and massive computational load make many algorithms dependent on GPU implementation, which limits its application on mobile devices with limited resources and high real-time requirements. This article explores in detail the lightweighting process of the YOLO v8 model, aiming to optimize its performance in resource constrained environments by combining BN layer scale factor pruning and int8 quantization techniques under the TensorRT framework. Firstly, using the scale factor in the BN layer as an evaluation criterion, redundant channels in the network are identified, effectively reducing the number of model parameters and computational requirements; Then deploy the model in NVIDIA's TensorRT framework for int8 quantization. This process compresses the floating-point operations of the model into low bit int8 operations, significantly reducing computational complexity and memory usage; And validated through COCO dataset experiments during the process. The results show that YOLO v8, after pruning and quantization, can achieve a compression ratio of 64.2% with a loss detection accuracy of about 4%. This study provides a comprehensive solution for the efficient deployment of deep learning models, especially in application scenarios that require balancing performance and resource efficiency, which has important practical significance. Future work will focus on further optimizing pruning and quantization strategies to adapt to a wider range of network architectures and application requirements.

Mathematical Modeling and Algorithm ApplicationVol. 3(2)
Decent work and economic growth
Openalex Percentile: Top 19%
Optical Systems and Laser Technology
1.25
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.