A nonlinear convolution neural network quantization method

In today's world, convolution neural networks possess tremendous potential and exhibit remarkable recognition rates in computer vision. However, neural network models are often so large that they are not well-suited for mobile devices, making model compression particularly important. Especially in scenarios with limited hardware resources such as the National Grid, model quantification is essential. This paper introduces an INT8 quantization method for convolution neural networks, which transforms the weights and input/output of the convolution neural network into the logarithmic domain through a non-linear formula. This method provides a better representation of the distribution of small values, resulting in less accuracy loss. Meanwhile, model calibration requires only a limited amount of image data, which reduces the time taken for model calibration while ensuring minimal accuracy loss. Experimental results show that our quantization method results in an accuracy loss of less than 1% on ImageNet and CIFAR.

Authors

Institutions

Publication Details

Published
2024-09-27
DOI
https://doi.org/10.1117/12.3051024
Primary Topic
Advanced Algorithms and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A nonlinear convolution neural network quantization method

Zheng Lou, Chao Xu, Lei Fan, Tao Weisong
Advanced Algorithms and Applications
article

A nonlinear convolution neural network quantization method

Zheng Lou, Chao Xu, Lei Fan, Tao Weisong
article en

Abstract

In today's world, convolution neural networks possess tremendous potential and exhibit remarkable recognition rates in computer vision. However, neural network models are often so large that they are not well-suited for mobile devices, making model compression particularly important. Especially in scenarios with limited hardware resources such as the National Grid, model quantification is essential. This paper introduces an INT8 quantization method for convolution neural networks, which transforms the weights and input/output of the convolution neural network into the logarithmic domain through a non-linear formula. This method provides a better representation of the distribution of small values, resulting in less accuracy loss. Meanwhile, model calibration requires only a limited amount of image data, which reduces the time taken for model calibration while ensuring minimal accuracy loss. Experimental results show that our quantization method results in an accuracy loss of less than 1% on ImageNet and CIFAR.

Nanjing Institute of Technology (CN), Nanjing University of Science and Technology (CN), Yuntianhua Group (China) (CN)
Openalex Percentile: Top 82%
Advanced Algorithms and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.