Fast Post-Training Pruning Framework for CNNs Based on Fisher Information

This paper presents a novel post-training pruning framework for Convolutional Neural Networks (CNNs) that achieves superior computational efficiency while maintaining model accuracy. My approach introduces three key innovations: (1) a Fisher information-based importance metric specifically adapted for CNNs [1], (2) a greedy mask rearrangement algorithm that accounts for inter-filter dependencies through block-diagonal Hessian approximations, and (3) a lightweight activation reconstruction method using learned scaling factors [2]. Through extensive experiments on MNIST with varying network architectures, I demonstrate that my framework achieves up to 37.29% FLOPs reduction with only 2.73% accuracy drop, while completing the entire pruning process in under 3 minutes on a single GPU. Comparative analysis shows my method reduces accuracy drop by 28-55% compared to magnitude-based pruning (threshold=0.1) and L1 regularization (λ=0.001) approaches]. The mathematical analysis provides theoretical guarantees on error bounds, while practical guidelines address real-world deployment considerations.

Authors

Institutions

Publication Details

Published
2025-07-11
DOI
https://doi.org/10.1109/cisat66811.2025.11181928
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Fast Post-Training Pruning Framework for CNNs Based on Fisher Information

Yinan Zhang
Neural Networks and Applications
article

Fast Post-Training Pruning Framework for CNNs Based on Fisher Information

Yinan Zhang
article en

Abstract

This paper presents a novel post-training pruning framework for Convolutional Neural Networks (CNNs) that achieves superior computational efficiency while maintaining model accuracy. My approach introduces three key innovations: (1) a Fisher information-based importance metric specifically adapted for CNNs [1], (2) a greedy mask rearrangement algorithm that accounts for inter-filter dependencies through block-diagonal Hessian approximations, and (3) a lightweight activation reconstruction method using learned scaling factors [2]. Through extensive experiments on MNIST with varying network architectures, I demonstrate that my framework achieves up to 37.29% FLOPs reduction with only 2.73% accuracy drop, while completing the entire pruning process in under 3 minutes on a single GPU. Comparative analysis shows my method reduces accuracy drop by 28-55% compared to magnitude-based pruning (threshold=0.1) and L1 regularization (λ=0.001) approaches]. The mathematical analysis provides theoretical guarantees on error bounds, while practical guidelines address real-world deployment considerations.

East China Normal University (CN)
Openalex Percentile: Top 86%
Neural Networks and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.