Entropy-Guided Search Space Optimization for Efficient Neural Network Pruning

Neural network pruning is essential for deploying deep learning models on resource-constrained devices by reducing computational and memory demands. In this paper, we propose a novel pruning framework, Entropy-Guided Search Space Optimization for Efficient Neural Network Pruning, which uses information entropy to assess the importance of convolutional layers. Specifically, we calculate the layer-wise entropy of pretrained weights, apply outlier detection to remove extreme values, and normalize the entropy values. These normalized values guide the selection of retention ratios, ensuring that layers with higher entropy retain more filters. By refining the subnetwork search space, our approach enhances the efficiency of the search process and improves overall subnetwork performance. The refined search space targets more promising regions, reducing computational overhead and resulting in higher-quality pruned networks. Through iterative optimization, the optimal subnetwork is identified and fine-tuned to produce the final pruned model. Experimental results on benchmark datasets show that our method significantly outperforms existing pruning methods, achieving substantial improvements in both accuracy and computational efficiency. This entropy-guided pruning strategy provides a robust and effective solution for neural network compression, suitable for a wide range of deep learning applications.