Understanding convolutional neural networks through Z-transform: Frequency domain analysis of kernel feature extraction
This paper analyzes Convolutional Neural Networks (CNNs) from a spatial frequency perspective using Z-transforms to evaluate kernel transfer functions. By examining which frequency bands kernels respond to, we quantitatively analyze feature processing through CNN layers. Experiments with custom and pre-trained models (InceptionV3, VGG16, ResNet-50, DenseNet-121) reveal CNNs capture high-frequency features in early layers while increasingly focusing on low-frequency features in deeper layers. Kernel pruning experiments demonstrate that kernels with larger weights capturing low-frequency features are critical for model performance. These findings provide insights into CNN feature extraction processes, contributing to improved interpretability and model construction guidelines.
Authors
- Kenya Jin’no (ORCID: https://orcid.org/0000-0002-0431-5769)
- Sora Togawa (ORCID: https://orcid.org/0009-0001-1559-605X)
Institutions
- Tokyo City University (JP)
Publication Details
- Journal
- Nonlinear Theory and Its Applications IEICE
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1587/nolta.16.878
- Primary Topic
- Neural Networks and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Research Institute of Electrical Communication, Tohoku University