A Re-Parameterized Lightweight Residual Attention Framework for Resource-Constrained Edge Computing
Edge vision systems require convolutional neural networks (CNNs) that preserve recognition accuracy under strict storage, computation, and latency constraints. Although ResNet18 is a compact residual backbone, direct deployment on resource-constrained devices remains costly, whereas simple channel reduction weakens representation capacity. This study aims to build a deployable ResNet18-based classifier that reduces model complexity while recovering the accuracy lost during compression. We propose a lightweight framework that combines global channel scaling, a re-parameterized attention residual block, and teacher–student knowledge distillation. The proposed block uses multi-branch convolution and squeeze-and-excitation attention during training, then folds the linear branches into a single 3-by-3 convolution for inference. Experiments on CIFAR-100 show that the final model reduces parameters from 11.220 M to 2.841 M, retains comparable Top-1 accuracy (0.7579 vs. 0.7606), improves Top-5 accuracy (0.9340 vs. 0.9253), and reduces graphics processing unit (GPU) batch inference latency from 3.279 ms to 2.161 ms. Deployment on PYNQ-Z2 verifies the complete camera-based CPU-side inference workflow, with an average end-to-end latency of 421.467 ms/frame. The results indicate that residual topology preservation, re-parameterized feature enhancement, and distillation form a practical route for edge-oriented lightweight CNN deployment.
Authors
- Xiyong Liu (ORCID: https://orcid.org/0000-0002-0259-3669)
- Gao Y (ORCID: https://orcid.org/0000-0003-2059-3168)
- Wei Wu
- Jiamin Zhu (ORCID: https://orcid.org/0009-0009-8392-800X)
Institutions
- Hainan University (CN)
- Sanya University (CN)
- Zhejiang University (CN)
Publication Details
- Journal
- Computers
- Published
- 2026-06-19
- DOI
- https://doi.org/10.3390/computers15060395
- Primary Topic
- Advanced Neural Network Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Zhejiang University