LWViT-Lightweight Vision Transformer for Edge Deployment via Adaptive Multi-Dimensional Pruning
The complex environments of construction sites present dual challenges for visual algorithms: the need for real-time performance and high accuracy. However, deploying traditional Vision Transformers (ViTs) on edge devices is hindered by substantial computational demands. To address this, we propose LWViT (Lightweight ViT), an adaptive model compression framework based on multi-dimensional task correlation. LWViT analyzes the interplay between the structural dimensions of ViTs and task-specific features to develop tailored pruning strategies. Experiments conducted on three benchmark datasets show that, at a pruning ratio of 0.80, LWViT achieves a 1.2× increase in inference speed while improving accuracy by 2.05% compared to the original ViT, outperforming state-of-the-art pruning approaches. This work offers an effective solution for the lightweight deployment of visual algorithms in edge computing scenarios.
Authors
- Guihai Yan (ORCID: https://orcid.org/0000-0002-1254-3278)
- Panbo He (ORCID: https://orcid.org/0000-0002-4014-0513)
- Jin He (ORCID: https://orcid.org/0000-0001-5081-3569)
- Yue Chen (ORCID: https://orcid.org/0000-0002-9529-1626)
- Yumeng Li (ORCID: https://orcid.org/0009-0004-3655-6200)
- Wei Wan (ORCID: https://orcid.org/0009-0001-8154-9139)
Institutions
- Hunan University (CN)
- Shenzhen Institute of Building Research (China) (CN)
Publication Details
- Published
- 2025-06-06
- DOI
- https://doi.org/10.1109/raiie65740.2025.11140045
- Primary Topic
- Optical Wireless Communication Technologies
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Research and Development