LWViT-Lightweight Vision Transformer for Edge Deployment via Adaptive Multi-Dimensional Pruning

The complex environments of construction sites present dual challenges for visual algorithms: the need for real-time performance and high accuracy. However, deploying traditional Vision Transformers (ViTs) on edge devices is hindered by substantial computational demands. To address this, we propose LWViT (Lightweight ViT), an adaptive model compression framework based on multi-dimensional task correlation. LWViT analyzes the interplay between the structural dimensions of ViTs and task-specific features to develop tailored pruning strategies. Experiments conducted on three benchmark datasets show that, at a pruning ratio of 0.80, LWViT achieves a 1.2× increase in inference speed while improving accuracy by 2.05% compared to the original ViT, outperforming state-of-the-art pruning approaches. This work offers an effective solution for the lightweight deployment of visual algorithms in edge computing scenarios.

Authors

Institutions

Publication Details

Published
2025-06-06
DOI
https://doi.org/10.1109/raiie65740.2025.11140045
Primary Topic
Optical Wireless Communication Technologies
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

LWViT-Lightweight Vision Transformer for Edge Deployment via Adaptive Multi-Dimensional Pruning

Guihai Yan, Panbo He, Jin He, Yue Chen et al.
Optical Wireless Communication Technologies
article

LWViT-Lightweight Vision Transformer for Edge Deployment via Adaptive Multi-Dimensional Pruning

Guihai Yan, Panbo He, Jin He, Yue Chen, Yumeng Li, Wei Wan
article en

Abstract

The complex environments of construction sites present dual challenges for visual algorithms: the need for real-time performance and high accuracy. However, deploying traditional Vision Transformers (ViTs) on edge devices is hindered by substantial computational demands. To address this, we propose LWViT (Lightweight ViT), an adaptive model compression framework based on multi-dimensional task correlation. LWViT analyzes the interplay between the structural dimensions of ViTs and task-specific features to develop tailored pruning strategies. Experiments conducted on three benchmark datasets show that, at a pruning ratio of 0.80, LWViT achieves a 1.2× increase in inference speed while improving accuracy by 2.05% compared to the original ViT, outperforming state-of-the-art pruning approaches. This work offers an effective solution for the lightweight deployment of visual algorithms in edge computing scenarios.

Hunan University (CN), Shenzhen Institute of Building Research (China) (CN)
Research and Development
Openalex Percentile: Top 78%
Optical Wireless Communication Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.