A comprehensive review of lightweight deep learning models for edge computing with future directions

The rapid development of the Internet of Things (IoT) has driven widespread demand for edge intelligence. However, resource-constrained edge devices struggle to support complex deep learning models, making lightweight deep learning models a key research direction. Despite significant progress in this field, a systematic review of its knowledge structure, evolutionary path, and future directions remains lacking. To this end, this paper, based on the PRISMA guidelines, screened 543 articles from the Web of Science (WoS) Core Collection and employed a combined bibliometric and systematic analysis approach to systematically analyze the trends, themes, and directions in this field. Research indicates that this field has experienced exponential growth in recent years. Model compression has been widely adopted as a foundational approach; neural architecture search (NAS) has become a mainstream paradigm for automated design of efficient models; knowledge distillation (KD) and lightweight Transformer architectures have also emerged as important frontiers. Research is shifting from “ex post” model compression to efficiency-focused native architecture design and algorithm-hardware co-optimization. However, this field still faces key challenges, including the accuracy-efficiency-robustness trade-off, high training resource overhead, and a lack of evaluation benchmarks. This study systematically reveals the field’s development trajectory, providing theoretical reference and guidance for future research.

Authors

Institutions

Publication Details

Journal
Discover Computing
Published
2026-02-22
DOI
https://doi.org/10.1007/s10791-026-10021-3
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A comprehensive review of lightweight deep learning models for edge computing with future directions

Wenyang Xiao, ShuangWen Zhao, Nanjun Lai, Siti Sarah Maidin et al.
Discover Computing
Advanced Neural Network Applications
article

A comprehensive review of lightweight deep learning models for edge computing with future directions

Wenyang Xiao, ShuangWen Zhao, Nanjun Lai, Siti Sarah Maidin, Qingzheng Hu, Deshinta Arrova Dewi
article en

Abstract

The rapid development of the Internet of Things (IoT) has driven widespread demand for edge intelligence. However, resource-constrained edge devices struggle to support complex deep learning models, making lightweight deep learning models a key research direction. Despite significant progress in this field, a systematic review of its knowledge structure, evolutionary path, and future directions remains lacking. To this end, this paper, based on the PRISMA guidelines, screened 543 articles from the Web of Science (WoS) Core Collection and employed a combined bibliometric and systematic analysis approach to systematically analyze the trends, themes, and directions in this field. Research indicates that this field has experienced exponential growth in recent years. Model compression has been widely adopted as a foundational approach; neural architecture search (NAS) has become a mainstream paradigm for automated design of efficient models; knowledge distillation (KD) and lightweight Transformer architectures have also emerged as important frontiers. Research is shifting from “ex post” model compression to efficiency-focused native architecture design and algorithm-hardware co-optimization. However, this field still faces key challenges, including the accuracy-efficiency-robustness trade-off, high training resource overhead, and a lack of evaluation benchmarks. This study systematically reveals the field’s development trajectory, providing theoretical reference and guidance for future research.

Discover ComputingVol. 29(1)
INTI International University (MY), China University of Geosciences (CN), Eastern Liaoning University (CN)
Industry, innovation and infrastructure
Openalex Percentile: Top 49%
Advanced Neural Network Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.