A Lightweight Convolutional Network Based on RepLKnet and Ghost Convolution

Over the past two years, convolutional neural networks have witnessed a resurgence in the domain of computer vision, owing to the contemporary design of large convolutional kernels and the corresponding optimization techniques. Nevertheless, these large kernel convolutional neural networks primarily concentrate on enlarging the size of the convolutional kernel, while overlooking the significant amount of redundant information that emerges among the feature map channels as the convolutional kernel expands. With the aim of enhancing the computational efficiency of large convolutional kernel networks and enabling their application in more resource-constrained settings, this paper incorporates ghost convolution to modify the RepLK block, thereby effectively exploiting these redundancies. The validation outcomes on the CIFAR-100 dataset indicate that the lightweight and enhanced network model attains 4.32% of the FLOPs and 4.77% of the parameter counts of the RepLKnet, accompanied by merely a 4.04% reduction in Top1 accuracy and a 0.15% decrease in Top5 accuracy.

Authors

Publication Details

Published
2024-12-27
DOI
https://doi.org/10.1109/eiecc64539.2024.10929238
Citations
1
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.25
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Lightweight Convolutional Network Based on RepLKnet and Ghost Convolution

Xiying Huang, Ruixiong Ma, Lan Pang, Feiyang Xue
1 citations
Advanced Neural Network Applications
0.25
article

A Lightweight Convolutional Network Based on RepLKnet and Ghost Convolution

Xiying Huang, Ruixiong Ma, Lan Pang, Feiyang Xue
article en
1 citations

Abstract

Over the past two years, convolutional neural networks have witnessed a resurgence in the domain of computer vision, owing to the contemporary design of large convolutional kernels and the corresponding optimization techniques. Nevertheless, these large kernel convolutional neural networks primarily concentrate on enlarging the size of the convolutional kernel, while overlooking the significant amount of redundant information that emerges among the feature map channels as the convolutional kernel expands. With the aim of enhancing the computational efficiency of large convolutional kernel networks and enabling their application in more resource-constrained settings, this paper incorporates ghost convolution to modify the RepLK block, thereby effectively exploiting these redundancies. The validation outcomes on the CIFAR-100 dataset indicate that the lightweight and enhanced network model attains 4.32% of the FLOPs and 4.77% of the parameter counts of the RepLKnet, accompanied by merely a 4.04% reduction in Top1 accuracy and a 0.15% decrease in Top5 accuracy.

Openalex Percentile: Top 41%
Advanced Neural Network Applications
0.25
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Lightweight Convolutional Network Based on RepLKnet and Ghost Convolution — Xiying Huang, Ruixiong Ma, et al. · (2024) | TGRS Research Map | TGRS