Comparative Analysis of Transformer and CNN in Image Recognition Applications

Convolutional Neural Network (CNN) and Transformer are two mainstream model architectures for deep learning in image recognition and classification tasks. The purpose of this paper is to explore the performance differences between the two through comparative experiments, so as to provide more comprehensive guidance for model selection. In this paper, the Residual Neural Network (ResNet) and Vision Transformer (ViT) are selected. As a representative, the performance of the two in shallow and deep layers was compared from the perspectives of theoretical analysis and experimental results. The results show that the Transformer performs well in shallow networks and is suitable for handling tasks that require global feature capture. CNN, on the other hand, gradually exert their feature extraction capabilities in deep networks, which are suitable for processing complex image classification tasks. This study not only provides scientific guidance for the model selection of image recognition and classification tasks, but also helps to promote more efficient algorithm design and promote the wide application of computer vision technology in various industries.

Authors

Institutions

Publication Details

Published
2024-10-23
DOI
https://doi.org/10.1109/iccasit62299.2024.10827955
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Comparative Analysis of Transformer and CNN in Image Recognition Applications

Yurui Yang, Ran Xiao, Kejun Chen, Yili Sun et al.
Neural Networks and Applications
article

Comparative Analysis of Transformer and CNN in Image Recognition Applications

Yurui Yang, Ran Xiao, Kejun Chen, Yili Sun, Shuai Tu, Ran Mei
article en

Abstract

Convolutional Neural Network (CNN) and Transformer are two mainstream model architectures for deep learning in image recognition and classification tasks. The purpose of this paper is to explore the performance differences between the two through comparative experiments, so as to provide more comprehensive guidance for model selection. In this paper, the Residual Neural Network (ResNet) and Vision Transformer (ViT) are selected. As a representative, the performance of the two in shallow and deep layers was compared from the perspectives of theoretical analysis and experimental results. The results show that the Transformer performs well in shallow networks and is suitable for handling tasks that require global feature capture. CNN, on the other hand, gradually exert their feature extraction capabilities in deep networks, which are suitable for processing complex image classification tasks. This study not only provides scientific guidance for the model selection of image recognition and classification tasks, but also helps to promote more efficient algorithm design and promote the wide application of computer vision technology in various industries.

Changchun University of Science and Technology (CN), Shandong University (CN), Sichuan University (CN), Shenzhen Technology University (CN), Arizona State University (US), University of Westminster (GB)
Openalex Percentile: Top 77%
Neural Networks and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Comparative Analysis of Transformer and CNN in Image Recognition Applications — Yurui Yang, Ran Xiao, et al. · (2024) | TGRS Research Map | TGRS