Efficiency and Adaptability of Deep Learning Architectures: A Performance Comparison of CNN, Transformer, and Hybrid Models

Innovations in deep learning architectures are driving a paradigm shift in computer vision. While traditional convolutional neural networks (CNNs) have long dominated image tasks due to their local perceptual advantages, the Transformer has rapidly penetrated the vision domain after emerging in natural language processing through its global attention mechanism. However, the high computational complexity and data dependency of the Transformer limit its practical applications. This study systematically compares the differences in computational efficiency, number of parameters, and task adaptability among CNN (ResNet-50), Transformer (ViT-B/16), and hybrid architecture (ConvNeXt-T) in the context of architecture evolution. The experimental results show that ConvNeXt-T architecture exhibits excellent performance on several standard datasets. The hybrid architecture demonstrates significant advantages in edge device deployment scenarios by fusing local convolution with global attention. The findings of the study offer empirical support for the selection of models in resource-limited settings and indicate pathways for the optimization of multimodal models.

Authors

Institutions

Publication Details

Published
2025-08-15
DOI
https://doi.org/10.1109/cvaa66438.2025.11193320
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Efficiency and Adaptability of Deep Learning Architectures: A Performance Comparison of CNN, Transformer, and Hybrid Models

Miaomiao Yang
Neural Networks and Applications
article

Efficiency and Adaptability of Deep Learning Architectures: A Performance Comparison of CNN, Transformer, and Hybrid Models

Miaomiao Yang
article en

Abstract

Innovations in deep learning architectures are driving a paradigm shift in computer vision. While traditional convolutional neural networks (CNNs) have long dominated image tasks due to their local perceptual advantages, the Transformer has rapidly penetrated the vision domain after emerging in natural language processing through its global attention mechanism. However, the high computational complexity and data dependency of the Transformer limit its practical applications. This study systematically compares the differences in computational efficiency, number of parameters, and task adaptability among CNN (ResNet-50), Transformer (ViT-B/16), and hybrid architecture (ConvNeXt-T) in the context of architecture evolution. The experimental results show that ConvNeXt-T architecture exhibits excellent performance on several standard datasets. The hybrid architecture demonstrates significant advantages in edge device deployment scenarios by fusing local convolution with global attention. The findings of the study offer empirical support for the selection of models in resource-limited settings and indicate pathways for the optimization of multimodal models.

North China University of Water Resources and Electric Power (CN)
Openalex Percentile: Top 85%
Neural Networks and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Efficiency and Adaptability of Deep Learning Architectures: A Performance Comparison of CNN, Transformer, and Hybrid Models — Miaomiao Yang · (2025) | TGRS Research Map | TGRS