Efficient American Sign Language Recognition Using Resnet-50

This study presents a robust and efficient American Sign Language (ASL) recognition system utilizing the ResNet50 architecture with transfer learning. The system is designed to accurately classify 26 static ASL alphabet gestures while tackling challenges such as hand shape variations, varying lighting conditions, and a limited dataset size. To enhance performance and reduce overfitting, data augmentation methods including rotation and horizontal flipping were applied. By leveraging transfer learning from a pre-trained ResNet-50 model, the proposed approach benefits from shorter training times and reduced computational demands without compromising accuracy. Experimental results show the system achieves an overall accuracy of 98.34 %, along with balanced precision, recall, and F1-scores across all gesture classes. Additionally, early stopping mechanisms were implemented to prevent overfitting and ensure generalization to unseen data. This work contributes to the advancement of deep learning-based models for ASL recognition and supports the development of inclusive communication technologies that foster seamless interaction between hearing and non-hearing communities.

Authors

Institutions

Publication Details

Published
2025-05-06
DOI
https://doi.org/10.1109/iceast64767.2025.11088186
Citations
2
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
3.87
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Efficient American Sign Language Recognition Using Resnet-50

Tze Hui Liew, Md. Jakir Hossen, Debanjon Dutta Purkaystha, Jayanta K. Ghosh et al.
2 citations
Hand Gesture Recognition Systems
3.87
article

Efficient American Sign Language Recognition Using Resnet-50

Tze Hui Liew, Md. Jakir Hossen, Debanjon Dutta Purkaystha, Jayanta K. Ghosh, M Sharifuzzaman, Anik Sen, Masud Pervez, Saptanil Ghose
article en
2 citations

Abstract

This study presents a robust and efficient American Sign Language (ASL) recognition system utilizing the ResNet50 architecture with transfer learning. The system is designed to accurately classify 26 static ASL alphabet gestures while tackling challenges such as hand shape variations, varying lighting conditions, and a limited dataset size. To enhance performance and reduce overfitting, data augmentation methods including rotation and horizontal flipping were applied. By leveraging transfer learning from a pre-trained ResNet-50 model, the proposed approach benefits from shorter training times and reduced computational demands without compromising accuracy. Experimental results show the system achieves an overall accuracy of 98.34 %, along with balanced precision, recall, and F1-scores across all gesture classes. Additionally, early stopping mechanisms were implemented to prevent overfitting and ensure generalization to unseen data. This work contributes to the advancement of deep learning-based models for ASL recognition and supports the development of inclusive communication technologies that foster seamless interaction between hearing and non-hearing communities.

American International University-Bangladesh (BD), Trine University (US), Multimedia University (MY), Jessore University of Science and Technology (BD), Jahangirnagar University (BD)
Openalex Percentile: Top 7%
Hand Gesture Recognition Systems
3.87
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.