Visual deep learning approaches for alphabetic sign language interpretation

Sign language plays a vital role in enabling interaction for individuals with hearing and speech impairment, making accurate alphabet-level recognition a fundamental requirement for accessible human-computer interaction systems. This paper investigates visual deep learning approaches for interpreting sign language alphabets from image data. A systematic framework is developed to assess the effectiveness of transfer learning-based convolutional neural networks in capturing discriminative hand gesture features. Using a benchmark American Sign Language (ASL) alphabet dataset, several advanced architectures, including ConvNeXtXLarge, EfficientNet, VGG19, and ResNet-50, are examined under a unified experimental protocol. The comparative analysis reveals that ConvNeXtXLarge achieves the uppermost recognition performance, attaining an accuracy of 99.81%, while EfficientNet, VGG19, and ResNet-50 also demonstrate strong results with accuracy of 99.68%, 99.31%, and 97.29%, respectively. These findings emphasize the effectiveness of modern transfer learning strategies in enhancing visual representation learning for fine-grained motion recognition. The proposed evaluation framework offers practical insights into model selection for scalable and reliable sign language interpretation systems, contributing to the advancement of inclusive assistive technologies and real-world visual language understanding applications.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-06-13
DOI
https://doi.org/10.1038/s41598-026-57945-w
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Visual deep learning approaches for alphabetic sign language interpretation

Zul Hilmi Abdullah, Muhammad Umair, Joy Dewanjee, Shahid Kamal et al.
Scientific Reports
Hand Gesture Recognition Systems
article

Visual deep learning approaches for alphabetic sign language interpretation

Zul Hilmi Abdullah, Muhammad Umair, Joy Dewanjee, Shahid Kamal, Miso Dhar, Yasir Ullah, Joyonta Kumar Nath, S. A. Mahadi Alam
article en

Abstract

Sign language plays a vital role in enabling interaction for individuals with hearing and speech impairment, making accurate alphabet-level recognition a fundamental requirement for accessible human-computer interaction systems. This paper investigates visual deep learning approaches for interpreting sign language alphabets from image data. A systematic framework is developed to assess the effectiveness of transfer learning-based convolutional neural networks in capturing discriminative hand gesture features. Using a benchmark American Sign Language (ASL) alphabet dataset, several advanced architectures, including ConvNeXtXLarge, EfficientNet, VGG19, and ResNet-50, are examined under a unified experimental protocol. The comparative analysis reveals that ConvNeXtXLarge achieves the uppermost recognition performance, attaining an accuracy of 99.81%, while EfficientNet, VGG19, and ResNet-50 also demonstrate strong results with accuracy of 99.68%, 99.31%, and 97.29%, respectively. These findings emphasize the effectiveness of modern transfer learning strategies in enhancing visual representation learning for fine-grained motion recognition. The proposed evaluation framework offers practical insights into model selection for scalable and reliable sign language interpretation systems, contributing to the advancement of inclusive assistive technologies and real-world visual language understanding applications.

Scientific Reports
International Islamic University Chittagong (BD), Multimedia University (MY), University of Southern Queensland (AU), Green University of Bangladesh (BD), University of Science and Technology Chittagong (BD)
Reduced inequalities
Openalex Percentile: Top 4%
Hand Gesture Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Visual deep learning approaches for alphabetic sign language interpretation — Zul Hilmi Abdullah, Muhammad Umair, et al. · Scientific Reports (2026) | TGRS Research Map | TGRS