Transformation of Sign Language to Text in Digital Era Using Deep Neural Network

Sign language is a vital means of communication for the deaf and hard-of-hearing community, yet persistent communication barriers exist due to a lack of effective sign language interpretation tools. To address this, our study proposes “Sign2Text,” a Deep learning-based approach that recognizes and translates sign language into text in real-time, utilizing deep learning (DL) and computer vision methods with convolutional neural networks (CNNs) and SVM. ASL Dataset is considered in this research. The proposed architecture consists of hand segmentation and tracking, feature extraction using CNNs- MobileNetV1, sequence modelling and classification using SVM, Our model achieved an accuracy of 99.5% in recognizing individual signs and correctly predicted sign language sentences into text, thereby enhancing communication accessibility for the deaf and hard-ofhearing community.

Authors

Publication Details

Published
2024-12-22
DOI
https://doi.org/10.1109/cicn63059.2024.10847557
Citations
3
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
1.12
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Transformation of Sign Language to Text in Digital Era Using Deep Neural Network

Arjun Babu, Mohebbanaaz, Y Siva Himaja, Sugala Stuthi et al.
3 citations
Hand Gesture Recognition Systems
1.12
article

Transformation of Sign Language to Text in Digital Era Using Deep Neural Network

Arjun Babu, Mohebbanaaz, Y Siva Himaja, Sugala Stuthi, B Mamatha
article en
3 citations

Abstract

Sign language is a vital means of communication for the deaf and hard-of-hearing community, yet persistent communication barriers exist due to a lack of effective sign language interpretation tools. To address this, our study proposes “Sign2Text,” a Deep learning-based approach that recognizes and translates sign language into text in real-time, utilizing deep learning (DL) and computer vision methods with convolutional neural networks (CNNs) and SVM. ASL Dataset is considered in this research. The proposed architecture consists of hand segmentation and tracking, feature extraction using CNNs- MobileNetV1, sequence modelling and classification using SVM, Our model achieved an accuracy of 99.5% in recognizing individual signs and correctly predicted sign language sentences into text, thereby enhancing communication accessibility for the deaf and hard-ofhearing community.

Quality Education
Openalex Percentile: Top 20%
Hand Gesture Recognition Systems
1.12
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.