Integrating Deep Learning and Python for Effective Sign Language Recognition

The advancement in technology has improved the accessibility of communications for a person with hearing impairment significantly. A full implementation approach for sign language recognition is provided based on deep learning techniques implemented in Python. Several neural network architectures have been explored to achieve a level of high accuracy in the recognition of ASL gestures from video data based on CNNs and LSTM networks. The dataset for this is pretty diverse sign language gestures, like there is a sign language gesture describing ‘cow’ and then another describing ‘panda’. The two models are then trained and tested based on the whole dataset. Apart from training and testing, we also discuss preprocessing techniques, data augmentation, optimization strategies to improve the performance of the model. We prove that the proposed system, in fact, is a real-time sign language recognition system, providing an intuitive interface for the users. Results indicate, therefore, a good integration extent of the deep learning frameworks with Python and bring considerable improvements concerning accuracy and efficiency of sign language interpretation-all leading to better communication and inclusion in cases among the deaf and hardof-hearing community.

Authors

Institutions

Publication Details

Published
2024-12-27
DOI
https://doi.org/10.1109/icpids65698.2024.00082
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Integrating Deep Learning and Python for Effective Sign Language Recognition

Suman Chaudhary, Shivani Pathania, Jose Anand, Devanshu Garg et al.
Hand Gesture Recognition Systems
article

Integrating Deep Learning and Python for Effective Sign Language Recognition

Suman Chaudhary, Shivani Pathania, Jose Anand, Devanshu Garg, Raj Kumar, Vikas Phluriya
article en

Abstract

The advancement in technology has improved the accessibility of communications for a person with hearing impairment significantly. A full implementation approach for sign language recognition is provided based on deep learning techniques implemented in Python. Several neural network architectures have been explored to achieve a level of high accuracy in the recognition of ASL gestures from video data based on CNNs and LSTM networks. The dataset for this is pretty diverse sign language gestures, like there is a sign language gesture describing ‘cow’ and then another describing ‘panda’. The two models are then trained and tested based on the whole dataset. Apart from training and testing, we also discuss preprocessing techniques, data augmentation, optimization strategies to improve the performance of the model. We prove that the proposed system, in fact, is a real-time sign language recognition system, providing an intuitive interface for the users. Results indicate, therefore, a good integration extent of the deep learning frameworks with Python and bring considerable improvements concerning accuracy and efficiency of sign language interpretation-all leading to better communication and inclusion in cases among the deaf and hardof-hearing community.

Chandigarh University (IN)
Quality Education
Openalex Percentile: Top 70%
Hand Gesture Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Integrating Deep Learning and Python for Effective Sign Language Recognition — Suman Chaudhary, Shivani Pathania, et al. · (2024) | TGRS Research Map | TGRS