An Artificial Intelligence-based Sign Language Recognition using Attention-Enhanced Long Short-Term Memory Networks

Sign language recognition is essential for enabling communication between the deaf-mute community and the broader population, helping to bridge significant communication barriers. Current techniques tend to use expensive sensors or custom hardware, but this research provides a low cost, AI approach to sign language recognition using video input. An AI model has been proposed in this work that utilizes a self-curated dataset of 14 essential gestures, designed to capture a wide range of commonly used expressions, and employs an LSTM network enhanced with an attention mechanism to capture temporal dependencies. This method allows the model to concentrate on the key frames in the gesture sequences, and can recognize much better, without having to have a lot of processing power. The proposed model achieved an accuracy of 92.1% across 14 gesture classes, demonstrating the feasibility of an efficient and accessible sign language recognition system. This work provides a foundational step toward accessible communication tools for the deaf-mute community, encouraging broader adoption through mobile and low-cost devices.

Authors

Institutions

Publication Details

Published
2025-04-17
DOI
https://doi.org/10.1109/incacct65424.2025.11011456
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Artificial Intelligence-based Sign Language Recognition using Attention-Enhanced Long Short-Term Memory Networks

Rakesh Chandra Joshi, Paurush Bhulania, Malay Kishore Dutta, Vansh Tiwari et al.
1 links
Hand Gesture Recognition Systems
article

An Artificial Intelligence-based Sign Language Recognition using Attention-Enhanced Long Short-Term Memory Networks

Rakesh Chandra Joshi, Paurush Bhulania, Malay Kishore Dutta, Vansh Tiwari, Tushar Vij
article en

Abstract

Sign language recognition is essential for enabling communication between the deaf-mute community and the broader population, helping to bridge significant communication barriers. Current techniques tend to use expensive sensors or custom hardware, but this research provides a low cost, AI approach to sign language recognition using video input. An AI model has been proposed in this work that utilizes a self-curated dataset of 14 essential gestures, designed to capture a wide range of commonly used expressions, and employs an LSTM network enhanced with an attention mechanism to capture temporal dependencies. This method allows the model to concentrate on the key frames in the gesture sequences, and can recognize much better, without having to have a lot of processing power. The proposed model achieved an accuracy of 92.1% across 14 gesture classes, demonstrating the feasibility of an efficient and accessible sign language recognition system. This work provides a foundational step toward accessible communication tools for the deaf-mute community, encouraging broader adoption through mobile and low-cost devices.

Amity University (IN)
Openalex Percentile: Top 89%
Hand Gesture Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

An Artificial Intelligence-based Sign Language Recognition using Attention-Enhanced Long Short-Term Memory Networks — Rakesh Chandra Joshi, Paurush Bhulania, et al. · (2025) | TGRS Research Map | TGRS