Sign Language Recognition System For The Deaf Using Mediapipe Based On The Long-Short Term Memory Method

As the world becomes increasingly digital, it is essential to develop inclusive technologies that bridge communication gaps, especially for individuals with hearing impairments. This research proposes a sign language recognition system utilizing Mediapipe for hand detection and Long Short-Term Memory (LSTM) networks for gesture recognition. The primary goal of this study is to accurately track and classify hand movements associated with Indonesian Sign Language (BISINDO), focusing on two-handed gestures. By leveraging Mediapipe for real-time hand tracking and LSTM for recognizing temporal dynamics, this system is capable of recognizing sign language with high accuracy across varied environmental conditions. Experimental results demonstrate the system's robust performance, with testing accuracy reaching up to 95% under controlled conditions. This research contributes to the field of non-verbal communication by enhancing the accessibility of sign language recognition technology and provides a foundation for future advancements in pattern recognition for real-time applications. Additionally, it addresses the challenges of lighting, viewpoint variation, and environmental noise, offering potential solutions for the deployment of sign language recognition systems in real-world scenarios.

Authors

Institutions

Publication Details

Published
2024-12-12
DOI
https://doi.org/10.1109/icitsi65188.2024.10929393
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Sign Language Recognition System For The Deaf Using Mediapipe Based On The Long-Short Term Memory Method

Deni Setiana, Hadi Setiawan, Glory Cornelia Patining Kurik
Hand Gesture Recognition Systems
article

Sign Language Recognition System For The Deaf Using Mediapipe Based On The Long-Short Term Memory Method

Deni Setiana, Hadi Setiawan, Glory Cornelia Patining Kurik
article en

Abstract

As the world becomes increasingly digital, it is essential to develop inclusive technologies that bridge communication gaps, especially for individuals with hearing impairments. This research proposes a sign language recognition system utilizing Mediapipe for hand detection and Long Short-Term Memory (LSTM) networks for gesture recognition. The primary goal of this study is to accurately track and classify hand movements associated with Indonesian Sign Language (BISINDO), focusing on two-handed gestures. By leveraging Mediapipe for real-time hand tracking and LSTM for recognizing temporal dynamics, this system is capable of recognizing sign language with high accuracy across varied environmental conditions. Experimental results demonstrate the system's robust performance, with testing accuracy reaching up to 95% under controlled conditions. This research contributes to the field of non-verbal communication by enhancing the accessibility of sign language recognition technology and provides a foundation for future advancements in pattern recognition for real-time applications. Additionally, it addresses the challenges of lighting, viewpoint variation, and environmental noise, offering potential solutions for the deployment of sign language recognition systems in real-world scenarios.

Padjadjaran University (ID)
Quality Education
Openalex Percentile: Top 71%
Hand Gesture Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.