Real-Time Sign Language Recognition and Translation Using MediaPipe and Random Forests for Inclusive Communication

Communication barriers faced by deaf and speech-impaired individuals necessitate innovative solutions for effective interaction with the hearing community. This research proposes a novel approach to sign language recognition and translation by leveraging Random Forests and MediaPipe technology. MediaPipe facilitates real-time hand gesture tracking and extraction of hand landmarks crucial for sign language interpretation. Subsequently, a Random Forest classifier is employed to recognize the signs depicted by the tracked gestures accurately. Upon successful recognition, the system seamlessly translates the sign language into written words and text, fostering enhanced communication accessibility for the deaf and speech-impaired community. Integrating advanced machine learning techniques with real-time tracking technology offers promising avenues for breaking down communication barriers and promoting inclusivity.

Authors

Institutions

Publication Details

Published
2025-02-06
DOI
https://doi.org/10.1109/cictn64563.2025.10932602
Citations
3
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
5.81
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Real-Time Sign Language Recognition and Translation Using MediaPipe and Random Forests for Inclusive Communication

Aman Verma, H. C. Saini, Rishi Kumar, Guru Prasad M S et al.
3 citations
Hand Gesture Recognition Systems
5.81
article

Real-Time Sign Language Recognition and Translation Using MediaPipe and Random Forests for Inclusive Communication

Aman Verma, H. C. Saini, Rishi Kumar, Guru Prasad M S, G. L. Sharma, Prakshep Gusain
article en
3 citations

Abstract

Communication barriers faced by deaf and speech-impaired individuals necessitate innovative solutions for effective interaction with the hearing community. This research proposes a novel approach to sign language recognition and translation by leveraging Random Forests and MediaPipe technology. MediaPipe facilitates real-time hand gesture tracking and extraction of hand landmarks crucial for sign language interpretation. Subsequently, a Random Forest classifier is employed to recognize the signs depicted by the tracked gestures accurately. Upon successful recognition, the system seamlessly translates the sign language into written words and text, fostering enhanced communication accessibility for the deaf and speech-impaired community. Integrating advanced machine learning techniques with real-time tracking technology offers promising avenues for breaking down communication barriers and promoting inclusivity.

Graphic Era University (IN)
Reduced inequalities
Openalex Percentile: Top 5%
Hand Gesture Recognition Systems
5.81
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.