AI-Powered Sign Language Translation: Enhancing Communication with MediaPipe and Machine Learning

The rapid advancement of artificial intelligence (AI) and machine learning has transformed communication accessibility for deaf and hard-of-hearing individuals. This research investigates using Media Pipe and Long Short-Term Memory (LSTM) networks for real-time sign language translation, focusing on overcoming barriers in Arabic Sign Language (ArSL). The study employs a landmark-driven approach, extracting hand and pose features, achieving 99.46% accuracy on a 10,000-sample dataset. Despite its success, challenges include handling diverse signing styles and environmental variations, with limitations in low-light conditions and subtle gesture recognition. TensorFlow Lite enables efficient mobile deployment, though technical details like data storage formats are omitted for brevity. Future work will explore dataset expansion, enhanced temporal modeling, and multimodal integration to boost accuracy and accessibility. Ethical considerations underscore the need for responsible AI development in assistive technologies.

Authors

Institutions

Publication Details

Published
2025-08-18
DOI
https://doi.org/10.1109/gaclm67198.2025.11232389
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AI-Powered Sign Language Translation: Enhancing Communication with MediaPipe and Machine Learning

Mohammed Jassim Al Ansari, Yazan Alahmed, Ammar Al-Hawamdeh
Hand Gesture Recognition Systems
article

AI-Powered Sign Language Translation: Enhancing Communication with MediaPipe and Machine Learning

Mohammed Jassim Al Ansari, Yazan Alahmed, Ammar Al-Hawamdeh
article en

Abstract

The rapid advancement of artificial intelligence (AI) and machine learning has transformed communication accessibility for deaf and hard-of-hearing individuals. This research investigates using Media Pipe and Long Short-Term Memory (LSTM) networks for real-time sign language translation, focusing on overcoming barriers in Arabic Sign Language (ArSL). The study employs a landmark-driven approach, extracting hand and pose features, achieving 99.46% accuracy on a 10,000-sample dataset. Despite its success, challenges include handling diverse signing styles and environmental variations, with limitations in low-light conditions and subtle gesture recognition. TensorFlow Lite enables efficient mobile deployment, though technical details like data storage formats are omitted for brevity. Future work will explore dataset expansion, enhanced temporal modeling, and multimodal integration to boost accuracy and accessibility. Ethical considerations underscore the need for responsible AI development in assistive technologies.

Al Ain University (AE), University of Lancashire (GB)
Openalex Percentile: Top 65%
Hand Gesture Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.