Real Time Hand Sign Language Translation: Text and Speech Conversion

The Sign Language conversion project presents a real-time system that can interpret sign language from a live webcam feed. Leveraging the power of the Media pipe library for landmark detection, the project extracts vital information from each frame, including hand landmarks. The detected landmark coordinates are then collected and stored in a CSV file for further analysis. Using machine learning techniques, a Random Forest Classifier is trained on this landmark data to classify different sign language patterns. During the webcam feed processing, the trained model predicts the sign language class and its probability in real- time. The results are overlaid on the video stream, providing users with immediate insights into the subject's sign language cues. Key Words: Sign language recognition, Hand gesture recognition, Gesture-to-text conversion, Visual language processing.

Authors

Publication Details

Journal
INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT
Published
2024-08-09
DOI
https://doi.org/10.55041/ijsrem36998
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Real Time Hand Sign Language Translation: Text and Speech Conversion

Uppu Lokesh, M. Yasaswini, Arun M. A, S Sanjay
INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT
Hand Gesture Recognition Systems
article

Real Time Hand Sign Language Translation: Text and Speech Conversion

Uppu Lokesh, M. Yasaswini, Arun M. A, S Sanjay
article en

Abstract

The Sign Language conversion project presents a real-time system that can interpret sign language from a live webcam feed. Leveraging the power of the Media pipe library for landmark detection, the project extracts vital information from each frame, including hand landmarks. The detected landmark coordinates are then collected and stored in a CSV file for further analysis. Using machine learning techniques, a Random Forest Classifier is trained on this landmark data to classify different sign language patterns. During the webcam feed processing, the trained model predicts the sign language class and its probability in real- time. The results are overlaid on the video stream, providing users with immediate insights into the subject's sign language cues. Key Words: Sign language recognition, Hand gesture recognition, Gesture-to-text conversion, Visual language processing.

INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENTVol. 08(008)
Quality Education
Openalex Percentile: Top 87%
Hand Gesture Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.