Real-Time Hand Sign Language Translation: Text and Speech Conversion

A real-time system that can decipher sign language from a live webcam stream is presented by the Sign Language Conversion Project. By using the Media Pipe library’s landmark identification capabilities, the project extracts crucial data from every frame, including hand landmarks. Following detection, the landmark coordinates are gathered and saved in a CSV file for later examination. This landmark data is used to train a Random Forest algorithm, which uses machine learning techniques to categorize various sign language patterns. The trained model predicts the sign language class and its probability in real-time during the processing of the webcam feed. Users get instant access to the subject’s sign language cues by superimposing the results over the live video feed. This work demonstrates the integration of computer vision and machine learning techniques to assess and comprehend nonverbal communication, with possible implications in human-computer interaction.

Authors

Publication Details

Published
2024-08-08
DOI
https://doi.org/10.1109/iccpct61902.2024.10673038
Citations
10
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
3.72
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Real-Time Hand Sign Language Translation: Text and Speech Conversion

Hariharan N. Krishnasamy, P Jeevanandham, G Keerthana, George Britt A
10 citations
Hand Gesture Recognition Systems
3.72
article

Real-Time Hand Sign Language Translation: Text and Speech Conversion

Hariharan N. Krishnasamy, P Jeevanandham, G Keerthana, George Britt A
article en
10 citations

Abstract

A real-time system that can decipher sign language from a live webcam stream is presented by the Sign Language Conversion Project. By using the Media Pipe library’s landmark identification capabilities, the project extracts crucial data from every frame, including hand landmarks. Following detection, the landmark coordinates are gathered and saved in a CSV file for later examination. This landmark data is used to train a Random Forest algorithm, which uses machine learning techniques to categorize various sign language patterns. The trained model predicts the sign language class and its probability in real-time during the processing of the webcam feed. Users get instant access to the subject’s sign language cues by superimposing the results over the live video feed. This work demonstrates the integration of computer vision and machine learning techniques to assess and comprehend nonverbal communication, with possible implications in human-computer interaction.

Quality Education
Openalex Percentile: Top 7%
Hand Gesture Recognition Systems
3.72
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.