Sign Language Translator: A Comparative Analysis of Deep Learning and Machine Learning Models

Worldwide, deaf mute people interaction with people who do not know the sign language is quite hard. Even though gestures constitute the main source of communication of the deaf and the mute, many hearing people do not have the ability to read normal signs. To minimize this shortcoming, the Sign Language Translator intends to utilize advanced technologies including deep learning, computer vision as well as machine learning to convert sign language to either oral speech or written text. This system performs the instantaneous conversion of sign language into text thereby promoting contacts and the free interaction of disabled and able people. Our approach is not only arrived at from implanting existing methods on a custom dataset but also uses a larger and richer dataset, WLASL (Word-Level American Sign Language) thus enhancing model performance. Four machine learning models are borrowed in this project: Long Short-Term Memory (LSTM) captures and recalls information over longer periods, Convolution Neural Networks (CNN)samples and analysis parts of images to retrieve spatial information, Random Forest Classifier implements learning using models based on a decision tree, and Support Vector Machine (SVM) is a supervised learning technique used to classify data of high dimensionality. With these models in place, we seek to improve the precision and utility of sign language interpretation.

Authors

Institutions

Publication Details

Published
2024-11-07
DOI
https://doi.org/10.1109/icisct64202.2024.10957050
Citations
1
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
0.37
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Sign Language Translator: A Comparative Analysis of Deep Learning and Machine Learning Models

Gunjan Aggarwal, Neha Reddy, Kanika Agarwal, Jeffy Finny
1 citations
Hand Gesture Recognition Systems
0.37
article

Sign Language Translator: A Comparative Analysis of Deep Learning and Machine Learning Models

Gunjan Aggarwal, Neha Reddy, Kanika Agarwal, Jeffy Finny
article en
1 citations

Abstract

Worldwide, deaf mute people interaction with people who do not know the sign language is quite hard. Even though gestures constitute the main source of communication of the deaf and the mute, many hearing people do not have the ability to read normal signs. To minimize this shortcoming, the Sign Language Translator intends to utilize advanced technologies including deep learning, computer vision as well as machine learning to convert sign language to either oral speech or written text. This system performs the instantaneous conversion of sign language into text thereby promoting contacts and the free interaction of disabled and able people. Our approach is not only arrived at from implanting existing methods on a custom dataset but also uses a larger and richer dataset, WLASL (Word-Level American Sign Language) thus enhancing model performance. Four machine learning models are borrowed in this project: Long Short-Term Memory (LSTM) captures and recalls information over longer periods, Convolution Neural Networks (CNN)samples and analysis parts of images to retrieve spatial information, Random Forest Classifier implements learning using models based on a decision tree, and Support Vector Machine (SVM) is a supervised learning technique used to classify data of high dimensionality. With these models in place, we seek to improve the precision and utility of sign language interpretation.

Sharda University (IN)
Quality Education
Openalex Percentile: Top 34%
Hand Gesture Recognition Systems
0.37
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.