Sign Language 2.0: Rethinking ASL Education for the Modern Age

American Sign Language is a non-verbal communication language that uses the motion of the hand and changes in hand shape to convey its meaning. It is the main mode of communication for those with hearing and language impairments. Sign language recognition helps a large number of people to communicate with regular people but there is a need to build an easy approach for these people so that they can learn in a better way and enhance their lives. This research focuses on the creation of a unique deep learning-based system for the recognition of American Sign Language (ASL). This system identifies 21 separate hand landmark coordinates by using Media Pipe to capture the complex dynamics of hand movements that are required for exact ASL communication. Recall, F1 Score, and Precision are used to validate the results of the experiments. The trained Deep Learning models have high generalization abilities with 98.2% classification accuracy towards 26 letters in the alphabet.

Authors

Institutions

Publication Details

Published
2024-11-14
DOI
https://doi.org/10.1109/incowoco64194.2024.10863052
Primary Topic
Hearing Impairment and Communication
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Sign Language 2.0: Rethinking ASL Education for the Modern Age

Kritarth Gupta, A M Rajurkar, Atharva Hardikar, Yashodhan Karulkar et al.
Hearing Impairment and Communication
article

Sign Language 2.0: Rethinking ASL Education for the Modern Age

Kritarth Gupta, A M Rajurkar, Atharva Hardikar, Yashodhan Karulkar, Artika Singh
article en

Abstract

American Sign Language is a non-verbal communication language that uses the motion of the hand and changes in hand shape to convey its meaning. It is the main mode of communication for those with hearing and language impairments. Sign language recognition helps a large number of people to communicate with regular people but there is a need to build an easy approach for these people so that they can learn in a better way and enhance their lives. This research focuses on the creation of a unique deep learning-based system for the recognition of American Sign Language (ASL). This system identifies 21 separate hand landmark coordinates by using Media Pipe to capture the complex dynamics of hand movements that are required for exact ASL communication. Recall, F1 Score, and Precision are used to validate the results of the experiments. The trained Deep Learning models have high generalization abilities with 98.2% classification accuracy towards 26 letters in the alphabet.

University of Mumbai (IN), Narsee Monjee Institute of Management Studies (IN)
Quality Education
Openalex Percentile: Top 66%
Hearing Impairment and Communication
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.