Harnessing AIML for Real-Time Conversion of Sign Language to Improve Web Accessibility

Access to information is a crucial aspect of modern digital life, particularly for individuals who rely on sign language for communication. This paper introduces a real-time extension that translates sign language gestures into text, providing an inclusive solution for individuals with speech disabilities. The system uses advanced computer vision and deep learning techniques, employing a Convolutional Neural Network (CNN) trained on a diverse dataset of American Sign Language (ASL) gestures. The technology records hand movements using a webcam, processes them in real time, and converts them into textual data for seamless online interactions, including web searches. This solution mirrors the simplicity and convenience of voice-command systems, offering a user-friendly and accessible interface. The innovation lies in its incorporating gesture recognition with web interaction capabilities, achieving notable improvements in usability and accuracy. With validation results exceeding 99% accuracy, the system demonstrates robustness under various conditions, bridging communication gaps and clearing the path for future developments, including multilingual sign language support and expanded accessibility features.

Authors

Institutions

Publication Details

Published
2024-12-17
DOI
https://doi.org/10.1109/icicnis64247.2024.10823269
Citations
2
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
0.74
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Harnessing AIML for Real-Time Conversion of Sign Language to Improve Web Accessibility

P Prema, M Elakkiya, R. P. Harshini, S Aishwariya
2 citations
Hand Gesture Recognition Systems
0.74
article

Harnessing AIML for Real-Time Conversion of Sign Language to Improve Web Accessibility

P Prema, M Elakkiya, R. P. Harshini, S Aishwariya
article en
2 citations

Abstract

Access to information is a crucial aspect of modern digital life, particularly for individuals who rely on sign language for communication. This paper introduces a real-time extension that translates sign language gestures into text, providing an inclusive solution for individuals with speech disabilities. The system uses advanced computer vision and deep learning techniques, employing a Convolutional Neural Network (CNN) trained on a diverse dataset of American Sign Language (ASL) gestures. The technology records hand movements using a webcam, processes them in real time, and converts them into textual data for seamless online interactions, including web searches. This solution mirrors the simplicity and convenience of voice-command systems, offering a user-friendly and accessible interface. The innovation lies in its incorporating gesture recognition with web interaction capabilities, achieving notable improvements in usability and accuracy. With validation results exceeding 99% accuracy, the system demonstrates robustness under various conditions, bridging communication gaps and clearing the path for future developments, including multilingual sign language support and expanded accessibility features.

Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology (IN)
Openalex Percentile: Top 26%
Hand Gesture Recognition Systems
0.74
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.