Real-time Gesture Recognition for Sign Language Communication with CNN

Communicating with hearing-impaired people is difficult. Meeting society's requirements requires developing systems that can recognize indications and notify people. Deaf-mute people now have better support thanks to sign language. Sign language-using hearing-impaired persons can enhance their communication and social skills with real-time gesture detection devices. The author presents a full CNN-based, real-time sign language recognition approach in this research. This system includes data collecting, preprocessing, architectural design, training, and real-time deployment. CNNs are trained on a vast and diverse sign language motion dataset. To increase model generalizability across signals and contexts, data preparation generally includes normalization, scaling, and augmentation. For optimal picture recognition, the CNN architecture is thoroughly trained and verified. A real-time video processing pipeline captures and prepares frames for CNN-based recognition. The model uses quantization and hardware acceleration for real-time performance to enhance efficiency. User-friendly interfaces make the system accessible to hearing-impaired people. Testing and assessment have shown the system's accuracy and resilience, permitting its actual deployment. Continuous improvement involves monitoring system performance and altering the model to fix issues and improve usability.

Authors

Institutions

Publication Details

Published
2024-09-20
DOI
https://doi.org/10.1109/icdscnc62492.2024.10939228
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Real-time Gesture Recognition for Sign Language Communication with CNN

A. Jayashree, S. Valli, Kamal Raj T, J. C. et al.
Hand Gesture Recognition Systems
article

Real-time Gesture Recognition for Sign Language Communication with CNN

A. Jayashree, S. Valli, Kamal Raj T, J. C., K. Pandiyan, Y. Monikarchana
article en

Abstract

Communicating with hearing-impaired people is difficult. Meeting society's requirements requires developing systems that can recognize indications and notify people. Deaf-mute people now have better support thanks to sign language. Sign language-using hearing-impaired persons can enhance their communication and social skills with real-time gesture detection devices. The author presents a full CNN-based, real-time sign language recognition approach in this research. This system includes data collecting, preprocessing, architectural design, training, and real-time deployment. CNNs are trained on a vast and diverse sign language motion dataset. To increase model generalizability across signals and contexts, data preparation generally includes normalization, scaling, and augmentation. For optimal picture recognition, the CNN architecture is thoroughly trained and verified. A real-time video processing pipeline captures and prepares frames for CNN-based recognition. The model uses quantization and hardware acceleration for real-time performance to enhance efficiency. User-friendly interfaces make the system accessible to hearing-impaired people. Testing and assessment have shown the system's accuracy and resilience, permitting its actual deployment. Continuous improvement involves monitoring system performance and altering the model to fix issues and improve usability.

Rajarajeswari Medical College and Hospital (IN), Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology (IN), SRM Institute of Science and Technology (IN)
Openalex Percentile: Top 71%
Hand Gesture Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Real-time Gesture Recognition for Sign Language Communication with CNN — A. Jayashree, S. Valli, et al. · (2024) | TGRS Research Map | TGRS