Intelligent Sign Language Recognition for Real-Time Text Conversion to Aid Speech and Hearing Impaired

This research presents an innovative system for converting sign language into text using an Arduino UNO-IoT platform and a custom-designed glove equipped with finger flex sensors. The flex sensors detect the bending angles of the fingers, generating real-time data corresponding to different sign language gestures. These signals are processed by the Arduino to interpret gestures, which are then displayed as text on a 16x2 LCD screen. The system is designed to improve communication for the hearing and speech impaired, providing a low-cost, portable, and user-friendly solution for converting hand gestures into readable text. Technical findings show that the system achieves an average accuracy of 85% for simple gestures and 75% for complex gestures, with consistent performance across multiple users. Results were analyzed in terms of angular displacement, sensor resistance, and gesture type recognition. The system effectively bridges the communication gap between sign language users and the general public, offering enhanced accessibility through IoT integration.

Authors

Institutions

Publication Details

Journal
Procedia Computer Science
Published
2025-01-01
DOI
https://doi.org/10.1016/j.procs.2025.04.102
Citations
2
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
3.87
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Intelligent Sign Language Recognition for Real-Time Text Conversion to Aid Speech and Hearing Impaired

K. Suthendran, M Bharath Kumar, Nishit Malviya, Shubham Anjankar et al.
2 citations
Procedia Computer Science
Hand Gesture Recognition Systems
3.87
article

Intelligent Sign Language Recognition for Real-Time Text Conversion to Aid Speech and Hearing Impaired

K. Suthendran, M Bharath Kumar, Nishit Malviya, Shubham Anjankar, Divya Kiran, Abhishek Tripathi, Dinesh Chandra, Arjun Ram
article en
2 citations

Abstract

This research presents an innovative system for converting sign language into text using an Arduino UNO-IoT platform and a custom-designed glove equipped with finger flex sensors. The flex sensors detect the bending angles of the fingers, generating real-time data corresponding to different sign language gestures. These signals are processed by the Arduino to interpret gestures, which are then displayed as text on a 16x2 LCD screen. The system is designed to improve communication for the hearing and speech impaired, providing a low-cost, portable, and user-friendly solution for converting hand gestures into readable text. Technical findings show that the system achieves an average accuracy of 85% for simple gestures and 75% for complex gestures, with consistent performance across multiple users. Results were analyzed in terms of angular displacement, sensor resistance, and gesture type recognition. The system effectively bridges the communication gap between sign language users and the general public, offering enhanced accessibility through IoT integration.

Procedia Computer ScienceVol. 259
Indian Institute of Information Technology Allahabad (IN), Indian Institute of Management Ranchi (IN), Kalasalingam Academy of Research and Education (IN)
Reduced inequalities
Openalex Percentile: Top 8%
Hand Gesture Recognition Systems
3.87
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.