Intelligent Sign Language Recognition for Real-Time Text Conversion to Aid Speech and Hearing Impaired
This research presents an innovative system for converting sign language into text using an Arduino UNO-IoT platform and a custom-designed glove equipped with finger flex sensors. The flex sensors detect the bending angles of the fingers, generating real-time data corresponding to different sign language gestures. These signals are processed by the Arduino to interpret gestures, which are then displayed as text on a 16x2 LCD screen. The system is designed to improve communication for the hearing and speech impaired, providing a low-cost, portable, and user-friendly solution for converting hand gestures into readable text. Technical findings show that the system achieves an average accuracy of 85% for simple gestures and 75% for complex gestures, with consistent performance across multiple users. Results were analyzed in terms of angular displacement, sensor resistance, and gesture type recognition. The system effectively bridges the communication gap between sign language users and the general public, offering enhanced accessibility through IoT integration.
Authors
- K. Suthendran (ORCID: https://orcid.org/0000-0002-7030-4398)
- M Bharath Kumar
- Nishit Malviya (ORCID: https://orcid.org/0000-0002-3949-4920)
- Shubham Anjankar (ORCID: https://orcid.org/0000-0002-1057-7343)
- Divya Kiran (ORCID: https://orcid.org/0000-0001-5925-5954)
- Abhishek Tripathi (ORCID: https://orcid.org/0000-0001-8197-3581)
- Dinesh Chandra
- Arjun Ram
Institutions
- Indian Institute of Information Technology Allahabad (IN)
- Indian Institute of Management Ranchi (IN)
- Kalasalingam Academy of Research and Education (IN)
Publication Details
- Journal
- Procedia Computer Science
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1016/j.procs.2025.04.102
- Citations
- 2
- Primary Topic
- Hand Gesture Recognition Systems
- Type
- article
- Field-Weighted Citation Impact
- 3.87