Real-Time Gesture-to-Speech Conversion System for Mute Person
This study introduces a machine learning-based system that assists mute individuals by recognizing real time hand gesture using a convolutional neural network (CNN). Captured via a laptop camera, these gestures are converted into text or speech for accessible non-verbal communication. The model is trained on a large dataset, accurately identifies various gestures, such as a raised finger indicating a need for food. A user-friendly camera window dashboard displays real-time results, ensuring practicality for daily use. The system boasts high accuracy and quick response times, making it effective for real-time interactions. Future enhancements may include expanding gesture recognition and improving robustness, advancing assistive technology for better communication.
Authors
- Archana Ratnaparakhi
- Vinay Waghmare
- Pallavi Deshpande
- Om Kale
- Madhav Vaidya (ORCID: https://orcid.org/0000-0002-6256-7200)
- Adnan Shaikh (ORCID: https://orcid.org/0000-0002-5974-6718)
Publication Details
- Published
- 2024-12-13
- DOI
- https://doi.org/10.1109/punecon63413.2024.10895936
- Primary Topic
- Hand Gesture Recognition Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00