Real-Time Gesture-to-Speech Conversion System for Mute Person

This study introduces a machine learning-based system that assists mute individuals by recognizing real time hand gesture using a convolutional neural network (CNN). Captured via a laptop camera, these gestures are converted into text or speech for accessible non-verbal communication. The model is trained on a large dataset, accurately identifies various gestures, such as a raised finger indicating a need for food. A user-friendly camera window dashboard displays real-time results, ensuring practicality for daily use. The system boasts high accuracy and quick response times, making it effective for real-time interactions. Future enhancements may include expanding gesture recognition and improving robustness, advancing assistive technology for better communication.

Authors

Publication Details

Published
2024-12-13
DOI
https://doi.org/10.1109/punecon63413.2024.10895936
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Real-Time Gesture-to-Speech Conversion System for Mute Person

Archana Ratnaparakhi, Vinay Waghmare, Pallavi Deshpande, Om Kale et al.
Hand Gesture Recognition Systems
article

Real-Time Gesture-to-Speech Conversion System for Mute Person

Archana Ratnaparakhi, Vinay Waghmare, Pallavi Deshpande, Om Kale, Madhav Vaidya, Adnan Shaikh
article en

Abstract

This study introduces a machine learning-based system that assists mute individuals by recognizing real time hand gesture using a convolutional neural network (CNN). Captured via a laptop camera, these gestures are converted into text or speech for accessible non-verbal communication. The model is trained on a large dataset, accurately identifies various gestures, such as a raised finger indicating a need for food. A user-friendly camera window dashboard displays real-time results, ensuring practicality for daily use. The system boasts high accuracy and quick response times, making it effective for real-time interactions. Future enhancements may include expanding gesture recognition and improving robustness, advancing assistive technology for better communication.

Openalex Percentile: Top 72%
Hand Gesture Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.