AI-BASED REAL-TIME SIGN LANGUAGE TRANSLATORS
ABSTRACT Sign language serves as a vital communication method for individuals who are deaf or have hearing impairments. It relies on hand gestures, facial cues, and body language to convey messages and express meaning. However, many people who don’t know sign language find it hard to communicate with sign language users. The latest progress in artificial intelligence and computing has enabled the creation of systems that can automatically recognize sign language. These systems can help recognize hand gestures in real-time, making it easier for individuals with hearing difficulties to communicate. Traditionally, recognizing gestures required special equipment like sensors or cameras, which could be expensive and not widely available. Now, using deep learning and computer vision techniques, we can recognize gestures directly from regular webcam feeds, which is more affordable and accessible. In our project, we created a real-time hand gesture recognition system that uses a webcam to capture hand signs and processes them with a deep learning model. It then converts these gestures into text and voice outputs. This system aims to help people with hearing and speech challenges by providing a simple communication tool. Our paper explains how the system works, how we built it, and how well it performs. The findings indicate that deep learning is capable of accurately identifying hand gestures, thereby enhancing communication for individuals who are deaf or mute. Keywords: Hand Gesture Recognition, Sign Language Translation, Deep Learning, Computer Vision, CNN.
Institutions
- Indian Institute of Technology Roorkee (IN)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2025-06-12
- DOI
- https://doi.org/10.5281/zenodo.15647884
- Primary Topic
- Hand Gesture Recognition Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00