SignMate : Real-Time Speech to Sign Language Translation

Sign language is the primary mode of communication for the deaf and hard-of-hearing community. However, the lack of widespread knowledge of sign language among the general population creates a significant communication barrier. SignMate aims to bridge this gap by developing a real-time speech-to-sign language translation system using deep learning techniques. The system leverages automatic speech recognition using Whisper, natural language processing for text processing, and a video-based approach to display corresponding American Sign Language and Indian Sign Language video clips. The paper details the methodologies used, challenges encountered, and the effectiveness of the system in improving accessibility and inclusivity for the deaf and hard-of-hearing community.