Generative AI for Text to Speech and Sign Language Translation
This paper presents the development of an AI-powered platform designed to enhance real-time communication for individuals with speech and hearing impairments. The system integrates 3D animation, Natural Language Processing[15] (NLP), and Automatic Speech Recognition [1] [2] (ASR) to convert spoken words into sign language gestures. By utilizing advanced speech recognition models, natural language understanding, and dynamic 3D [6] gesture generation, the platform ensures a smooth and intuitive communication experience. To promote inclusivity, the system supports both multilingual and regional sign languages, making it accessible across diverse linguistic and cultural backgrounds. This solution bridges the gap in real-time communication tools by offering a scalable and accessible platform for both web and mobile applications. Ultimately, the goal is to empower individuals with disabilities, enhance their interaction with digital environments, and foster greater social inclusion.
Authors
- Muntaha Rouf
- Jitendra Singh Jadon
Institutions
- Amity University (IN)
Publication Details
- Published
- 2025-03-07
- DOI
- https://doi.org/10.1109/icdt63985.2025.10986615
- Citations
- 2
- Primary Topic
- Hand Gesture Recognition Systems
- Type
- article
- Field-Weighted Citation Impact
- 3.87