Generative AI for Text to Speech and Sign Language Translation

This paper presents the development of an AI-powered platform designed to enhance real-time communication for individuals with speech and hearing impairments. The system integrates 3D animation, Natural Language Processing[15] (NLP), and Automatic Speech Recognition [1] [2] (ASR) to convert spoken words into sign language gestures. By utilizing advanced speech recognition models, natural language understanding, and dynamic 3D [6] gesture generation, the platform ensures a smooth and intuitive communication experience. To promote inclusivity, the system supports both multilingual and regional sign languages, making it accessible across diverse linguistic and cultural backgrounds. This solution bridges the gap in real-time communication tools by offering a scalable and accessible platform for both web and mobile applications. Ultimately, the goal is to empower individuals with disabilities, enhance their interaction with digital environments, and foster greater social inclusion.

Authors

Institutions

Publication Details

Published
2025-03-07
DOI
https://doi.org/10.1109/icdt63985.2025.10986615
Citations
2
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
3.87
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Generative AI for Text to Speech and Sign Language Translation

Muntaha Rouf, Jitendra Singh Jadon
2 citations
Hand Gesture Recognition Systems
3.87
article

Generative AI for Text to Speech and Sign Language Translation

Muntaha Rouf, Jitendra Singh Jadon
article en
2 citations

Abstract

This paper presents the development of an AI-powered platform designed to enhance real-time communication for individuals with speech and hearing impairments. The system integrates 3D animation, Natural Language Processing[15] (NLP), and Automatic Speech Recognition [1] [2] (ASR) to convert spoken words into sign language gestures. By utilizing advanced speech recognition models, natural language understanding, and dynamic 3D [6] gesture generation, the platform ensures a smooth and intuitive communication experience. To promote inclusivity, the system supports both multilingual and regional sign languages, making it accessible across diverse linguistic and cultural backgrounds. This solution bridges the gap in real-time communication tools by offering a scalable and accessible platform for both web and mobile applications. Ultimately, the goal is to empower individuals with disabilities, enhance their interaction with digital environments, and foster greater social inclusion.

Amity University (IN)
Quality Education
Openalex Percentile: Top 8%
Hand Gesture Recognition Systems
3.87
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Generative AI for Text to Speech and Sign Language Translation — Muntaha Rouf, Jitendra Singh Jadon · (2025) | TGRS Research Map | TGRS