A CONVERSION OF SPEECH LANGUAGE INTO SIGN LANGUAGE

This research introduces an AI-driven communication platform designed to bridge the communication gap between hearing and deaf individuals.The system employs Temporal Convolutional Networks (TCNs) for precise recognition of Indian Sign Language (ISL) gestures.To handle spoken language input, it incorporates a Speech Recognition and Synthesis Module (SRSM) that utilizes Hidden Markov Models (HMMs) to transcribe speech into text.A 3D avatar module subsequently interprets the transcribed speech into ISL visual gestures, allowing for seamless realtime interaction.The gesture recognition model, trained on the MNIST ISL dataset, achieved a high accuracy rate of 98.5%, ensuring dependable performance in both gesture-to-text and speech-to-sign translation tasks.Designed for inclusivity, the system caters to deaf, mute, and non-signing users.Additionally, a user-friendly web interface enhances accessibility and ease of use across platforms.

Publication Details

Journal
IJARCCE
Published
2025-05-05
DOI
https://doi.org/10.17148/ijarcce.2025.14493
Primary Topic
Hearing Impairment and Communication
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A CONVERSION OF SPEECH LANGUAGE INTO SIGN LANGUAGE

IJARCCE
Hearing Impairment and Communication
article

A CONVERSION OF SPEECH LANGUAGE INTO SIGN LANGUAGE

article en

Abstract

This research introduces an AI-driven communication platform designed to bridge the communication gap between hearing and deaf individuals.The system employs Temporal Convolutional Networks (TCNs) for precise recognition of Indian Sign Language (ISL) gestures.To handle spoken language input, it incorporates a Speech Recognition and Synthesis Module (SRSM) that utilizes Hidden Markov Models (HMMs) to transcribe speech into text.A 3D avatar module subsequently interprets the transcribed speech into ISL visual gestures, allowing for seamless realtime interaction.The gesture recognition model, trained on the MNIST ISL dataset, achieved a high accuracy rate of 98.5%, ensuring dependable performance in both gesture-to-text and speech-to-sign translation tasks.Designed for inclusivity, the system caters to deaf, mute, and non-signing users.Additionally, a user-friendly web interface enhances accessibility and ease of use across platforms.

IJARCCEVol. 14(4)
Quality Education
Openalex Percentile: Top 90%
Hearing Impairment and Communication
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.