Developing Accurate Sri Lankan Sign Language to Tamil Vocal And American Sign Language Translation

This research presents a web-based real-time Sri Lankan Sign Language (SLSL) translation system aimed at bridging communication gaps for individuals with speech and hearing disabilities. Leveraging advanced machine learning, the system translates SLSL gestures into Tamil vocal language and American Sign Language (ASL), supported by video-to-text conversion with Yolo-NAS, voice model and clips of animated 3D characters. Key objectives included accurate vocabulary mapping for selected vocabularies, real-time translation with minimal latency, an audio player to display Tamil voice and animated 3D characters to convey nuanced ASL gestures. The system is integrated as one website, but each translation part has separate pages where users can navigate and fulfill their needs. User feedback highlighted the simple and direct user interface design and fluidity of interactions, particularly the animated 3D characters in SLSL to ASL translation. Challenges included optimizing gesture rendering and expanding vocabulary coverage, which will be addressed in future work. This research underscores the potential of AI-driven solutions for enhancing accessibility and inclusivity in communication with cross-lingual and cross-model communication features.