A computer graphics-based model to generate dynamic 3D animations for corresponding Bangla sign language gestures using HamNoSys to SiGML conversion

Effective communication is essential for human touch, and it’s especially crucial for those who rely on sign language because they have speech or hearing difficulties. Communication between deaf and normal people is restricted by the inability of current technology to automatically create flexible Bangla Sign Language (BdSL) animations from Bangla text or voice. This work introduces a revolutionary computer graphics-based system that takes voice or text input in Bangla and uses it to create BdSL animations. The system uses a HamNoSys to Gesture Markup Language (SiGML) conversion to dynamically translate input into gestures. With the use of 94 classes in the dataset that cover Bangla numbers, alphabets, and word motions, the model can generate any word or phrase in Bangla. Additionally, the system creates gestures for inputs that aren’t in the dataset by spelling out the letters. The system converts Bangla text into three-dimensional animated BdSL movements by parsing it based on Linguistic principles. According to performance evaluations, each input has a processing cost of 79.57 ms, and the average accuracy for text and voice input is 97.50% and 94.75%, respectively. The method ensures fluency and naturalness by taking into consideration crucial elements of sign language, such as hand shape, palm orientation, and non-manual messages. By reducing communication barriers between the sign and non-sign populations, this study significantly advances accessibility. Visit this GitHub repository link for further details on the implementation of the suggested system and the SiGML dataset: https://gitlab.com/devarifkhan/bdsl-3d-animation