Real – Time Communication System for Specially Abled Powered by AI

Our project primarily focuses on developing a model to facilitate communication for deaf or dumb individuals, who often face significant challenges in interacting with others. Real-time communication is a critical aspect of life, enabling individuals to connect instantly from anywhere globally. Our system aims to recognize hand gestures, text and speech. It perform tasks such as Sign Language convert into text and speech and the text will be convert into speech with our desired language, ensuring it is received within the appropriate hearing frequency range. To achieve this, the proposed system will incorporate artificial intelligence by creating a model using Convolutional Neural Networks (CNNs) to recognize Indian Sign Language or human actions and convert them into text and audio formats. The corresponding messages will be sent via Global System for Mobile Communication (GSM) module to the wearer's Android device, which will convert the text into speech. By utilizing an Automatic Speech Recognition (ASR), and Statistical Machine Translation (SMT) algorithm, facilitate multilingual speech translation. By using Real-time Protocol (RTP) for recording functions for the future use. This AI-Powered system also establishes speech and text processing via Bluetooth-enabled mobile connectivity for seamless interaction.