A Unified Communication Model for Multiple Sensory Disabilities Using Convolutional Neural Networks

Day by day the ratio of deaf, blind, and deaf-blind people is increasing rapidly and according to research conducted over 15 million of the world’s population is living with these disabilities. With the advancement in technology, these sensory disabled can communicate with each other still many such people it difficult to communicate. This paper proposes a communication model that will make communication between people with sensory disabilities much easier. In this work, we create an all-in-one user interface that contains different modes of communication on a single platform. Speech is being converted to text using speech recognition, hand gestures to text using the CNN model, and Braille script to text using Python libraries. This would help many people to communicate without any hassle and allow deferentially able to live life like abled people. Our research focuses on making communication easier among any person who has a disability or multiple disabilities so that they can communicate easily and properly. We focus on making the solution easier and simpler as much as possible.