Helen: An Intelligent Virtual Assistant for People with Auditory Problems

The integration of artificial intelligence has grown exponentially to improve human interaction with the world. The most common examples are virtual assistants such as Alexa, Siri, Cortana, or Google, and electronic devices that can connect with other electronic devices in the home. Undoubtedly, incorporating these virtual assistants and devices has supported and improved the interaction of users with low technological experience or people with a motor impairment who can also benefit from them. However, people with auditory problems who are commonly limited verbally and use sign language to communicate can not use virtual assistants in their current design. Therefore, some authors have pointed out the importance of developing devices and creating environments so that people with auditory disability can improve their interaction with these devices. Hence, this study aims to introduce Helen, a virtual assistant for people with auditory disability. Its design is based on a qualitative analysis of semi-structured interviews with people with auditory problems. Helen can perform some actions using sign language. This study presents the results of the interviews, the details of Helen's design, the hardware construction, and the user interface design. We firmly believe this project will serve as a cornerstone for empowering the deaf community, providing them with a virtual assistant to control various home devices.