AI-Assisted Eye-Controlled Human–Computer Interaction and IoT-Based Home Automation for People with Disabilities and Paralysis
People with severe motor disabilities and paralysis often face difficulties in operating conventional computers and communicating independently. This research presents an artificial intelligence-assisted eyecontrolled human-computer interaction system that provides an alternative input mechanism using eye movement, slight head movement, and intentional blinking. A computer vision module using the built-in laptop webcam and OpenCV with MediaPipe Face Mesh detects iris movement and slight head movement and translates the detected movements into mouse cursor movement, while a blink sensor connected to an Arduino enables hands-free selection. The system incorporates a virtual keyboard with predictive word and sentence assistance to reduce the effort required for eye-based typing. A text-to-speech facility converts typed messages into audible speech. Emergency short message service alerts, caretaker calling, and a local buzzer-based emergency alert are integrated to provide additional assistance. An ESP8266-based home automation interface enables users to control appliances such as lights, fans, and windows. The proposed system was developed as a lowcost prototype integrating assistive communication, computer interaction, emergency assistance, and environmental control into a unified platform for individuals with motor disabilities.
Authors
- Neha Deepak Bhalerao
- Shweta Rajkumar Yadav
Institutions
- Savitribai Phule Pune University (IN)
Publication Details
- Journal
- International Journal of Innovative Research in Technology
- Published
- 2026-09-17
- DOI
- https://doi.org/10.64643/ijirt.208570-459
- Primary Topic
- Gaze Tracking and Assistive Technology
- Type
- article
- Field-Weighted Citation Impact
- 0.00