Hands-Free Computing: Virtual Mouse and Keyboard with Eye Gaze

The virtual keyboard and mouse are the most often used input devices in computers; however, because they allow individuals with disabilities and those who are paralyzed to perform basic tasks using the traditional input system, using the same input device can be difficult for them. The suggested system offers an alternative to a physically operated virtual keyboard and mouse for those with physical limitations and paralysis by utilizing their facial expressions captured by the web camera as the primary input method. The way the system operates is by facial expressions, such as eye and mouth movements. The system recognizes the area of the face where the mouth, eyes, and nose are located and removed for processing using the Haar classifier. It directs the action. By enabling hands free communication between people and computers, of the virtual keyboard and mouse. It enables impaired users to move the cursor left and right, scroll up and down, and scroll left and right. It also allows them to utilize a virtual mouse. The eyeball position on the virtual keyboard can be set to the left or right. By simply blinking, the user can select the desired key from the virtual keyboard and type without using their hands or fingers.

Authors

Publication Details

Published
2024-11-23
DOI
https://doi.org/10.59544/cdeg4765/icrcct24p133
Primary Topic
Gaze Tracking and Assistive Technology
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Hands-Free Computing: Virtual Mouse and Keyboard with Eye Gaze

Evgeny A. Semenishchev, S. Shanthini, K Banuroopa
Gaze Tracking and Assistive Technology
article

Hands-Free Computing: Virtual Mouse and Keyboard with Eye Gaze

Evgeny A. Semenishchev, S. Shanthini, K Banuroopa
article en

Abstract

The virtual keyboard and mouse are the most often used input devices in computers; however, because they allow individuals with disabilities and those who are paralyzed to perform basic tasks using the traditional input system, using the same input device can be difficult for them. The suggested system offers an alternative to a physically operated virtual keyboard and mouse for those with physical limitations and paralysis by utilizing their facial expressions captured by the web camera as the primary input method. The way the system operates is by facial expressions, such as eye and mouth movements. The system recognizes the area of the face where the mouth, eyes, and nose are located and removed for processing using the Haar classifier. It directs the action. By enabling hands free communication between people and computers, of the virtual keyboard and mouse. It enables impaired users to move the cursor left and right, scroll up and down, and scroll left and right. It also allows them to utilize a virtual mouse. The eyeball position on the virtual keyboard can be set to the left or right. By simply blinking, the user can select the desired key from the virtual keyboard and type without using their hands or fingers.

Quality Education
Openalex Percentile: Top 78%
Gaze Tracking and Assistive Technology
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.