Al-Powered Virtual Mouse Using Computer Vision

Traditional computer interaction primarily relies on physical devices such as keyboards and mice. Although these devices have been reliable for decades, they create limitations in terms of ergonomics, hygiene, and accessibility. In the modern era of Human–Computer Interaction (HCI), there is a growing demand for touch less solutions that improve convenience and safety, particularly in the wake of global health concerns. This project presents a vision-based virtual mouse system that allows users to control computer operations through hand gestures captured via a standard webcam. The system leverages OpenCV for image processing, Mediapipe for hand landmark detection, and PyAutoGUI for mouse event control. The index finger is mapped to cursor movement, while proximity between the index and thumb fingers is used to trigger click events. Experimental results demonstrate that the proposed system operates in real time with high accuracy, achieving smooth cursor movement and reliable click detection. The solution is low-cost, requires no specialized hardware, and can serve as an accessible interface for everyday computing, interactive presentations, and assistive technologies.

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-09-29
DOI
https://doi.org/10.5281/zenodo.17222045
Primary Topic
Geochemistry and Geologic Mapping
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Al-Powered Virtual Mouse Using Computer Vision

Zenodo (CERN European Organization for Nuclear Research)
Geochemistry and Geologic Mapping
article

Al-Powered Virtual Mouse Using Computer Vision

article en

Abstract

Traditional computer interaction primarily relies on physical devices such as keyboards and mice. Although these devices have been reliable for decades, they create limitations in terms of ergonomics, hygiene, and accessibility. In the modern era of Human–Computer Interaction (HCI), there is a growing demand for touch less solutions that improve convenience and safety, particularly in the wake of global health concerns. This project presents a vision-based virtual mouse system that allows users to control computer operations through hand gestures captured via a standard webcam. The system leverages OpenCV for image processing, Mediapipe for hand landmark detection, and PyAutoGUI for mouse event control. The index finger is mapped to cursor movement, while proximity between the index and thumb fingers is used to trigger click events. Experimental results demonstrate that the proposed system operates in real time with high accuracy, achieving smooth cursor movement and reliable click detection. The solution is low-cost, requires no specialized hardware, and can serve as an accessible interface for everyday computing, interactive presentations, and assistive technologies.

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 26%
Geochemistry and Geologic Mapping
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.