Next-gen interaction experience using virtual mouse system

The Virtual Mouse System is an innovative, touch-free control mechanism that replaces traditional computer mice using computer vision and artificial intelligence (AI). With a standard camera or webcam, it interprets hand, head, and eye gestures to perform actions like cursor movement, clicking, and scrolling. Designed for both general users and individuals with physical disabilities, it provides an intuitive, accessible, and futuristic interaction method. Key technologies like OpenCV and AI enable real- time gesture recognition, making it suitable for applications in accessibility, gaming, and education. This system eliminates physical devices, offering convenience and a modern dimension to human-computer interaction. This project focuses on developing a Virtual Mouse System using Python, MediaPipe, and PyAutoGUI, enabling users to control a computer cursor with simple hand gestures. The system leverages MediaPipe’s Hand Tracking API to detect hand landmarks and recognize specific gestures, which are then mapped to mouse actions such as cursor movement, clicking, dragging, and scrolling.

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-04-30
DOI
https://doi.org/10.5281/zenodo.17110296
Primary Topic
Geochemistry and Geologic Mapping
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Next-gen interaction experience using virtual mouse system

Zenodo (CERN European Organization for Nuclear Research)
Geochemistry and Geologic Mapping
article

Next-gen interaction experience using virtual mouse system

article en

Abstract

The Virtual Mouse System is an innovative, touch-free control mechanism that replaces traditional computer mice using computer vision and artificial intelligence (AI). With a standard camera or webcam, it interprets hand, head, and eye gestures to perform actions like cursor movement, clicking, and scrolling. Designed for both general users and individuals with physical disabilities, it provides an intuitive, accessible, and futuristic interaction method. Key technologies like OpenCV and AI enable real- time gesture recognition, making it suitable for applications in accessibility, gaming, and education. This system eliminates physical devices, offering convenience and a modern dimension to human-computer interaction. This project focuses on developing a Virtual Mouse System using Python, MediaPipe, and PyAutoGUI, enabling users to control a computer cursor with simple hand gestures. The system leverages MediaPipe’s Hand Tracking API to detect hand landmarks and recognize specific gestures, which are then mapped to mouse actions such as cursor movement, clicking, dragging, and scrolling.

Zenodo (CERN European Organization for Nuclear Research)
Aditya Birla (India) (IN)
Quality Education
Openalex Percentile: Top 42%
Geochemistry and Geologic Mapping
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.