Gesture and Voice-Controlled Virtual Mouse: An Ai-Based Approach to Hands-Free Navigation
This research presents a cutting-edge, hands-free virtual mouse integrated with a voice assistant to enhance accessibility and improve user interaction with digital devices. The system leverages Open Computer Vision (OpenCV) and MediaPipe for real-time hand gesture recognition, while pyttsx3 and Speech recognition enable efficient voice command processing. By eliminating the need for traditional input devices, the proposed approach seamlessly translates hand movements into cursor actions and executes system functions through voice commands. An intuitive interface, developed with Eel, enhances usability, ensuring a smooth and responsive user experience. Experimental results demonstrate superior accuracy and adaptability compared to existing models, highlighting the system's potential for touchless humancomputer interaction Solutions, particularly in accessibilityfocused applications.
Authors
- Bollapalli Althaph
- Beebi Naseeba
- Sai Vennela Tipirneni
- Bhukya Chinni Krishna
- Palakonda Jesse Angelina
Institutions
- SRM University (IN)
- VIT-AP University
- San Jose State University (US)
Publication Details
- Published
- 2025-04-02
- DOI
- https://doi.org/10.23919/indiacom66777.2025.11115270
- Primary Topic
- Speech and dialogue systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00