Virtual mouse design based on OpenCV and deep learning
Gesture control technology enables non-contact operation of electronic devices through advanced sensors and algorithms. This design employs deep learning for gesture recognition, using Python and OpenCV to call the camera and process images, expanding the dataset to 4590 images through data augmentation. The VGG neural network model is built and trained using Keras, which reads camera frames in real-time to predict gestures and simulate mouse operations. This virtual mouse simplifies human-computer interaction, enhances user experience, and addresses the difficulties faced by the elderly, people with disabilities, and those in educational or presentation settings who find traditional mouse usage inconvenient.
Authors
- Xiaowei Zhao (ORCID: https://orcid.org/0000-0002-1182-4502)
- Jianhua Zhang (ORCID: https://orcid.org/0000-0001-8061-1861)
- Zhiguo Zheng (ORCID: https://orcid.org/0009-0004-3588-7729)
- Jianke Wang
Institutions
- Hainan University (CN)
Publication Details
- Published
- 2025-07-24
- DOI
- https://doi.org/10.1117/12.3068825
- Primary Topic
- Advanced Algorithms and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00