Virtual Mouse Using Machine Learning

The mouse is a key invention in Human-Computer Interaction (HCI), but it still relies on physical devices, whether wired or wireless, which require connections and power sources. The proposed virtual mouse system addresses this using a webcam or built-in camera to detect hand gestures and fingertips through computer vision. It employs the PyAutoGui library to automate GUI tasks, allowing control over mouse operations such as moving the cursor, clicking, and scrolling. The OpenCV library, used for computer vision, provides tools for hand recognition, while the machine learning algorithm, Single Shot Detection (SSD), interprets these gestures to control the mouse functions virtually. By utilizing the Media Pipe framework for hand detection, this system eliminates the need for a physical mouse and reduces dependency on hardware. It can handle functions such as clicking, scrolling, adjusting volume and brightness, and moving the cursor.