A System for Controlling the GUI by Gestures using a Webcam, Based on MV Algorithms

This article presents a gesture-controlled computer system using a webcam and machine vision (MV) algorithms, which allows for more intuitive and accessible human-computer interaction. The research is of great importance because it improves the usability of a computer for people with disabilities and offers a faster alternative to traditional input methods in limited conditions, such as the workplace. The goal is to develop a system that allows users to control graphical user interfaces (GUIs) using gestures using computer vision techniques. The technique includes image processing, hand segmentation, gesture recognition, and command execution. The experiments were conducted on Windows 10 and macOS. The results show successful gesture recognition and command execution in Windows 10, while macOS testing revealed the potential for simplification with built-in features. The study concludes that gesture control technology has significant potential to improve human-computer interaction, especially in environments where traditional input devices are impractical or unavailable.