Design and Implementation of a Human-Computer Interaction System Using Hand Tracking and Gesture Recognition with a Built-in Camera

The improvement of Human-Computer Interaction (HCI) systems remains an ongoing research challenge. This paper presents a system that utilizes visual hand imagery as a form of human input. The system is designed to be robust, intuitive, configurable and compatible with built-in traditional cameras. Furthermore, it operates in a low-frequency input environment, offering as an alternative to the traditional mouse and keyboard. Targeted at casual users, its ultimate goal is to provide a portable and versatile solution compatible with multiple desktop operating systems. The system features a simple, user-friendly interface that enables easy editing and configuration. To evaluate its effectiveness, the system was tested by 31 participants, and the feedback was predominantly satisfactory, indicating its potential for practical use.