Home Appliance Operation via 3D Keypoint Based Gesture Detection in Body-Relative Command Spaces

In this paper, we propose a flexible device control method using personalized command spaces that function as buttons on a virtual remote control that follows the user. By performing two different gestures in each space, the users can control various devices in a room. This system is implemented through multiple cameras and 3D human keypoint tracking. We experimentally evaluated the influence of command spaces arrangement on gesture recognition and determined the recognition accuracies for different gestures in each command space. The system demonstrated high usability, with even inexperienced users achieving high gesture recognition accuracy.