A Depth Camera-Based Pointing Control System for Appliance Interaction
This paper presents a depth camera-based pointing control system that enables users to interact with household appliances without the need for physical remote controls. The system leverages skeletal tracking to capture the user's upperbody movements and calculates a pointing vector based on the positions of the right wrist and elbow. By analyzing the user's pointing direction and the duration of pointing, the system determines the intended appliance and displays an interactive control menu. The proposed system consists of three main steps: (1) appliance calibration, where the system records appliance locations through user-defined pointing actions; (2) pointing determination, which identifies the closest appliance based on vector calculations; and (3) control execution, where users select functions via hand gestures, and commands are transmitted wirelessly. Experimental evaluations involving multiple users demonstrate the accuracy of the system in recognizing pointing directions and controlling appliances effectively. The results highlight the system's potential for intuitive and contactless human-computer interaction in smart home environments.
Authors
- Zhexiao Lin (ORCID: https://orcid.org/0000-0002-1552-198X)
- Yi‐Zeng Hsieh (ORCID: https://orcid.org/0000-0002-5758-4516)
- Chun Chen (ORCID: https://orcid.org/0000-0001-9264-8020)
Institutions
- National Taiwan University of Science and Technology (TW)
Publication Details
- Published
- 2025-06-27
- DOI
- https://doi.org/10.1109/iccci65070.2025.11158373
- Primary Topic
- Gaze Tracking and Assistive Technology
- Type
- article
- Field-Weighted Citation Impact
- 0.00