Recognition, Stabilization, and Command-Mapping Algorithms for Contactless Hand-Gesture Control of an ABB Industrial Robot
Although contactless hand-gesture interfaces can support intuitive human–robot interaction, transient classification errors may trigger unintended commands when classifier outputs are mapped directly to robot actions. This study presents a processing framework for contactless control of an ABB IRB 120 industrial robot. The framework combines RGB acquisition, geometric normalization of 21 MediaPipe hand landmarks, population-based sample filtering, multilayer perceptron classification, temporal transition stabilization, and a two-hand command grammar. Thirteen gesture classes were represented by 63-dimensional landmark vectors, and 19,250 samples were retained after processing. The classifier achieved an approximate mean per-class recall of 99.46% on the held-out test subset. Four temporal processing configurations were compared using 30 repetitions per interface action: raw output, majority voting, three-consecutive-label confirmation, and the proposed cellular-automaton (CA)-based stabilizer. The latter two methods improved command reliability relative to the raw output and produced comparable results. The CA stabilizer processed labels sampled every 100 ms and introduced a validation delay of approximately 300 ms. Robot-program control achieved an 86.7% success rate across 90 trials, while Cartesian direction control achieved a 97.2% success rate across 180 trials. The mean displacement overshoot was 2.42 mm, or 24.2% of the nominal 10 mm command. The framework provides a practical perception-to-control interface while complementing, rather than replacing, certified robot safety functions.
Authors
- Wojciech Kaczmarek (ORCID: https://orcid.org/0000-0003-3805-9510)
- Bartosz Bieńkowski
Institutions
- Military University of Technology in Warsaw (PL)
Publication Details
- Journal
- Sensors
- Published
- 2026-11-09
- DOI
- https://doi.org/10.3390/s26217073
- Primary Topic
- Hand Gesture Recognition Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00