A Carpometacarpal Thumb Tracking Device for Telemanipulation of a Robotic Thumb: Development, Prototyping, and Evaluation

Hand−tracking systems are widely employed for telemanipulating grippers with high degrees of freedom (DOFs) such as an anthropomorphic robotic hand (ARH). However, tracking human thumb motion is challenging due to the complex motion of the carpometacarpal (CMC) joint. Existing hand−tracking systems can track the motion of simple joints with one DOF, but most fail to track the motion of the CMC joint, or to do so, there is a need for expensive and intricately set up hardware systems. This research introduces and realizes an affordable and personalizable tracking device to capture the CMC joint Flexion/Extension and Abduction/Adduction motions. Tracked human thumb motion is mapped to a robot thumb in a hybrid approach: the proposed algorithm maps the CMC joint motion to the first two joints of the robot thumb, while joint mapping is established between the metacarpophalangeal and interphalangeal joints to the last two joints. When the tracking device is paired with a flex glove outfitted with bend sensors, the developed system provides the means to telemanipulate an ARH with a four-DOF thumb and one-DOF underactuated digits. A three-stage framework is proposed to telemanipulate the fully actuated robot thumb. The tracking device and framework were evaluated through a device operation and personalization test, as well as a framework verification test. Two volunteers successfully personalized, calibrated, and tested the device using the proposed mapping algorithm. One volunteer further evaluated the framework by performing hand poses and grasps, demonstrating effective control of the robot thumb for precision and power grasps in coordination with the other digits. The successful results support expanding the system and further evaluating it as a research platform for studying human–robot interaction in grasping tasks or in manufacturing, assistive, or medical domains.