Optimized YOLO-Based Model for Real-Time Hand Keypoint Detection in Robotics

Human hand detection is crucial for robots as they learn human gestures for grasping tasks. However, due to the limited computational power of embedded devices used by robots, many existing approaches fail to meet real-time requirements. To address this challenge, we present an real-time model based on the YOLO framework for human hand keypoint detection. Our approach involves extracting relevant hand data from the COCO dataset to create a specialized dataset tailored for our task. We then design a neural network backbone and decoder grounded in the YOLO architecture, optimizing it for efficient and accurate hand keypoint detection. Our network not only meets real-time performance standards but also demonstrates scalability, allowing for the integration of additional tasks without significant reconfiguration. Through extensive experiments and comparative analysis, we validate the superiority of our model over existing methods. We conclude by discussing the implications of our findings and potential directions for future research.

Authors

Institutions

Publication Details

Published
2024-08-23
DOI
https://doi.org/10.1109/wrcsara64167.2024.10685670
Citations
2
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
0.74
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Optimized YOLO-Based Model for Real-Time Hand Keypoint Detection in Robotics

Fukai Zhang, Dun Li, Lingxiang Hu, Chengqiu Zhang et al.
2 citations
Hand Gesture Recognition Systems
0.74
article

Optimized YOLO-Based Model for Real-Time Hand Keypoint Detection in Robotics

Fukai Zhang, Dun Li, Lingxiang Hu, Chengqiu Zhang, Zhinan Jiang, Xingfei Zhu
article en
2 citations

Abstract

Human hand detection is crucial for robots as they learn human gestures for grasping tasks. However, due to the limited computational power of embedded devices used by robots, many existing approaches fail to meet real-time requirements. To address this challenge, we present an real-time model based on the YOLO framework for human hand keypoint detection. Our approach involves extracting relevant hand data from the COCO dataset to create a specialized dataset tailored for our task. We then design a neural network backbone and decoder grounded in the YOLO architecture, optimizing it for efficient and accurate hand keypoint detection. Our network not only meets real-time performance standards but also demonstrates scalability, allowing for the integration of additional tasks without significant reconfiguration. Through extensive experiments and comparative analysis, we validate the superiority of our model over existing methods. We conclude by discussing the implications of our findings and potential directions for future research.

Qingdao University (CN), Jiangnan University (CN), Shandong University (CN), Informatique, BioInformatique, Systèmes Complexes (FR), Tsinghua University (CN)
Openalex Percentile: Top 28%
Hand Gesture Recognition Systems
0.74
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.