Research on gesture recognition algorithm based on target detection

Gesture recognition technology is widely used in many fields, such as virtual reality, smart homes, auxiliary medical treatment, and human-computer interaction equipment. Through the analysis and understanding of human gestures, more natural and intuitive communication between humans and computers can be achieved. However, due to the complexity of hand motion in human-computer interaction, gesture recognition faces many challenges, such as self-occlusion, self-collision, and appearance similarity of the hand. In order to solve these problems, this study proposes a gesture recognition algorithm based on target detection. Dynamic Snake Convolution(DSC) and Adaptive Feature Pyramid Network(AFPN) modules are introduced into the You Only Look Once Version 8(YOLOv8) model. The experimental results show that the enhanced YOLOv8 model equipped with DSC and AFPN module performs better than baseline YOLOv8 in gesture recognition tasks. In addition, experiments and ablation studies on the Light-HaGRID dataset further prove the effectiveness of the improved YOLOv8 model and the contributions of its components.

Authors

Institutions

Publication Details

Published
2024-09-20
DOI
https://doi.org/10.1145/3703935.3704048
Primary Topic
Video Surveillance and Tracking Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on gesture recognition algorithm based on target detection

Xingya Yan, L. Y. Dong, Xiaowei Liu, Fengchun Dong et al.
Video Surveillance and Tracking Methods
article

Research on gesture recognition algorithm based on target detection

Xingya Yan, L. Y. Dong, Xiaowei Liu, Fengchun Dong, Xinlei He
article en

Abstract

Gesture recognition technology is widely used in many fields, such as virtual reality, smart homes, auxiliary medical treatment, and human-computer interaction equipment. Through the analysis and understanding of human gestures, more natural and intuitive communication between humans and computers can be achieved. However, due to the complexity of hand motion in human-computer interaction, gesture recognition faces many challenges, such as self-occlusion, self-collision, and appearance similarity of the hand. In order to solve these problems, this study proposes a gesture recognition algorithm based on target detection. Dynamic Snake Convolution(DSC) and Adaptive Feature Pyramid Network(AFPN) modules are introduced into the You Only Look Once Version 8(YOLOv8) model. The experimental results show that the enhanced YOLOv8 model equipped with DSC and AFPN module performs better than baseline YOLOv8 in gesture recognition tasks. In addition, experiments and ablation studies on the Light-HaGRID dataset further prove the effectiveness of the improved YOLOv8 model and the contributions of its components.

Xi’an University of Posts and Telecommunications (CN)
Openalex Percentile: Top 70%
Video Surveillance and Tracking Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Research on gesture recognition algorithm based on target detection — Xingya Yan, L. Y. Dong, et al. · (2024) | TGRS Research Map | TGRS