Research on Gesture Recognition Optimization Based on YOLOv8 and Efficient Vision Transformer Network

Gesture recognition technology is widely used in the fields of human-computer interaction, virtual reality, and smart home, but it still faces challenges of recognition accuracy, real-time performance, and adaptability to complex environments. Given the problems such as low precision rate and slow speed in practical applications, this study proposes an improved YOLOvS gesture recognition algorithm. Leap Motion was used to collect gesture data, and labeling was used to complete the gesture data set. The algorithm added an EfficientViT visual transformation network based on YOLOvS to improve the accuracy and speed of gesture recognition. The introduction of the Triplet Attention mechanism and Diou loss function enhances the feature extraction capability of gesture recognition and improves the accuracy and robustness of target detection. The results show that compared with the original YOLOvS algorithm, the proposed algorithm improves the accuracy by 4.5% and the detection speed by S.7<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">%</sup>• The algorithm has strong practicability and can be applied to human-computer interaction and other fields.

Authors

Institutions

Publication Details

Published
2024-09-27
DOI
https://doi.org/10.1109/iciscae62304.2024.10761862
Citations
3
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
1.12
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on Gesture Recognition Optimization Based on YOLOv8 and Efficient Vision Transformer Network

Haolong Wu, Yaowu Xu, Daisheng Xu, Peng Yang
3 citations
Hand Gesture Recognition Systems
1.12
article

Research on Gesture Recognition Optimization Based on YOLOv8 and Efficient Vision Transformer Network

Haolong Wu, Yaowu Xu, Daisheng Xu, Peng Yang
article en
3 citations

Abstract

Gesture recognition technology is widely used in the fields of human-computer interaction, virtual reality, and smart home, but it still faces challenges of recognition accuracy, real-time performance, and adaptability to complex environments. Given the problems such as low precision rate and slow speed in practical applications, this study proposes an improved YOLOvS gesture recognition algorithm. Leap Motion was used to collect gesture data, and labeling was used to complete the gesture data set. The algorithm added an EfficientViT visual transformation network based on YOLOvS to improve the accuracy and speed of gesture recognition. The introduction of the Triplet Attention mechanism and Diou loss function enhances the feature extraction capability of gesture recognition and improves the accuracy and robustness of target detection. The results show that compared with the original YOLOvS algorithm, the proposed algorithm improves the accuracy by 4.5% and the detection speed by S.7<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">%</sup>• The algorithm has strong practicability and can be applied to human-computer interaction and other fields.

Xiamen University of Technology (CN)
Affordable and clean energy
Openalex Percentile: Top 21%
Hand Gesture Recognition Systems
1.12
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.