CWF-HRNet: Context-aware Fusion for Human Pose Estimation based on High-Resolution Networks

This study proposes a novel CWF-HRNet, based on dynamic perception fusion, to enhance human pose estimation for volleyball coaching visual aids. It addresses key challenges in real-world teaching scenarios, such as blurred image details, inadequate multi-resolution information fusion, and limb occlusion. The CWF-HRNet integrates the CARAFE upsampling module, which dynamically adjusts pixel contributions using context-related weight matrices based on image content. To improve multi-resolution information fusion, the HL-WASP multi-scale fusion module combines shallow features from different layers, expanding the feature receptive field and enhancing detail capture. Additionally, a context-based dynamic perception module enhances global semantic understanding to address occlusions. Experimental results demonstrate that CWF-HRNet improves evaluation metrics AP, AP<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">50</sup>, AP<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">75</sup>, AP<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">M</sup>, AP<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">L</sup>, and AR by 4.1%, 2.6%, 3.5%, 3.6%, 4.4%, and 3.4%, respectively, compared to the HRNet model, while reducing parameters by 14%. These enhancements underscore the superior accuracy and efficiency of CWF-HRNet in challenging scenarios, making it well-suited for real-time sports training applications.

Authors

Institutions

Publication Details

Published
2024-08-04
DOI
https://doi.org/10.1109/icma61710.2024.10632900
Primary Topic
Human Pose and Action Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

CWF-HRNet: Context-aware Fusion for Human Pose Estimation based on High-Resolution Networks

JiQing Xing, Shiyu Ding, Hong Liang, Kuan Luan et al.
Human Pose and Action Recognition
article

CWF-HRNet: Context-aware Fusion for Human Pose Estimation based on High-Resolution Networks

JiQing Xing, Shiyu Ding, Hong Liang, Kuan Luan, Jin Li
article en

Abstract

This study proposes a novel CWF-HRNet, based on dynamic perception fusion, to enhance human pose estimation for volleyball coaching visual aids. It addresses key challenges in real-world teaching scenarios, such as blurred image details, inadequate multi-resolution information fusion, and limb occlusion. The CWF-HRNet integrates the CARAFE upsampling module, which dynamically adjusts pixel contributions using context-related weight matrices based on image content. To improve multi-resolution information fusion, the HL-WASP multi-scale fusion module combines shallow features from different layers, expanding the feature receptive field and enhancing detail capture. Additionally, a context-based dynamic perception module enhances global semantic understanding to address occlusions. Experimental results demonstrate that CWF-HRNet improves evaluation metrics AP, AP<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">50</sup>, AP<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">75</sup>, AP<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">M</sup>, AP<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">L</sup>, and AR by 4.1%, 2.6%, 3.5%, 3.6%, 4.4%, and 3.4%, respectively, compared to the HRNet model, while reducing parameters by 14%. These enhancements underscore the superior accuracy and efficiency of CWF-HRNet in challenging scenarios, making it well-suited for real-time sports training applications.

Harbin Engineering University (CN)
Openalex Percentile: Top 87%
Human Pose and Action Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

CWF-HRNet: Context-aware Fusion for Human Pose Estimation based on High-Resolution Networks — JiQing Xing, Shiyu Ding, et al. · (2024) | TGRS Research Map | TGRS