Local feature enhancement for robust 2D multi-person pose estimation via pose refinement network
Accurate 2D multi-person pose estimation remains challenging due to issues such as occlusion, missing body parts, and low resolution, particularly in complex backgrounds. This paper proposes an refinement network for multi-person pose estimation through the complementary fusion of extended local receptive fields and contextual information. The proposed cascaded dilated convolution module (DCM) expands the local receptive field through geometric perception, addressing the issue of feature ambiguity in low-resolution and small-scale human bodies. Simultaneously, a hybrid self-attention module (HSM) is introduced to integrate the semantic relevance of joints and precise spatial location information by parallelly combining convolutional self-attention (CSA) and coordinate attention (CA). This optimizes localization through semantic association, not only reducing background interference but also resolving the problem of overlapping joints in multi-person scenarios. Consequently, the network framework achieves an effective balance between the accuracy of human feature extraction at different scales and computational speed. Extensive experiments conducted on the MS COCO and CrowdPose datasets demonstrate that the proposed network architecture outperforms comparable methods, exhibiting superior robustness and computational performance in high-density crowd scenes, uneven lighting conditions, and complex texture scenarios. The related code and models are available at https://github.com/Twl-GZ/Human-pose .
Authors
- Fangyuan Lei (ORCID: https://orcid.org/0000-0002-2059-8818)
- Huihui Li (ORCID: https://orcid.org/0000-0003-0463-8178)
- Weili Tian (ORCID: https://orcid.org/0009-0003-5832-9837)
- Xiaoyong Liu (ORCID: https://orcid.org/0000-0002-0795-841X)
- Jin Zhan (ORCID: https://orcid.org/0000-0002-7070-7031)
- Yufeng Zeng (ORCID: https://orcid.org/0009-0007-9856-5980)
- Zhaokang Guan
- Chensheng Yi
Institutions
- Hong Kong University of Science and Technology (HK)
- Guangzhou Academy of Special Equipment Inspection and Testing (CN)
- Guangdong Polytechnic Normal University (CN)
Publication Details
- Journal
- The Visual Computer
- Published
- 2025-12-07
- DOI
- https://doi.org/10.1007/s00371-025-04256-2
- Primary Topic
- Human Pose and Action Recognition
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Guangdong Polytechnic Normal University
- Natural Science Foundation of Guangdong Province