Curvelet-enhanced transformer architecture for blurred action fine-grained detection
This study proposes a novel Multi Curvelet Transformer Network (MCTN) for fine-grained human behavior recognition in dynamic video scenarios. A key challenge in this field lies in accurately identifying human actions under adverse conditions such as motion blur, occlusion, and varying illumination. To address this, we introduce a motion blur restoration module leveraging the curvelet transform to enhance motion image clarity, thereby improving downstream behavior detection. Furthermore, we enhance the Transformer architecture by embedding curvelet-based multi-scale attention mechanisms, which significantly improve the model's ability to extract spatial-temporal features at different resolutions. The proposed network also adopts a multi-curvelet transform structure to deepen semantic representation. Experimental results on benchmark datasets, including an action recognition dataset and the MSCOCO dataset, demonstrate that MCTN achieves superior performance, reaching a mean average precision (mAP) of 0.822. These results underscore the potential of MCTN in real-time intelligent video analysis and human-computer interaction applications.
Authors
- Zhetao Guo (ORCID: https://orcid.org/0009-0004-4083-8171)
- Ying Xing (ORCID: https://orcid.org/0000-0003-4840-7427)
- Yushi Shen
- W Zhang
- Yuxiang Ren
Institutions
- Beijing University of Posts and Telecommunications (CN)
- Beijing University of Chinese Medicine (CN)
- Beijing Computing Center (CN)
- Cloud Computing Center (CN)
- China United Network Communications Group (China) (CN)
Publication Details
- Journal
- Scientific Reports
- Published
- 2025-12-31
- DOI
- https://doi.org/10.1038/s41598-025-33985-6
- Primary Topic
- Human Pose and Action Recognition
- Type
- article
- Field-Weighted Citation Impact
- 0.00