Curvelet-enhanced transformer architecture for blurred action fine-grained detection

This study proposes a novel Multi Curvelet Transformer Network (MCTN) for fine-grained human behavior recognition in dynamic video scenarios. A key challenge in this field lies in accurately identifying human actions under adverse conditions such as motion blur, occlusion, and varying illumination. To address this, we introduce a motion blur restoration module leveraging the curvelet transform to enhance motion image clarity, thereby improving downstream behavior detection. Furthermore, we enhance the Transformer architecture by embedding curvelet-based multi-scale attention mechanisms, which significantly improve the model's ability to extract spatial-temporal features at different resolutions. The proposed network also adopts a multi-curvelet transform structure to deepen semantic representation. Experimental results on benchmark datasets, including an action recognition dataset and the MSCOCO dataset, demonstrate that MCTN achieves superior performance, reaching a mean average precision (mAP) of 0.822. These results underscore the potential of MCTN in real-time intelligent video analysis and human-computer interaction applications.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2025-12-31
DOI
https://doi.org/10.1038/s41598-025-33985-6
Primary Topic
Human Pose and Action Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Curvelet-enhanced transformer architecture for blurred action fine-grained detection

Zhetao Guo, Ying Xing, Yushi Shen, W Zhang et al.
Scientific Reports
Human Pose and Action Recognition
article

Curvelet-enhanced transformer architecture for blurred action fine-grained detection

Zhetao Guo, Ying Xing, Yushi Shen, W Zhang, Yuxiang Ren
article en

Abstract

This study proposes a novel Multi Curvelet Transformer Network (MCTN) for fine-grained human behavior recognition in dynamic video scenarios. A key challenge in this field lies in accurately identifying human actions under adverse conditions such as motion blur, occlusion, and varying illumination. To address this, we introduce a motion blur restoration module leveraging the curvelet transform to enhance motion image clarity, thereby improving downstream behavior detection. Furthermore, we enhance the Transformer architecture by embedding curvelet-based multi-scale attention mechanisms, which significantly improve the model's ability to extract spatial-temporal features at different resolutions. The proposed network also adopts a multi-curvelet transform structure to deepen semantic representation. Experimental results on benchmark datasets, including an action recognition dataset and the MSCOCO dataset, demonstrate that MCTN achieves superior performance, reaching a mean average precision (mAP) of 0.822. These results underscore the potential of MCTN in real-time intelligent video analysis and human-computer interaction applications.

Scientific ReportsVol. 16(1)
Beijing University of Posts and Telecommunications (CN), Beijing University of Chinese Medicine (CN), Beijing Computing Center (CN), Cloud Computing Center (CN), China United Network Communications Group (China) (CN)
Sustainable cities and communities
Openalex Percentile: Top 34%
Human Pose and Action Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Curvelet-enhanced transformer architecture for blurred action fine-grained detection — Zhetao Guo, Ying Xing, et al. · Scientific Reports (2025) | TGRS Research Map | TGRS