Traffic Accident Rescue Action Recognition Method Based on Real-Time UAV Video
Low-altitude drones, which are unimpeded by traffic congestion or urban terrain, have become a critical asset in emergency rescue missions. To address the current lack of emergency rescue data, UAV aerial videos were collected to create an experimental dataset for action classification and localization annotation. A total of 5082 keyframes were labeled with 1–5 targets each, and 14,412 instances of data were prepared (including flight altitude and camera angles) for action classification and position annotation. To mitigate the challenges posed by high-resolution drone footage with excessive redundant information, we propose the SlowFast-Traffic (SF-T) framework, a spatio-temporal sequence-based algorithm for recognizing traffic accident rescue actions. For more efficient extraction of target–background correlation features, we introduce the Actor-Centric Relation Network (ACRN) module, which employs temporal max pooling to enhance the time-dimensional features of static backgrounds, significantly reducing redundancy-induced interference. Additionally, smaller ROI feature map outputs are adopted to boost computational speed. To tackle class imbalance in incident samples, we integrate a Class-Balanced Focal Loss (CB-Focal Loss) function, effectively resolving rare-action recognition in specific rescue scenarios. We replace the original Faster R-CNN with YOLOX-s to improve the target detection rate. On our proposed dataset, the SF-T model achieves a mean average precision (mAP) of 83.9%, which is 8.5% higher than that of the standard SlowFast architecture while maintaining a processing speed of 34.9 tasks/s. Both accuracy-related metrics and computational efficiency are substantially improved. The proposed method demonstrates strong robustness and real-time analysis capabilities for modern traffic rescue action recognition.
Authors
- Bixing Zhang
- Bo Yang (ORCID: https://orcid.org/0000-0002-0961-3861)
- Tao Liu (ORCID: https://orcid.org/0000-0001-8261-9277)
- Siyu Zhang (ORCID: https://orcid.org/0000-0003-2350-4546)
- Yan Tian
- Geng Chen (ORCID: https://orcid.org/0000-0001-6209-301X)
- Jang‐Jih Lu (ORCID: https://orcid.org/0000-0002-1692-1707)
Institutions
- North China Institute of Science and Technology (CN)
- Wisdom Health (United States) (US)
- Huazhong University of Science and Technology (CN)
Publication Details
- Journal
- Drones
- Published
- 2025-07-24
- DOI
- https://doi.org/10.3390/drones9080519
- Citations
- 1
- Primary Topic
- Fire Detection and Safety Systems
- Type
- article
- Field-Weighted Citation Impact
- 1.30
Funders
- Fundamental Research Funds for the Central Universities