Make It Easy: Action Quality Assessment of Cyborg Animals Based on Spatial-Temporal Pose Inference
Assessing the action quality of cyborg animals helps to adjust control strategies, guide the development of control algorithm, and enhance the efficiency of navigation and military applications. However, existing research is limited in control algorithm and ignores the assessment of movement smoothness. In this paper, we first propose EASY, an effective assessment framework, which is able to (i) evaluate the action quality of cyborg animals of various sizes and motion patterns; (ii) obtain assessment results directly based on keypoints. Specifically, EASY first captures keypoints sequences through a small object pose estimation module. It employs the convolutional block attention module (CBAM) and depthwise over parameterized convolution (DOConv), allowing more accurate feature recognition with fewer parameters. Then, EASY employs multi-field fusion strategy that merges commonalities and differences, enabling a comprehensive and accurate assessment of fluency. We tested EASY on both CyborgRat-MFA dataset and CyborgBee-MFA dataset. Extensive experiments demonstrate that the assessment results are consistent with human expert scores, which prove that our proposed EASY is reasonable, effective, and interpretable.
Authors
- Qiqi Li (ORCID: https://orcid.org/0009-0002-6467-6731)
- Le Han (ORCID: https://orcid.org/0000-0003-3414-315X)
- Pengfei Wang (ORCID: https://orcid.org/0000-0002-6747-1574)
- Nenggan Zheng
Institutions
- Zhejiang University (CN)
Publication Details
- Published
- 2024-12-02
- DOI
- https://doi.org/10.1109/swc62898.2024.00184
- Primary Topic
- Morphological variations and asymmetry
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China