Make It Easy: Action Quality Assessment of Cyborg Animals Based on Spatial-Temporal Pose Inference

Assessing the action quality of cyborg animals helps to adjust control strategies, guide the development of control algorithm, and enhance the efficiency of navigation and military applications. However, existing research is limited in control algorithm and ignores the assessment of movement smoothness. In this paper, we first propose EASY, an effective assessment framework, which is able to (i) evaluate the action quality of cyborg animals of various sizes and motion patterns; (ii) obtain assessment results directly based on keypoints. Specifically, EASY first captures keypoints sequences through a small object pose estimation module. It employs the convolutional block attention module (CBAM) and depthwise over parameterized convolution (DOConv), allowing more accurate feature recognition with fewer parameters. Then, EASY employs multi-field fusion strategy that merges commonalities and differences, enabling a comprehensive and accurate assessment of fluency. We tested EASY on both CyborgRat-MFA dataset and CyborgBee-MFA dataset. Extensive experiments demonstrate that the assessment results are consistent with human expert scores, which prove that our proposed EASY is reasonable, effective, and interpretable.

Authors

Institutions

Publication Details

Published
2024-12-02
DOI
https://doi.org/10.1109/swc62898.2024.00184
Primary Topic
Morphological variations and asymmetry
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Make It Easy: Action Quality Assessment of Cyborg Animals Based on Spatial-Temporal Pose Inference

Qiqi Li, Le Han, Pengfei Wang, Nenggan Zheng
Morphological variations and asymmetry
article

Make It Easy: Action Quality Assessment of Cyborg Animals Based on Spatial-Temporal Pose Inference

Qiqi Li, Le Han, Pengfei Wang, Nenggan Zheng
article en

Abstract

Assessing the action quality of cyborg animals helps to adjust control strategies, guide the development of control algorithm, and enhance the efficiency of navigation and military applications. However, existing research is limited in control algorithm and ignores the assessment of movement smoothness. In this paper, we first propose EASY, an effective assessment framework, which is able to (i) evaluate the action quality of cyborg animals of various sizes and motion patterns; (ii) obtain assessment results directly based on keypoints. Specifically, EASY first captures keypoints sequences through a small object pose estimation module. It employs the convolutional block attention module (CBAM) and depthwise over parameterized convolution (DOConv), allowing more accurate feature recognition with fewer parameters. Then, EASY employs multi-field fusion strategy that merges commonalities and differences, enabling a comprehensive and accurate assessment of fluency. We tested EASY on both CyborgRat-MFA dataset and CyborgBee-MFA dataset. Extensive experiments demonstrate that the assessment results are consistent with human expert scores, which prove that our proposed EASY is reasonable, effective, and interpretable.

Zhejiang University (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 61%
Morphological variations and asymmetry
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Make It Easy: Action Quality Assessment of Cyborg Animals Based on Spatial-Temporal Pose Inference — Qiqi Li, Le Han, et al. · (2024) | TGRS Research Map | TGRS