A Multi-feature Co-distillation Algorithm Based on Human Skeletal Point Behavior Recognition

Depth model-based behavior estimation of human skeletal points is widely used in the field of behavior recognition. In order to improve the accuracy of behavior recognition, the complexity and computation of the designed network model are increasing, while the mobile platforms have limited arithmetic power and memory, and thus cannot be deployed. To solve the above problems, the AGCN network, a skeletal point-based behavior recognition model, is clipped to compress the network size so that it can support common mobile platforms; and a multi-feature co-distillation method is proposed to efficiently migrate the performance of the original network to the target network, so that the performance of the clipped lightweight network tends to be close to that of the original network. The model training, testing, visualization, and ablation experiments are completed on the NTU-RGB+D60 data set. The experimental results show that the algorithm after lightweighting (clipping network and multi-feature co-distillation), can significantly reduce the computational amount of behavior recognition.