Improved Action Recognition Algorithm for Video Surveillance Based on PoseC3D

The precise recognition of human action is of great significance for intelligent monitoring and video analysis. Previous researchers have utilized many methods to detect human action, but the accuracy and robustness of these methods remain to be improved. Skeleton-based action recognition methods have reported high accuracy and robustness, but these methods have not fully utilized multiple modalities for feature fusion. In order to solve the above problems, a multi-modality feature fusion based video surveillance personnel action recognition method is proposed by combining the two methods. The SlowOnly network is used to extract RGB modality features. The Faster R-CNN and Lite-HRNet networks are used to obtain skeleton modality data. The PoseC3D network is used to extract skeleton modality features. The early and late fusion of RGB modality features and skeleton modality features are performed. Then the action recognition results of video surveillance personnel are obtained. The experimental results on the NTU RGB+D public dataset under the X-Sub standard show the following points. In the action recognition model based on a single skeleton modality, PoseC3D has a higher recognition accuracy than GCN methods, reaching 92.8%. In the action recognition model based on RGB modality, recognition accuracy has reached 95.4%. The action recognition model based on multi-modality feature fusion has a higher recognition accuracy than the recognition model based on a single modality, reaching 96.1%.