An Efficient Human Activity Recognition Framework Based on Graph Convolutional Network for Human-Robot Collaboration

In this paper, a collaborative human-robot object processing framework based on skeleton data and graph convolutional human action recognition is proposed, and network architecture search and adaptive graph mechanisms are introduced. By recognizing the pose that the human carries the object, it is passed to the collaborative robot to make a matching object pickup action. The method is driven by the human skeleton data captured from RGB images, recognizes human actions by adaptive learning graph structure, and builds a graph convolution model and training in the collected dataset. Human-robot collaboration experiments are conducted in a laboratory environment, and the experimental results show that the method achieves high accuracy and real-time performance, and effectively accomplishes the human-robot collaboration task.