Enhancing Robot Learning with Transformer-based Morphology Modeling

Abstract The transformer model has made significant progress in various areas through large-scale training. In contrast, the traditional robot performs a single task, and there is an issue with migrating the strategic model. In this study, a Robot Morphology Learning (RML) method is proposed to enhance efficiency and generalization performance by learning multiple tasks in a transformer model. RML constructs the robot’s morphology as a graph and utilizes a graph neural network to handle graphs of arbitrary connections and sizes, addressing the disparity in state and action space dimensions. RML breaks through the limitation of non-migration of models, realizes efficient training, and improves the generalization performance of models, enabling quick adaptation to new tasks. Experimental results show that the proposed method outperforms previous methods in both multi-task learning and transfer learning experiments.