Gait Recognition via Motion Difference Representation Learning and Salient Feature Modeling

As a periodic movement, gait contains informative biometric traits formed by individual body structures, motion patterns, and behavioral habits. Previous gait recognition methods mainly focus on mining the appearance cues from gait sequences, while neglecting the dynamic motion characteristics. Motion cues are important complementary information for generating high-quality gait representations that can help models accurately recognize individuals. In this article, we propose a novel gait recognition framework named GaitDS to model dynamic motion information and construct salient gait representations. Specifically, we develop a motion information perception module that can directly represent dynamic regions during walking and extract fine-grained motion features based on the appearance of body parts over time. In addition, since some frames in gait sequences share partial similarities, we present saliency identity representation learning to focus on key frames along the temporal dimension, and integrate salient identity features to enhance sequence-level representations. Furthermore, a channel enhanced module is designed to generate more discriminative gait representations, where motion and temporal salient features can be complemented with global representations. Compared with existing state-of-the-art methods, our model achieves superior average rank-1 recognition accuracy on three benchmark datasets, i.e., 93.7% on CASIA-B, 92.4% on OU-MVLP, and 50.7% on Gait3D.