RaGeoSense for smart home gesture recognition using sparse millimeter wave radar point clouds

With the growing demand for contactless human-computer interaction in the smart home field, gesture recognition technology shows great market potential. In this paper, a sparse millimeter wave point cloud-based gesture recognition system, RaGeoSense, is proposed, which is designed for smart home scenarios. RaGeoSense effectively improves the recognition performance and system robustness by combining multiple advanced signal processing and deep learning methods. Firstly, the system adopts three methods, namely K-mean clustering straight-through filtering, frame difference filtering and median filtering, to reduce the noise of the raw millimeter wave data, which significantly improves the quality of the point cloud data. Subsequently, the generated point cloud data are processed with sliding sequence sampling and point cloud tiling to extract the spatio-temporal features of the action. To further improve the classification performance, the system proposes an integrated model architecture that combines GBDT and XGBoost for efficient extraction of nonlinear features, and utilizes LSTM gated loop units to classify the gesture sequences, thus realizing the accurate recognition of eight different one-arm gestures. The experimental results show that RaGeoSense performs well at different distances, angles and movement speeds, with an average recognition rate of 95.2%, which is almost unaffected by the differences in personnel and has a certain degree of anti-interference ability.