A Human Activity Recognition model based on CNN and Transformer

Abstract This study aims to utilize data from built-in sensors in smartphones for human activity recognition. By analyzing the three-dimensional accelerometer and gyroscope data in user behavior, accurate classification of eight common activity states is achieved, including walking, standing, sitting, squatting, going up stairs, going down stairs, climbing ladders, and descending ladders. To enhance the model’s generalization capability, a method combining Transformer neural networks with one-dimensional Convolutional Neural Networks (CNNs) is employed, along with data sample augmentation. Experimental results demonstrate a significant improvement in recognition accuracy compared to traditional models, indicating the potential for real-time application on smartphones and other devices. This approach provides essential technical support for predictive human-computer interaction on smart devices and holds extensive application prospects.