Smartphone based human activity recognition irrespective of usage behavior using deep learning technique

Abstract Human activity recognition (HAR) from sensory data is a crucial task for a wide variety of applications. The in-built inertial sensor facilities of commercial smartphones have made the data collection process easier. However, different smartphone configurations exhibit variations in sensor readings for the same activities. Different smartphone holding positions, like in hand, shirt, or trouser pockets, also lead to variations in signal patterns for the same activity. Some recent works have shown that automated feature extraction using deep learning methods can significantly improve activity recognition, although there is a lack of experimentation considering device heterogeneity and different smartphone holding positions. The proposed work addresses this research gap with a two-fold contribution. First, a CNN-based HAR framework is proposed that forms 2-D frequency domain images to capture temporal patterns in the data along with inter-axis spatial features. Second, an ensemble of conditional classifiers has been designed based on CNN that exhibits generality in terms of device configurations and usage behavior. Real life data have been collected for different activities using different devices for experimentation. The proposed ensemble model is found to recognize activities with 94% accuracy even when the training and test devices are different for real datasets.