DIAT-DSCNN-GRU-HARNet: A Lightweight DCNN for Video Based Classification of Human Activities

The research in computer vision and pattern recognition focuses on detecting and classifying human actions in videos. Using standard convolution for spatial feature extraction leads to large parameters, causing issues like lower performance, overfitting, slow training, and poor prediction. For temporal feature extraction, recurrent neural networks (RNN) are used but these face vanishing gradient problem. Another variant of RNN i.e. long short term memory faces problem of high computational cost. To solve these issues, lightweight convolution neural network model is being proposed named as “DIAT-DSCNN-GRU-HARNet”. This model classifies human activities in videos using separable convolution, dilated convolution, and gated recurrent unit, considering parameters, model size, and floating point operations. We conducted in-depth experiments using realistic videos of UCF-ARG-Arial, UCF-ARG-Ground, and HON4D, comparing results with other approaches to demonstrate the effectiveness of our suggested technique.