A CNN-LSTM Framework for Real-Time Human Action Recognition in Video Sequences

This paper presents an advanced framework for action recognition in video sequences, leveraging the combined strengths of Convolutional Neural Networks (CNNs) and Long Short-Term Memory (LSTM) networks to capture both spatial and temporal dimensions of human activities. The framework processes video input by extracting individual frames and analyzing spatial features through CNNs to determine "what" actions occur in each frame. These extracted features are then passed to an LSTM network, which models the temporal dynamics, allowing the system to understand "how" actions unfold over time. Real-time processing capabilities are enabled through OpenCV, making this approach suitable for applications requiring immediate feedback and dynamic response. The model is trained on a diverse dataset encompassing a range of action classes, achieving high accuracy in recognizing activities from simple gestures to complex behaviors. This CNN-LSTM architecture demonstrates broad applicability across various domains: it can identify abnormal behavior in surveillance settings, enable gesture-based control in human-computer interaction, and analyze athletic performance in sports. By integrating CNNs and LSTMs, this framework enhances automated video analysis capabilities and underscores the potential of deep learning to interpret complex human actions in real-world scenarios. This work represents a significant step forward in video-based action recognition, paving the way for more intelligent, responsive, and robust systems.

Authors

Institutions

Publication Details

Published
2025-02-06
DOI
https://doi.org/10.1109/aide64228.2025.10987297
Citations
1
Primary Topic
Human Pose and Action Recognition
Type
article
Field-Weighted Citation Impact
1.28
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A CNN-LSTM Framework for Real-Time Human Action Recognition in Video Sequences

Somalapura Prakasha Bharath, Ashwin Shenoy M, N. Thillaiarasu, Chaithanya et al.
1 citations
Human Pose and Action Recognition
1.28
article

A CNN-LSTM Framework for Real-Time Human Action Recognition in Video Sequences

Somalapura Prakasha Bharath, Ashwin Shenoy M, N. Thillaiarasu, Chaithanya, N V Bhoomika, Chetan Sangalad
article en
1 citations

Abstract

This paper presents an advanced framework for action recognition in video sequences, leveraging the combined strengths of Convolutional Neural Networks (CNNs) and Long Short-Term Memory (LSTM) networks to capture both spatial and temporal dimensions of human activities. The framework processes video input by extracting individual frames and analyzing spatial features through CNNs to determine "what" actions occur in each frame. These extracted features are then passed to an LSTM network, which models the temporal dynamics, allowing the system to understand "how" actions unfold over time. Real-time processing capabilities are enabled through OpenCV, making this approach suitable for applications requiring immediate feedback and dynamic response. The model is trained on a diverse dataset encompassing a range of action classes, achieving high accuracy in recognizing activities from simple gestures to complex behaviors. This CNN-LSTM architecture demonstrates broad applicability across various domains: it can identify abnormal behavior in surveillance settings, enable gesture-based control in human-computer interaction, and analyze athletic performance in sports. By integrating CNNs and LSTMs, this framework enhances automated video analysis capabilities and underscores the potential of deep learning to interpret complex human actions in real-world scenarios. This work represents a significant step forward in video-based action recognition, paving the way for more intelligent, responsive, and robust systems.

Nitte University (IN), REVA University (IN)
Openalex Percentile: Top 20%
Human Pose and Action Recognition
1.28
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.