Deep Learning Techniques and Behavior Recognition in Video Image Sequence Analysis

Aiming at the performance bottleneck of distinguishing complex scenes and similar actions in video behavior recognition, a hybrid neural network architecture based on spatio-temporal feature fusion is constructed in this study. By organically integrating the spatial perception advantages of 3D convolutional neural network and the time series modeling capabilities of long-term and short-term memory networks, a double-stream feature interaction framework is innovatively designed: 3D-CNN is used to analyze the spatial topological relationship of objects in video frames, and LSTM is used to capture the time series law of cross-frame motion evolution. In the feature fusion stage, an attention weighting mechanism is introduced to dynamically adjust the contribution weight of spatio-temporal features, forming a multi-level behavior representation. After datasets testing, the average recognition accuracy of the model on UCF101 and HMDB51 benchmarks reaches 94.7% and 72.3%, respectively, which is 5.2% higher than that of the benchmark method. The validation experiment of the module shows that the combined training strategy of spatio-temporal features can reduce the recognition error rate of the model for occluded scenes by 31%, while applying the attention mechanism can improve the article discrimination of similar actions by 19.8%. This study provides a more interpretable feature fusion paradigm for dynamic visual understanding.

Authors

Institutions

Publication Details

Published
2024-12-13
DOI
https://doi.org/10.1145/3735014.3735882
Primary Topic
Video Surveillance and Tracking Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Deep Learning Techniques and Behavior Recognition in Video Image Sequence Analysis

Dan Zeng
Video Surveillance and Tracking Methods
article

Deep Learning Techniques and Behavior Recognition in Video Image Sequence Analysis

Dan Zeng
article en

Abstract

Aiming at the performance bottleneck of distinguishing complex scenes and similar actions in video behavior recognition, a hybrid neural network architecture based on spatio-temporal feature fusion is constructed in this study. By organically integrating the spatial perception advantages of 3D convolutional neural network and the time series modeling capabilities of long-term and short-term memory networks, a double-stream feature interaction framework is innovatively designed: 3D-CNN is used to analyze the spatial topological relationship of objects in video frames, and LSTM is used to capture the time series law of cross-frame motion evolution. In the feature fusion stage, an attention weighting mechanism is introduced to dynamically adjust the contribution weight of spatio-temporal features, forming a multi-level behavior representation. After datasets testing, the average recognition accuracy of the model on UCF101 and HMDB51 benchmarks reaches 94.7% and 72.3%, respectively, which is 5.2% higher than that of the benchmark method. The validation experiment of the module shows that the combined training strategy of spatio-temporal features can reduce the recognition error rate of the model for occluded scenes by 31%, while applying the attention mechanism can improve the article discrimination of similar actions by 19.8%. This study provides a more interpretable feature fusion paradigm for dynamic visual understanding.

Wuhan Ship Development & Design Institute (CN)
Openalex Percentile: Top 69%
Video Surveillance and Tracking Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.