A Novel Classification Model for Suspicious Human Activities in Diverse Environments Using Fused Feature Block and Machine Vision Techniques

Automated detection of suspicious human activities in complex and crowded environments remains a critical challenge in modern surveillance systems due to high false-positive rates, poor contrast and generalization across diverse scenes. We propose a GM_CNN3D Model for the classification of suspicious activity based on a Deep Fused Feature Block (DFFB) framework that integrates handcrafted spatial descriptors (PCA-HOG and Motion-HOG) with deep spatiotemporal features extracted from 3D Convolution Neural Network (3D-CNN). Motion regions are first localized using a Gaussian Mixture Model (GMM), after which handcrafted and deep features are concatenated in a dimensionality-normalized fusion stage, followed by a fully connected layer and softmax classification. The system is evaluated on five diverse and publicly available datasets: Violent Crowd, Hockey Fight, Kaggle Fight, Movies Fight, and Custom Annotated YouTube Clips, achieving up to 99.12% accuracy, 98.7% F1-score, and a ROC-AUC of 0.992, outperforming state-of-the-art CNN, LSTM, and SlowFast models. All datasets include real world scenarios with varying lighting, crowd density, and camera viewpoints, with annotations created manually where unavailable. The proposed method demonstrates robust cross-scene performance, enabling automated alarming and reduced false positives in real-time security operations.

Authors

Institutions

Publication Details

Journal
Digital
Published
2026-04-13
DOI
https://doi.org/10.3390/digital6020030
Primary Topic
Anomaly Detection Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Novel Classification Model for Suspicious Human Activities in Diverse Environments Using Fused Feature Block and Machine Vision Techniques

Fernando B. Duarte, Bushra Mughal, Tiago Cunha Reis, Carlos Jorge Dos Santos Limão Sebastiã
Digital
Anomaly Detection Techniques and Applications
article

A Novel Classification Model for Suspicious Human Activities in Diverse Environments Using Fused Feature Block and Machine Vision Techniques

Fernando B. Duarte, Bushra Mughal, Tiago Cunha Reis, Carlos Jorge Dos Santos Limão Sebastiã
article en

Abstract

Automated detection of suspicious human activities in complex and crowded environments remains a critical challenge in modern surveillance systems due to high false-positive rates, poor contrast and generalization across diverse scenes. We propose a GM_CNN3D Model for the classification of suspicious activity based on a Deep Fused Feature Block (DFFB) framework that integrates handcrafted spatial descriptors (PCA-HOG and Motion-HOG) with deep spatiotemporal features extracted from 3D Convolution Neural Network (3D-CNN). Motion regions are first localized using a Gaussian Mixture Model (GMM), after which handcrafted and deep features are concatenated in a dimensionality-normalized fusion stage, followed by a fully connected layer and softmax classification. The system is evaluated on five diverse and publicly available datasets: Violent Crowd, Hockey Fight, Kaggle Fight, Movies Fight, and Custom Annotated YouTube Clips, achieving up to 99.12% accuracy, 98.7% F1-score, and a ROC-AUC of 0.992, outperforming state-of-the-art CNN, LSTM, and SlowFast models. All datasets include real world scenarios with varying lighting, crowd density, and camera viewpoints, with annotations created manually where unavailable. The proposed method demonstrates robust cross-scene performance, enabling automated alarming and reduced false positives in real-time security operations.

DigitalVol. 6(2)
Universidade Politécnica de Lisboa (PT), Universidade Lusófona (PT)
No poverty
Openalex Percentile: Top 23%
Anomaly Detection Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.