A Hybrid Spatiotemporal Fusion Model for Real-time Fall Detection

We propose a hybrid spatiotemporal fusion model for real‑time fall detection using monocular camera videos. Per-frame spatial features are extracted by a lightweight CNN with squeeze-and-excitation modules, an AutoEncoder reduces noise to generate core representations, and a two-layer GRU together with a Transformer encoder jointly learns temporal flow and global relations. Multi-task learning that combines classification error (cross-entropy) and reconstruction error (MSE) enables discrimination of subtle pre-fall motions. Evaluated on sequences (30 frames by default) compiled from multiple public datasets with a subject-wise split, the proposed model achieves 97.10% accuracy (67/69), 100% recall for falls (FN=0), and ROC–AUC of 1.00. With 0.91 GFLOPs, 3.22 M parameters, and an average inference delay of 8.16 ms per sample, its usability in edge environments is verified.

Authors

Publication Details

Journal
Journal of Institute of Control Robotics and Systems
Published
2026-02-12
DOI
https://doi.org/10.5302/j.icros.2026.25.0248
Primary Topic
Context-Aware Activity Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Hybrid Spatiotemporal Fusion Model for Real-time Fall Detection

EunYoung Kim, Jaeho Lee
Journal of Institute of Control Robotics and Systems
Context-Aware Activity Recognition Systems
article

A Hybrid Spatiotemporal Fusion Model for Real-time Fall Detection

EunYoung Kim, Jaeho Lee
article en

Abstract

We propose a hybrid spatiotemporal fusion model for real‑time fall detection using monocular camera videos. Per-frame spatial features are extracted by a lightweight CNN with squeeze-and-excitation modules, an AutoEncoder reduces noise to generate core representations, and a two-layer GRU together with a Transformer encoder jointly learns temporal flow and global relations. Multi-task learning that combines classification error (cross-entropy) and reconstruction error (MSE) enables discrimination of subtle pre-fall motions. Evaluated on sequences (30 frames by default) compiled from multiple public datasets with a subject-wise split, the proposed model achieves 97.10% accuracy (67/69), 100% recall for falls (FN=0), and ROC–AUC of 1.00. With 0.91 GFLOPs, 3.22 M parameters, and an average inference delay of 8.16 ms per sample, its usability in edge environments is verified.

Journal of Institute of Control Robotics and SystemsVol. 32(2)
Reduced inequalities, Peace, Justice and strong institutions
Openalex Percentile: Top 58%
Context-Aware Activity Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.