Integrating Perspectives: A Unified Deep Learning Framework for Human Activity Recognition

Human Activity Recognition (HAR) is vital in healthcare, smart environments, and human-computer interaction. Traditional methods struggle with real-world data complexity. This research presents a new framework combining Graph Convolutional Networks (GCNs) and Recurrent Neural Networks (RNNs) with a dual attention mechanism to boost HAR performance. GCNs model spatial relationships in graph-structured data, capturing dependencies between body joints or sensors. Our approach constructs a graph with nodes for sensors or joints and edges for their spatial connections. GCNs extract spatial features, which are then input into an RNN to model the temporal dynamics of activities. A dual attention mechanism is introduced to enhance the model's focus on relevant information. Spatial attention highlights important nodes, while temporal attention focuses on significant time steps. Experiments on benchmark HAR datasets show that our GCN-RNN dual attention framework outperforms existing methods, improving accuracy and robustness, especially for complex activities. This research demonstrates the potential of combining graph-based spatial modelling with temporal sequence learning and dual attention mechanisms for advanced HAR applications.

Authors

Institutions

Publication Details

Published
2024-09-20
DOI
https://doi.org/10.1109/icdscnc62492.2024.10939249
Primary Topic
Context-Aware Activity Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Integrating Perspectives: A Unified Deep Learning Framework for Human Activity Recognition

Saravanan Matheswaran, G. Karthi, G. Sreelakshmi, D. Madhavi Latha et al.
Context-Aware Activity Recognition Systems
article

Integrating Perspectives: A Unified Deep Learning Framework for Human Activity Recognition

Saravanan Matheswaran, G. Karthi, G. Sreelakshmi, D. Madhavi Latha, G. Vallathan, Dikpal Reddy
article en

Abstract

Human Activity Recognition (HAR) is vital in healthcare, smart environments, and human-computer interaction. Traditional methods struggle with real-world data complexity. This research presents a new framework combining Graph Convolutional Networks (GCNs) and Recurrent Neural Networks (RNNs) with a dual attention mechanism to boost HAR performance. GCNs model spatial relationships in graph-structured data, capturing dependencies between body joints or sensors. Our approach constructs a graph with nodes for sensors or joints and edges for their spatial connections. GCNs extract spatial features, which are then input into an RNN to model the temporal dynamics of activities. A dual attention mechanism is introduced to enhance the model's focus on relevant information. Spatial attention highlights important nodes, while temporal attention focuses on significant time steps. Experiments on benchmark HAR datasets show that our GCN-RNN dual attention framework outperforms existing methods, improving accuracy and robustness, especially for complex activities. This research demonstrates the potential of combining graph-based spatial modelling with temporal sequence learning and dual attention mechanisms for advanced HAR applications.

Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology (IN), Saveetha University (IN)
Openalex Percentile: Top 71%
Context-Aware Activity Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Integrating Perspectives: A Unified Deep Learning Framework for Human Activity Recognition — Saravanan Matheswaran, G. Karthi, et al. · (2024) | TGRS Research Map | TGRS