DSAFN: Dual-Stream Attention Temporal-Spatial Fusion Network for Human Activity Recognition

Human activity recognition (HAR) technology plays a vital role in the field of mobile computing. With the advancement of mobile device intelligence, the number of sensors carried by wearable devices such as smart watches is also increasing, which greatly improves the model's ability to recognize intricate human behaviors. Nevertheless, this advancement also raises the problem of data heterogeneity, which causes the model to encounter the difficulty of data distribution alignment when fusing multi-modal data across different individuals. This paper proposes a dualstream attention temporal-spatial fusion network for Human Activity Recognition (DSFAN) to fully extract the spatio-temporal features of activity data, and then fuses the features of different modalities based on the attention mechanism to extract domain-invariant features to achieve unsupervised domain adaption (UDA). In addition, we conducted experiments on three public HAR datasets to verify the superiority of our proposed model over other models.

Authors

Institutions

Publication Details

Published
2024-12-27
DOI
https://doi.org/10.1109/eiecc64539.2024.10929581
Primary Topic
Context-Aware Activity Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

DSAFN: Dual-Stream Attention Temporal-Spatial Fusion Network for Human Activity Recognition

Shukai Duan, Huosheng Hu, Lidan Wang
Context-Aware Activity Recognition Systems
article

DSAFN: Dual-Stream Attention Temporal-Spatial Fusion Network for Human Activity Recognition

Shukai Duan, Huosheng Hu, Lidan Wang
article en

Abstract

Human activity recognition (HAR) technology plays a vital role in the field of mobile computing. With the advancement of mobile device intelligence, the number of sensors carried by wearable devices such as smart watches is also increasing, which greatly improves the model's ability to recognize intricate human behaviors. Nevertheless, this advancement also raises the problem of data heterogeneity, which causes the model to encounter the difficulty of data distribution alignment when fusing multi-modal data across different individuals. This paper proposes a dualstream attention temporal-spatial fusion network for Human Activity Recognition (DSFAN) to fully extract the spatio-temporal features of activity data, and then fuses the features of different modalities based on the attention mechanism to extract domain-invariant features to achieve unsupervised domain adaption (UDA). In addition, we conducted experiments on three public HAR datasets to verify the superiority of our proposed model over other models.

Southwest University (CN)
National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities
Openalex Percentile: Top 71%
Context-Aware Activity Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

DSAFN: Dual-Stream Attention Temporal-Spatial Fusion Network for Human Activity Recognition — Shukai Duan, Huosheng Hu, et al. · (2024) | TGRS Research Map | TGRS