UNIFIED REPRESENTATION LEARNING FRAMEWORKS FOR WEARABLEBASED HUMAN ACTIVITY RECOGNITION: FROM UNSUPERVISED EMBEDDING TO MULTI-TASK ADAPTATION
Wearable-based Human Activity Recognition (HAR) has become an important element in ubiquitous computing,healthcare monitoring and intelligent human-computer interaction. Nevertheless, current HAR systems facechallenges in terms of generality across different sensor types, users, and activity areas and are mostly because ofthe lack of labelled data and the over reliance on task-specific learning paradigms. In order to overcome thelimitations, recent scholarship has been directed towards unified representation learning frameworks that makeuse of unsupervised, weakly supervised, and multitask adaptation strategies that learn generalisable featureembeddings from multimodal wearable sensor data. This manuscript forms a detailed study on these unifiedframeworks that describes how these frameworks have evolved from unsupervised embedding learning (Sheng &Huber, 2020) and weakly supervised Siamese networks (Sheng & Huber, 2019) to state-of-the-art consistencybased weakly self-supervised approaches (Sheng & Huber, 2024; Sheng & Huber, 2025). It explores how therepresentation learning methods of contrastive learning, self-supervised pre-training and multitask architectures(Samyoun et al., 2022) can improve cross-domain generalisation and reduce the dependence on large amounts ofannotation. Moreover, the review brings together the results of new emergent models such as multimodal andtransformer-based models such as Harformer (Wang, Mo, & Zhu, 2025) and CrossHAR (Hong et al., 2024)pointing to the promise of hierarchical and channel-separated embeddings for domain-invariant representations.The synthesis of the confluence of unsupervised embedding, weakly supervised adaptation and multitask learninghas been identified as the cornerstone of next-generation unified frameworks for scalable, adaptive HAR in avariety of contexts. The article concludes with an overview of outstanding challenges related to modalityimbalance, temporal dynamics alignment, and interpretability, as well as some recommendations for futureresearch in the area of universal representation learning for wearable-based HAR systems.
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2025-10-13
- DOI
- https://doi.org/10.5281/zenodo.17342925
- Primary Topic
- Context-Aware Activity Recognition Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00