Improved Multi-Task Radar Sensing via Attention-Based Feature Distillation and Contrastive Learning
Radar sensing is gaining increasing attention due to its unique advantages, including being device-free, privacy-preserving, and capable of penetrating obstacles. It has been extensively studied in various applications such as human activity recognition, vital sign monitoring, and person identification. However, most existing research focuses on a single specific application, and there remains a lack of studies or datasets dedicated to multi-task radar sensing. In this paper, we collected a dataset for two sensing tasks, including gesture recognition and person identification, via a miniature mm-wave radar. The raw radar signals were processed using micro-Doppler and range-Doppler techniques to extract spectral and spatial representations. We propose an improved multi-task radar sensing framework (MT-DualFormer) that incorporates attention-based cross-task feature distillation and contrastive learning to maximize task performance. MT-DualFormer consists of dual branches with CNN and Transformer modules, capturing both spatial and temporal dependencies in radar data. Attention-based cross-task feature distillation enables knowledge transfer between gesture recognition and person identification tasks. Meanwhile, contrastive learning ensures embedding space separability, facilitating robust task-specific classification. In the evaluation, MT-DualFormer achieves accuracy rates of 98.87% for gesture recognition and 97.96% for person identification, surpassing five representative multi-task approaches and ten state-of-the-art models. This study underscores the importance of leveraging task correlations to enhance the performance of radar-based sensing systems.
Authors
- Kaishun Wu (ORCID: https://orcid.org/0000-0003-2216-0737)
- Anna Li (ORCID: https://orcid.org/0000-0002-5753-1430)
- Jiguang He (ORCID: https://orcid.org/0000-0002-6227-2138)
- Fei Luo (ORCID: https://orcid.org/0000-0001-9760-1520)
- Lu Wang (ORCID: https://orcid.org/0000-0001-6345-3873)
- Bin Jiang (ORCID: https://orcid.org/0000-0002-4044-885X)
- Zitong Yu (ORCID: https://orcid.org/0000-0003-0422-6616)
Institutions
- Shenzhen University (CN)
- Hong Kong University of Science and Technology (HK)
- China University of Petroleum, East China (CN)
- Great Bay University
- Lancaster University (GB)
Publication Details
- Journal
- IEEE Transactions on Information Forensics and Security
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/tifs.2025.3592544
- Citations
- 2
- Primary Topic
- Advanced SAR Imaging Techniques
- Type
- article
- Field-Weighted Citation Impact
- 9.99