FE-SpikeFormer: A Camera-Based Facial Expression Recognition Method for Hospital Health Monitoring
Facial expression recognition has emerged as a critical research area in health monitoring, enabling healthcare professionals to assess patients' emotional and psychological states for timely intervention and personalized care. However, existing methods often struggle to balance computational accuracy with energy efficiency. To address this challenge, this paper proposes FE-SpikeFormer - a high-accuracy, low-energy, and deployment-friendly Spiking Neural Network (SNN) for facial emotion recognition. The proposed architecture comprises three key components: the initial convolution module, the spiking extraction block, and the spiking integration block. These three modules collectively support detailed and contextual feature extraction, promote spatial feature integration, and strengthen the representational capacity of spiking signals. Meanwhile, a joint verification is conducted in both controlled laboratory settings and real-world hospital scenarios. Experimental results demonstrate that FE-SpikeFormer achieves top-three recognition accuracy among state-of-the-art methods, while utilizing only 6.93 million parameters. Moreover, it exhibits strong robustness against various noise conditions, underscoring its potential for practical deployment in healthcare environments.
Authors
- Shiqi Zhou (ORCID: https://orcid.org/0000-0003-1220-3342)
- Minjiang Chen (ORCID: https://orcid.org/0000-0002-4040-6115)
- Chun Sing Lai (ORCID: https://orcid.org/0000-0002-4169-4438)
- Zhekang Dong (ORCID: https://orcid.org/0000-0003-4639-3834)
- Liyan Zhu (ORCID: https://orcid.org/0009-0005-3238-9932)
- Xiaoyue Ji (ORCID: https://orcid.org/0000-0002-3526-5215)
- Jiansong Ji (ORCID: https://orcid.org/0000-0003-4727-2794)
Institutions
- Center for Special Minimally Invasive and Robotic Surgery (US)
- Hangzhou Dianzi University (CN)
- Brunel University of London (GB)
- Tsinghua University (CN)
Publication Details
- Journal
- IEEE Journal of Biomedical and Health Informatics
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/jbhi.2025.3589267
- Primary Topic
- Face recognition and analysis
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation