Multi-Property Infrared Sensor Array for Intelligent Human Tracking in Privacy-Preserving Ambient Assisted Living

This paper deals with a privacy-preserving human tracking system that uses multi-property infrared sensor arrays. In the growing field of intelligent elderly care, there is a critical need for monitoring systems that ensure safety without compromising personal privacy. While traditional camera-based systems offer detailed activity recognition, privacy-related concerns often limit their practical application and user acceptance. Consequently, approaches that protect privacy at the sensor level have gained increasing attention. The privacy-preserving human tracking system proposed in this paper protects privacy at the sensor level by fusing data from an ultra-low-resolution 8×8 (64-pixel) passive thermal infrared (IR) sensor array and a similarly low-resolution 8×8 active Time-of-Flight (ToF) sensor. The thermal sensor identifies human presence based on heat signature, while the ToF sensor provides a depth map of the environment. By integrating these complementary modalities through a convolutional neural network (CNN) enhanced with a cross-attention mechanism, our system achieves real-time three-dimensional human tracking. Compared to previous methods using ultra-low-resolution IR sensors, which mostly only obtained two-dimensional coordinates, the acquisition of the Z coordinate enables the system to analyze changes in a person’s vertical position. This allows for the detection and differentiation of critical events such as falls, sitting, and lying down, which are ambiguous to 2D systems. With a demonstrated mean absolute error (MAE) of 0.172 m in indoor tracking, our system provides the data required for privacy-preserving Ambient Assisted Living (AAL) applications.