Resource-constrained edge-based deep learning for real-time person-identification using foot-pad
To build a smart home that assists people with disabilities, we urgently need a non-invasive user identification system capable of recognizing family members in real-time and being easy to use. Existing systems face issues such as privacy concerns from cameras, inconvenience from needing physical contact with sensors, and the requirement to always carry a specific device. Additionally, these systems typically depend on edge nodes to collect data and then transfer it to cloud servers for high-performance inference. This dependency leads to network delays, hindering real-time service, and introducing security issues. To address these requirements, this paper presents a real-time non-invasive user identification system that recognizes users as they step on a foot pad. This study introduces an edge node designed to measure real-time foot pressure distribution data, along with a preprocessing system for data generalization. Additionally, we propose a system that performs real-time user inference using only resource-constrained edge nodes to overcome the challenges of cloud-based systems, including addressing security issues without specific protocols. To achieve this, we optimized various deep learning-based user identification models to be executable on edge nodes and then compared their performance. As a result, using a ResNet18 model through pruning and post quantization training with integer, we achieved inference within 1.5 s with 85% accuracy. Compared to the worst-performing AlexNet, the ResNet18 model shows a substantial reduction in model size by approximately 33%, a decrease in memory usage by about 80%, and a significant increase in inference speed by over tenfold. • It uses foot pressure for user recognition, overcoming biometric impracticalities. • Conducting all tasks at edge node, we resolved issues of security and predictability. • Data preprocessing overcame limits, enabling effective learning with minimal data. • To select the optimal model effectively, we evaluated the AI models comprehensively. • A user-friendly real-time recognition system expandable to smart homes for patients.
Authors
- Soon Ju Kang (ORCID: https://orcid.org/0000-0002-8171-195X)
- Dong Hyuk Heo
- Sung Ho Park (ORCID: https://orcid.org/0000-0001-9356-7791)
Institutions
- Kyungpook National University (KR)
Publication Details
- Journal
- Engineering Applications of Artificial Intelligence
- Published
- 2024-09-09
- DOI
- https://doi.org/10.1016/j.engappai.2024.109290
- Citations
- 5
- Primary Topic
- Gait Recognition and Analysis
- Type
- article
- Field-Weighted Citation Impact
- 0.92
Funders
- Ministry of Education
- National Research Foundation of Korea