Effective Multivariate Voice Liveness Detection System for Internet of Things Security

Voice assistants, as crucial components of the Internet of Things (IoT), are vulnerable to voice spoofing attacks and pose great threats to the security of IoT. Passive liveness detection distinguishes between genuine and spoofing voices by analyzing the collected voice, eliminating the need for deploying additional sensors. This method plays a crucial role in detecting spoofing speeches and ensuring the security of the IoT. However, current passive liveness detection methods typically require users to adopt specific gestures. Meanwhile, these methods are often designed for specific attacks and cannot accommodate multivariate attacks. To address these challenges, this paper proposes an efficient and robust liveness feature called VoiceID, which utilizes the inherent vocal cord vibrations and voiced language to authenticate the collected voice. The VoiceID is defined as the set of maximum magnitude-peak frequency bins in the magnitude spectrum of each frame for voice. VoiceID can be combined with existing acoustic features to compensate for the granularity gap in extracting fine-grained features and distinguishing between genuine and spoofing voices. Furthermore, to leverage VoiceID, this paper proposes a solid fake voice liveness detection system named SFSys and elaborates on a series of acoustic features that can work with VoiceID. Extensive experiments on authoritative ASVspoof 2019 and ASVspoof 2021 datasets reveal that VoiceID reduces the equal error rate and the minimum tandem decision cost function of the existing acoustic features by at most 6.19% and 0.2479. Moreover, SFSys outperforms existing voice liveness detection schemes and exhibits robustness in various advanced spoofing attack environments.