Driver Drowsiness Detection Based on Facial Video Non-Contact Heart Rate Measurement

Drowsy driving is a major contributor to traffic accidents, making real-time monitoring of driver drowsiness essential for effective preventive measures. This paper presents a novel method for detecting driver drowsiness through facial video analysis and non-contact heart rate measurement. To address the challenges posed by varying lighting conditions, the algorithm integrates RGB (red, green, and blue) and multi-scale reinforced image color space techniques. This combination enhances the robustness of heart rate signal extraction by generating spatio-temporal maps that minimize the impact of low light. A convolutional neural network is used to accurately map these spatio-temporal features to their corresponding heart rate values. To provide a comprehensive assessment of drowsiness, a differential thresholding method is utilized to extract heart rate variability information. Building on this data, a dynamic drowsiness assessment model is developed using long short-term memory networks. Evaluation results on the corresponding dataset demonstrate a high accuracy rate of 95.1%, underscoring the method’s robustness, which means it can greatly enhance the reliability of drowsiness detection systems, ultimately contributing to a reduction in traffic accidents caused by driver fatigue.