Nighttime Driver Fatigue Detection Based on Real-Time Joint Face and Facial Landmarks Detection

Driver fatigue detection (DFD) in low-light nighttime driving environments is crucial for road safety, but it remains challenging due to degraded image quality and computational constraints. This paper proposes a real-time three-stage framework specifically designed for nighttime driver fatigue detection, integrating low-light image enhancement, joint face and facial landmark detection, and geometry-based fatigue judgment. In the initial stage, the framework utilizes the Zero-Reference Deep Curve Estimation (Zero-DCE) algorithm to improve the visual quality of input images under low-light conditions. Subsequently, a novel lightweight single-stage detector, You Only Look Once for Joint Face and Facial Landmark Detection (YOLOJFF), is introduced for efficient joint localization. Finally, fatigue judgment is performed in real-time by calculating the Eye Aspect Ratio (EAR) and Mouth Aspect Ratio (MAR) from the detected landmarks and using a sliding time window strategy. Experimental results demonstrate that the enhancement module significantly improves detection performance. The YOLOJFF model achieves a favorable balance, with 90.9% precision, 87.6% mean Average Precision (mAP), and 5.2 Normalized Mean Error (NME), while requiring only 3.7 million (M) parameters and running at 107.5 FPS. The proposed framework provides a robust and efficient solution for real-time DFD in nighttime scenarios.