Fatigue Driving Detection Based on Facial Multi-Information Feature Fusion

Abstract Driver fatigue driving risk detection is one of the important areas of road traffic safety research in China. According to statistics, more than 40% of China’s traffic accidents every year are related to driver fatigue. In order to reduce this risk, this paper proposes a new method based on facial multi-information feature fusion to realize real-time fatigue driving detection. The method includes using the camera to capture the driver’s face image in real time, combining the face recognition in Dlib library and the detection of 68 key points, and implementing the face detection through OpenCV. Further, the opening and closing states of eyes and mouth were analyzed based on EAR and MAR algorithms, and a reasonable threshold was set to judge fatigue behavior. The HPE head pose estimation method is used to judge the fatigue state by considering the pitch Angle and roll Angle information. Finally, the improved rough set theory comprehensive evaluation method is used to carry out decision fusion processing on the feature results, and intuitively display the system detection results, which is convenient to evaluate the fatigue state of the current driver. The experimental results show that the multi-feature fusion detection method has good real-time performance, the accuracy rate is 94.55%, and the fatigue state can be detected quickly and accurately under various driving attitudes.