Design of driver DMS algorithm based on human posture prediction

Distracted driving and fatigued driving are significant contributors to road safety accidents. To enhance driver safety, this study aims to design and develop a Driver DMS (Driver Monitoring System) detection and application system based on human posture prediction. The system integrates intelligent monitoring equipment, and three cameras are installed on the dashboard in front of the driver, the rearview mirror and the window corner in the upper right corner. After experimental debugging, the full coverage of the driver's seat and surrounding areas is realized. These cameras are connected with the vehicle's central control computer and smart phone, which can monitor the driver's driving status in real time and will not affect the driver's normal driving. The system adopts an improved YOLOv5 algorithm, uses Stacking method to fuse models, takes multiple fine-tuning single models as base learners and XGBoost as sub-learners, and retrains the classification results of the base learners to improve the accuracy of driver behavior detection. Secondly, the algorithm combines traditional machine learning technology with convolutional neural network, such as the ability of using traditional machine learning technology to process structured data and the superiority of convolutional neural network in image feature extraction to obtain more accurate output values. Then, the distracted and tired driving state is detected by analyzing the data such as EAR (eye aspect ratio) and PERCLOS (percentage of closed eyes). Additionally, the Jetson Nano deep learning embedded development platform is used to address the system's limited computing power, and a fatigue monitoring alarm strategy is implemented. After software design, system testing and error analysis, the accuracy of the system is 98%, the accuracy of LigthGBM classification is 0.9738, the recall rate of the system is 0.9736, and the F1 score is 0.9735. These data verify the effectiveness of the system and provide a reliable solution to ensure safe driving.