Using deep learning model integration to build a smart railway traffic safety monitoring system

According to the importance of railway safety, it is crucial to build a smart railway traffic safety system in Taiwan, especially there are often to see related accidents. Therefore, this study aimed to build a smart railway traffic safety system using the integration of object detection, segmentation, machine learning, and notification system. First, the Mask R-CNN model was applied to automatically build the digital boundaries of railway, which achieved an average Interest of Union (IOU) of over 0.9. Then, the YOLO v3 model was applied to detect intrusions of railway, especially humans' intrusion. The above object detection model achieved an Overall accuracy (OA) of over 90% for different classes, and an OA of 95.68% for human detection. The YOLO v3 model was also able to detect intrusion within different scenarios, such as nighttime, rainy daytime, and rainy nighttime. Moreover, the XGBoost model was applied to predict the sizes of intruding objects, which has a low MAE of 0.54 cm and an R2 score of 0.997. Finally, the LINE bot was applied to notify the related operators, including the above information, such as time of intrusion, locations, classes of intruding objects, sizes and the image of intrusion. The above implementation can be helpful for railway traffic safety monitoring, which may help related accidents prevention.