3D Object Detection System in Scattering Medium Environment

Peplography is a technology for removing scattering media such as fog and smoke. However, Peplography only removes scattering media, and decisions about the images are made by humans. Therefore, there are still many improvements to be made in terms of system automation. In this paper, we combine Peplography with You Only Look Once (YOLO) to attempt object detection under scattering medium conditions. In addition, images reconstructed by Peplography have different characteristics from normal images. Therefore, by applying Peplography to the training images, we attempt to learn the image characteristics of Peplography and improve the detection accuracy. Also, when considering autonomous driving in foggy conditions or rescue systems at the scene of a fire, three-dimensional (3D) information such as the distance to the vehicle in front and the person in need of rescue is also necessary. Furthermore, we apply a stereo camera to this algorithm to achieve 3D object position and distance detection under scattering media conditions. In addition, when estimating the scattering medium in Peplography, it is important to specify the processing area, otherwise the scattering medium will not be removed properly. Therefore, we construct a system that continuously improves processing by estimating the size of the object in object detection and successively changing the area range using the estimated value. As a result, the PSNR result by our proposed method is better than the PSNR by the conventional Peplography process. The distance estimation and the object detection are also verified to be accurate, recording values of 0.989 for precision and 0.573 for recall. When the proposed system is applied, it is expected to have a significant impact on the stability of autonomous driving technology and the safety of life rescue at fire scenes.