Restoration of Atmospheric Turbulence-degraded Images Based on Contrastive Learning

Image degradation caused by atmospheric turbulence seriously affects the performance of downstream computer vision tasks such as object detection and image recognition.Existing deep learning-based image restoration models for atmospheric turbulence degradation have achieved good performance,but have not fully utilized the feature information of the turbulence effect.To improve restoration results,a method for restoring of atmospheric turbulence-degraded images based on contrastive learning is proposed.Aiming at the blurring and distortion caused by atmospheric turbulence degradation,a turbulence mitigation block is designed,which integrates a Transformer-based channel information interaction module and a CNN-based spatial information interaction module to suppress the turbulence interference to the image at both global and local levels.At the same time,contrastive learning is introduced to consider the clear image and the degraded image of atmospheric turbulence as positive and negative samples,to pull the output of the atmospheric turbulence restoration network closer to the positive samples and push it farther away from the negative samples in the feature space,so that feature extraction and image restoration can be performed more efficiently.The proposed method achieves 26.78 dB and 22.42 dB PSNR and 0.790 9 and 0.682 0 SSIM on the synthetic Helen dataset and synthetic Places dataset,respectively,which is the best result compared with the existing five methods,and it is suitable for improving the quality of atmospheric turbulence degradation images.