Improving semantic segmentation accuracy in thin cloud interference scenarios by mixing simulated cloud-covered samples
• Mixing thin cloud-covered samples mitigates thin cloud interference. • Nonlinear terms optimized the atmospheric scattering model. • The catalyst effect of simulated cloud activates the model’s transferability. Thin cloud interference presents a significant challenge for the semantic segmentation of optical satellite imagery, which directly degrades the model accuracy and causes difficulties in sample selection. This paper generated a dataset named Populus euphratica and Tamarix chinensis discrimination (PTD), containing both cloudless and thin cloud scenarios. Based on this PTD dataset, an enhanced Atmospheric Scattering Model with Nonlinear Optimization (ASM_NL) was proposed to simulate high-fidelity thin clouds by incorporating two vital nonlinear terms: the point spread function and the Perlin noise. Additionally, we adopt a strategy of mixing simulated thin cloud-covered images (STCI) into the training set at a certain proportion to improve the semantic segmentation accuracy in thin cloud-covered scenarios. The conclusions are as follows: 1) ASM_NL can simulate high-fidelity clouds at an average Jensen-Shannon distance of 0.0699. 2) When dealing with medium- and high-cloud density datasets, mixing STCI proved to be more effective than cloud removal in mitigating thin cloud interference, resulting in average macro F1 score improvements of 0.164 and 0.094, respectively. 3) The semantic segmentation accuracy improved significantly by mixing STCI with a minimal proportion of 1/60, demonstrating the activation of model transfer capabilities. This study provides a concise and efficient methodology for effectively mitigating thin cloud interference in deep learning-based optical satellite imagery analysis.
Authors
- Linze Bai (ORCID: https://orcid.org/0000-0002-1384-5630)
- Chenghu Zhou (ORCID: https://orcid.org/0000-0003-3331-2302)
- Philippe De Maeyer (ORCID: https://orcid.org/0000-0001-8902-3855)
- Zhanfeng Shen (ORCID: https://orcid.org/0000-0002-8651-7435)
- Tim Van de Voorde (ORCID: https://orcid.org/0000-0002-9324-5087)
- Zihan Zhang (ORCID: https://orcid.org/0000-0003-2544-4487)
- Ruifeng Li (ORCID: https://orcid.org/0000-0002-1383-7745)
- Junli Li (ORCID: https://orcid.org/0000-0002-1054-5966)
- H. Wang (ORCID: https://orcid.org/0009-0001-2467-5331)
Institutions
- Chinese Academy of Sciences (CN)
- Peking University (CN)
- Ghent University (BE)
- Xinjiang Institute of Ecology and Geography (CN)
- Joint Research Center (BE)
- Aerospace Information Research Institute (CN)
- Institute of Geographic Sciences and Natural Resources Research (CN)
- University of Chinese Academy of Sciences (CN)
- Zhejiang University (CN)
Publication Details
- Journal
- International Journal of Applied Earth Observation and Geoinformation
- Published
- 2024-08-13
- DOI
- https://doi.org/10.1016/j.jag.2024.104087
- Citations
- 2
- Primary Topic
- Advanced Neural Network Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.50
Funders
- University of Chinese Academy of Sciences
- National Natural Science Foundation of China-Shenzhen Robotics Research Center Project
- Xinjiang Institute of Ecology and Geography, Chinese Academy of Sciences
- Sichuan Province Youth Science and Technology Innovation Team