Improving semantic segmentation accuracy in thin cloud interference scenarios by mixing simulated cloud-covered samples

• Mixing thin cloud-covered samples mitigates thin cloud interference. • Nonlinear terms optimized the atmospheric scattering model. • The catalyst effect of simulated cloud activates the model’s transferability. Thin cloud interference presents a significant challenge for the semantic segmentation of optical satellite imagery, which directly degrades the model accuracy and causes difficulties in sample selection. This paper generated a dataset named Populus euphratica and Tamarix chinensis discrimination (PTD), containing both cloudless and thin cloud scenarios. Based on this PTD dataset, an enhanced Atmospheric Scattering Model with Nonlinear Optimization (ASM_NL) was proposed to simulate high-fidelity thin clouds by incorporating two vital nonlinear terms: the point spread function and the Perlin noise. Additionally, we adopt a strategy of mixing simulated thin cloud-covered images (STCI) into the training set at a certain proportion to improve the semantic segmentation accuracy in thin cloud-covered scenarios. The conclusions are as follows: 1) ASM_NL can simulate high-fidelity clouds at an average Jensen-Shannon distance of 0.0699. 2) When dealing with medium- and high-cloud density datasets, mixing STCI proved to be more effective than cloud removal in mitigating thin cloud interference, resulting in average macro F1 score improvements of 0.164 and 0.094, respectively. 3) The semantic segmentation accuracy improved significantly by mixing STCI with a minimal proportion of 1/60, demonstrating the activation of model transfer capabilities. This study provides a concise and efficient methodology for effectively mitigating thin cloud interference in deep learning-based optical satellite imagery analysis.

Authors

Institutions

Publication Details

Journal
International Journal of Applied Earth Observation and Geoinformation
Published
2024-08-13
DOI
https://doi.org/10.1016/j.jag.2024.104087
Citations
2
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.50

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Improving semantic segmentation accuracy in thin cloud interference scenarios by mixing simulated cloud-covered samples

Linze Bai, Chenghu Zhou, Philippe De Maeyer, Zhanfeng Shen et al.
2 citations
International Journal of Applied Earth Observation and Geoinformation
Advanced Neural Network Applications
0.50
article

Improving semantic segmentation accuracy in thin cloud interference scenarios by mixing simulated cloud-covered samples

Linze Bai, Chenghu Zhou, Philippe De Maeyer, Zhanfeng Shen, Tim Van de Voorde, Zihan Zhang, Ruifeng Li, Junli Li, H. Wang
article en
2 citations

Abstract

• Mixing thin cloud-covered samples mitigates thin cloud interference. • Nonlinear terms optimized the atmospheric scattering model. • The catalyst effect of simulated cloud activates the model’s transferability. Thin cloud interference presents a significant challenge for the semantic segmentation of optical satellite imagery, which directly degrades the model accuracy and causes difficulties in sample selection. This paper generated a dataset named Populus euphratica and Tamarix chinensis discrimination (PTD), containing both cloudless and thin cloud scenarios. Based on this PTD dataset, an enhanced Atmospheric Scattering Model with Nonlinear Optimization (ASM_NL) was proposed to simulate high-fidelity thin clouds by incorporating two vital nonlinear terms: the point spread function and the Perlin noise. Additionally, we adopt a strategy of mixing simulated thin cloud-covered images (STCI) into the training set at a certain proportion to improve the semantic segmentation accuracy in thin cloud-covered scenarios. The conclusions are as follows: 1) ASM_NL can simulate high-fidelity clouds at an average Jensen-Shannon distance of 0.0699. 2) When dealing with medium- and high-cloud density datasets, mixing STCI proved to be more effective than cloud removal in mitigating thin cloud interference, resulting in average macro F1 score improvements of 0.164 and 0.094, respectively. 3) The semantic segmentation accuracy improved significantly by mixing STCI with a minimal proportion of 1/60, demonstrating the activation of model transfer capabilities. This study provides a concise and efficient methodology for effectively mitigating thin cloud interference in deep learning-based optical satellite imagery analysis.

International Journal of Applied Earth Observation and GeoinformationVol. 133
Chinese Academy of Sciences (CN), Peking University (CN), Ghent University (BE), Xinjiang Institute of Ecology and Geography (CN), Joint Research Center (BE), Aerospace Information Research Institute (CN), Institute of Geographic Sciences and Natural Resources Research (CN), University of Chinese Academy of Sciences (CN), Zhejiang University (CN)
University of Chinese Academy of Sciences, National Natural Science Foundation of China-Shenzhen Robotics Research Center Project, Xinjiang Institute of Ecology and Geography, Chinese Academy of Sciences, Sichuan Province Youth Science and Technology Innovation Team
Openalex Percentile: Top 36%
Advanced Neural Network Applications
0.50
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.