TPL-DA: A Novel Threshold-Free Pseudolabel Learning Framework for Domain Adaptive Semantic Segmentation of High-Resolution Remote Sensing Images

Semantic segmentation techniques for remote sensing scene understanding have significantly advanced, enhancing the refined Earth observation. However, most methods highly depend on extensive annotated data, leading to performance deterioration in complex high-resolution remote sensing cross-domain scenes, where variations in image conditions and environments are prevalent. Domain adaptive semantic segmentation (DASS) has been proposed to mitigate the reliance on dense and costly annotations, typically using stagewise training. This article addresses three key challenges in existing DASS methods: 1) insufficient warmup training, limiting potential performance gains; 2) rigid pseudolabel threshold settings in self-training (ST) result in performance bottlenecks; 3) entropy-based prediction bias alone fails to effectively identify high-confidence noise early in ST. To address these issues, we propose a novel threshold-free pseudolabel learning framework, TPL-DA. During the warmup stage, we introduce a multiview bidirectional consistency learning mechanism within a teacher–student architecture. This mechanism employs a bias-free data augmentation strategy, fostering consistent bidirectional predictions in teacher–student networks, thereby enhancing domain generalization and feature robustness. Our multiscale context-enhanced prediction module further amplifies this. In the ST stage, we propose a dynamic threshold-free pseudolabel learning strategy that utilizes well-aligned feature prototypes in the feature space to guide pseudolabel generation in the probability space, eliminating the threshold constraints. In addition, we model uncertainty using relative entropy and incorporate it into the optimization objective to manage high-confidence noise. Extensive experiments on the LoveDA, Potsdam, and Vaihingen datasets demonstrate that TPL-DA consistently outperforms existing methods and popular benchmarks, significantly enhancing DASS performance across diverse cross-domain scenes.

Authors

Institutions

Publication Details

Journal
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Published
2024-11-19
DOI
https://doi.org/10.1109/jstars.2024.3502075
Citations
2
Primary Topic
Remote-Sensing Image Classification
Type
article
Field-Weighted Citation Impact
0.64

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

TPL-DA: A Novel Threshold-Free Pseudolabel Learning Framework for Domain Adaptive Semantic Segmentation of High-Resolution Remote Sensing Images

Yan Ren, Ming Zhang, Guoqing Liu, Jie Long et al.
2 citations
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Remote-Sensing Image Classification
0.64
article

TPL-DA: A Novel Threshold-Free Pseudolabel Learning Framework for Domain Adaptive Semantic Segmentation of High-Resolution Remote Sensing Images

Yan Ren, Ming Zhang, Guoqing Liu, Jie Long, Xi-Xian Gao, Nan Su
article en
2 citations

Abstract

Semantic segmentation techniques for remote sensing scene understanding have significantly advanced, enhancing the refined Earth observation. However, most methods highly depend on extensive annotated data, leading to performance deterioration in complex high-resolution remote sensing cross-domain scenes, where variations in image conditions and environments are prevalent. Domain adaptive semantic segmentation (DASS) has been proposed to mitigate the reliance on dense and costly annotations, typically using stagewise training. This article addresses three key challenges in existing DASS methods: 1) insufficient warmup training, limiting potential performance gains; 2) rigid pseudolabel threshold settings in self-training (ST) result in performance bottlenecks; 3) entropy-based prediction bias alone fails to effectively identify high-confidence noise early in ST. To address these issues, we propose a novel threshold-free pseudolabel learning framework, TPL-DA. During the warmup stage, we introduce a multiview bidirectional consistency learning mechanism within a teacher–student architecture. This mechanism employs a bias-free data augmentation strategy, fostering consistent bidirectional predictions in teacher–student networks, thereby enhancing domain generalization and feature robustness. Our multiscale context-enhanced prediction module further amplifies this. In the ST stage, we propose a dynamic threshold-free pseudolabel learning strategy that utilizes well-aligned feature prototypes in the feature space to guide pseudolabel generation in the probability space, eliminating the threshold constraints. In addition, we model uncertainty using relative entropy and incorporate it into the optimization objective to manage high-confidence noise. Extensive experiments on the LoveDA, Potsdam, and Vaihingen datasets demonstrate that TPL-DA consistently outperforms existing methods and popular benchmarks, significantly enhancing DASS performance across diverse cross-domain scenes.

IEEE Journal of Selected Topics in Applied Earth Observations and Remote SensingVol. 18
Inner Mongolia University of Science and Technology (CN)
National Natural Science Foundation of China, Natural Science Foundation of Inner Mongolia
Openalex Percentile: Top 25%
Remote-Sensing Image Classification
0.64
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.