CGAP: A Hybrid Contrastive and Graph-Based Active Learning Pipeline to Detect Water and Sediment in Multispectral Images

In this article, we develop a contrastive graph-based active learning pipeline (CGAP) to identify surface water and near-water sediment pixels in multispectral images. The CGAP enhances the graph-based active learning pipeline (Chen et al., 2023), which outperforms methods such as CNN-Unet, support vector machine, and random forest, while requiring less training data. Active learning plays an important role for training data reduction, resulting in an order of magnitude less training data compared with conventional methods and three or more orders of magnitude less compared with CNN-Unet. Our improvements focus on boosting both the pipeline's robustness and efficiency by integrating a feature-embedding neural network prior to graph construction. This neural network, trained using contrastive learning, performs effective data dimension reduction by projecting high-dimensional raw features into a lower dimensional space, thereby facilitating more efficient graph learning. The training process incorporates specialized augmentations to bolster the embedded features' resilience to geometric transformations, varying resolutions, and light cloud cover. Moreover, we develop a Python-based demo, GraphRiverClassifier, that uses the Google Earth Engine and our enhanced pipeline to provide a user-friendly tool for rapid and accurate surface water and sediment analyses and rapid testing of algorithm performances.

Authors

Institutions

Publication Details

Journal
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Published
2024-11-07
DOI
https://doi.org/10.1109/jstars.2024.3493073
Citations
2
Primary Topic
Advanced Image and Video Retrieval Techniques
Type
article
Field-Weighted Citation Impact
0.50

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

CGAP: A Hybrid Contrastive and Graph-Based Active Learning Pipeline to Detect Water and Sediment in Multispectral Images

Jon Schwenk, Andrea L. Bertozzi, Bohan Chen, Kevin Miller
2 citations
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Advanced Image and Video Retrieval Techniques
0.50
article

CGAP: A Hybrid Contrastive and Graph-Based Active Learning Pipeline to Detect Water and Sediment in Multispectral Images

Jon Schwenk, Andrea L. Bertozzi, Bohan Chen, Kevin Miller
article en
2 citations

Abstract

In this article, we develop a contrastive graph-based active learning pipeline (CGAP) to identify surface water and near-water sediment pixels in multispectral images. The CGAP enhances the graph-based active learning pipeline (Chen et al., 2023), which outperforms methods such as CNN-Unet, support vector machine, and random forest, while requiring less training data. Active learning plays an important role for training data reduction, resulting in an order of magnitude less training data compared with conventional methods and three or more orders of magnitude less compared with CNN-Unet. Our improvements focus on boosting both the pipeline's robustness and efficiency by integrating a feature-embedding neural network prior to graph construction. This neural network, trained using contrastive learning, performs effective data dimension reduction by projecting high-dimensional raw features into a lower dimensional space, thereby facilitating more efficient graph learning. The training process incorporates specialized augmentations to bolster the embedded features' resilience to geometric transformations, varying resolutions, and light cloud cover. Moreover, we develop a Python-based demo, GraphRiverClassifier, that uses the Google Earth Engine and our enhanced pipeline to provide a user-friendly tool for rapid and accurate surface water and sediment analyses and rapid testing of algorithm performances.

IEEE Journal of Selected Topics in Applied Earth Observations and Remote SensingVol. 18
Los Alamos National Laboratory (US), University of California, Los Angeles (US), The University of Texas at Austin (US)
U.S. Department of Energy
Clean water and sanitation
Openalex Percentile: Top 34%
Advanced Image and Video Retrieval Techniques
0.50
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

CGAP: A Hybrid Contrastive and Graph-Based Active Learning Pipeline to Detect Water and Sediment in Multispectral Images — Jon Schwenk, Andrea L. Bertozzi, et al. · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (2024) | TGRS Research Map | TGRS