Deep Learning Approaches for Cloud Property Retrieval: Leveraging Geospatial Foundation Models and Multitask Frameworks

With the rapid growth of Earth-observation datasets, geospatial foundation models (FMs) provide a scalable approach to learn transferable features across diverse satellite sensor data. However, their cross-sensor adaptation ability needs more exploration. To study this issue, we present a benchmarking study of SatVision-TOA, an FM pre-trained on over 20 years of MODIS data, when adapted to the GOES NOAA ABI sensor for four downstream cloud properties: cloud mask, cloud phase (segmentation), and cloud optical depth (COD) and cloud particle size (CPS) (regression). We propose a multi-task learning fine-tuning pipeline with a U-Net-based decoder and a lightweight preprocessor to address band-mismatch handling (14 MODIS bands for pre-training vs. 16 ABI bands for fine-tuning). To evaluate our pipeline, we benchmark fine-tuned models against from-scratch baselines, evaluate full fine-tuning (FFT) versus parameter-efficient fine-tuning (PEFT) methods (LoRA, VPT), and compare 14-band versus 16-band inputs. Our experiments show that multi-task learning improves efficiency and predictive quality in both fine-tuned and from-scratch settings. For the other four comparisons (FT vs. from-scratch, FFT vs. PEFT, 14-bands vs. 16-bands and loss functions), the results are mixed and there is no setup that always performs the best for all segmentation and regression tasks.

Authors

Publication Details

Journal
Maryland Shared Open Access Repository (USMAI Consortium)
Published
2025-04-01
DOI
https://doi.org/10.13016/m2hows-tdmj
Primary Topic
Atmospheric aerosols and clouds
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Deep Learning Approaches for Cloud Property Retrieval: Leveraging Geospatial Foundation Models and Multitask Frameworks

Jordan A. Caraballo‐Vega, Caleb Parten, Jie Gong, Danielle Murphy et al.
Maryland Shared Open Access Repository (USMAI Consortium)
Atmospheric aerosols and clouds
article

Deep Learning Approaches for Cloud Property Retrieval: Leveraging Geospatial Foundation Models and Multitask Frameworks

Jordan A. Caraballo‐Vega, Caleb Parten, Jie Gong, Danielle Murphy, Xingyan Li, Jianwu Wang, Kevin Zhang, Mark Carroll, Haoxiang Zhang, Autumn Sterling
article en

Abstract

With the rapid growth of Earth-observation datasets, geospatial foundation models (FMs) provide a scalable approach to learn transferable features across diverse satellite sensor data. However, their cross-sensor adaptation ability needs more exploration. To study this issue, we present a benchmarking study of SatVision-TOA, an FM pre-trained on over 20 years of MODIS data, when adapted to the GOES NOAA ABI sensor for four downstream cloud properties: cloud mask, cloud phase (segmentation), and cloud optical depth (COD) and cloud particle size (CPS) (regression). We propose a multi-task learning fine-tuning pipeline with a U-Net-based decoder and a lightweight preprocessor to address band-mismatch handling (14 MODIS bands for pre-training vs. 16 ABI bands for fine-tuning). To evaluate our pipeline, we benchmark fine-tuned models against from-scratch baselines, evaluate full fine-tuning (FFT) versus parameter-efficient fine-tuning (PEFT) methods (LoRA, VPT), and compare 14-band versus 16-band inputs. Our experiments show that multi-task learning improves efficiency and predictive quality in both fine-tuned and from-scratch settings. For the other four comparisons (FT vs. from-scratch, FFT vs. PEFT, 14-bands vs. 16-bands and loss functions), the results are mixed and there is no setup that always performs the best for all segmentation and regression tasks.

Maryland Shared Open Access Repository (USMAI Consortium)
National Science Foundation, University of Maryland, Baltimore County, Centre International de Recherche sur le Cancer, National Institutes of Health
Openalex Percentile: Top 29%
Atmospheric aerosols and clouds
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.