Spatiotemporal Conditional Diffusion with a Vision-Language Model: Spatial Quality Modeling for Adaptive Fusion of Radar Forecasts

Combining diffusion forecasts requires decisions about which candidates to retain and how to preserve strong echoes. We propose STCD-VLM, which learns candidate subset quality for adaptive fusion of radar nowcasts. Six observations condition spatiotemporal conditional diffusion (STCD) to generate five candidate sequences covering 120 min. Radar descriptors and representations from a frozen Gemma 4 31B vision-language model (VLM) condition a shared quality network. The network evaluates all 31 nonempty subsets and selects one for the complete sequence, combining its mean and pixelwise maximum. Evaluation on 256 event groups from eight Chinese S-band radar collections yields critical success indices of 0.25871 and 0.12712 at 30 and 40 dBZ. Relative to five-candidate maximum aggregation, these scores increase by 0.04108 and 0.02185, while false alarm ratios decrease by 0.08070 and 0.08203; 15 km fractions skill scores improve by 0.08433 and 0.07822. Fixed five-candidate fusion accounts for most of the mean CSI improvement over maximum aggregation. Adaptive selection adds 0.00170 to this mean under the same fusion rule, with higher CSI30, lower false alarm ratios and slightly lower CSI40. A matched zero-VLM control has similar principal score estimates, leaving the independent benefit of VLM inputs to be established. These comparisons support a quality-guided fusion framework that improves strong-echo overlap and neighborhood coverage agreement relative to maximum aggregation, while producing an event-specific forecast through one sequence-wide subset decision.

Authors

Institutions

Publication Details

Journal
Atmosphere
Published
2026-10-13
DOI
https://doi.org/10.3390/atmos17101005
Primary Topic
Precipitation Measurement and Analysis
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Spatiotemporal Conditional Diffusion with a Vision-Language Model: Spatial Quality Modeling for Adaptive Fusion of Radar Forecasts

Peng Xinjue, Xinwei Qian, Yunfei Zhang, Lu Peng et al.
Atmosphere
Precipitation Measurement and Analysis
article

Spatiotemporal Conditional Diffusion with a Vision-Language Model: Spatial Quality Modeling for Adaptive Fusion of Radar Forecasts

Peng Xinjue, Xinwei Qian, Yunfei Zhang, Lu Peng, Junkai Liu, Xinghai Zhang
article en

Abstract

Combining diffusion forecasts requires decisions about which candidates to retain and how to preserve strong echoes. We propose STCD-VLM, which learns candidate subset quality for adaptive fusion of radar nowcasts. Six observations condition spatiotemporal conditional diffusion (STCD) to generate five candidate sequences covering 120 min. Radar descriptors and representations from a frozen Gemma 4 31B vision-language model (VLM) condition a shared quality network. The network evaluates all 31 nonempty subsets and selects one for the complete sequence, combining its mean and pixelwise maximum. Evaluation on 256 event groups from eight Chinese S-band radar collections yields critical success indices of 0.25871 and 0.12712 at 30 and 40 dBZ. Relative to five-candidate maximum aggregation, these scores increase by 0.04108 and 0.02185, while false alarm ratios decrease by 0.08070 and 0.08203; 15 km fractions skill scores improve by 0.08433 and 0.07822. Fixed five-candidate fusion accounts for most of the mean CSI improvement over maximum aggregation. Adaptive selection adds 0.00170 to this mean under the same fusion rule, with higher CSI30, lower false alarm ratios and slightly lower CSI40. A matched zero-VLM control has similar principal score estimates, leaving the independent benefit of VLM inputs to be established. These comparisons support a quality-guided fusion framework that improves strong-echo overlap and neighborhood coverage agreement relative to maximum aggregation, while producing an event-specific forecast through one sequence-wide subset decision.

AtmosphereVol. 17(10)
China Meteorological Administration (CN)
National Key Research and Development Program of China
Openalex Percentile: Top 20%
Precipitation Measurement and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.