Generative Data Assimilation of Sparse Weather Station Observations at Kilometer Scales

Abstract Data assimilation of observations into full atmospheric states is essential for weather forecast model initialization. Recently, methods for deep generative data assimilation have been proposed which allow for using new input data without retraining the model. They could also dramatically accelerate the costly data assimilation process used in operational regional weather models. Here, in a central US testbed, we demonstrate the viability of Score‐based Data Assimilation (SDA) in the context of realistically complex km‐scale weather. We train an unconditional diffusion model to generate snapshots of a state‐of‐the‐art km‐scale analysis product, the High Resolution Rapid Refresh. Then, using SDA to incorporate sparse weather station data, the model produces maps of precipitation and surface winds. The generated fields display physically plausible structures, such as gust fronts, and sensitivity tests confirm learned physics through multivariate relationships. Preliminary skill analysis shows the approach already outperforms a naive baseline of the High‐Resolution Rapid Refresh system itself. By incorporating observations from 40 weather stations, 10% lower RMSEs on left‐out stations are attained. Despite some lingering imperfections such as insufficiently disperse ensemble DA estimates, we find the results overall an encouraging proof of concept, and the first at km‐scale. It is a ripe time to explore extensions that combine increasingly ambitious regional state generators with an increasing set of in situ, ground‐based, and satellite remote sensing data streams.

Authors

Institutions

Publication Details

Journal
Journal of Advances in Modeling Earth Systems
Published
2025-10-01
DOI
https://doi.org/10.1029/2024ms004505
Citations
8
Primary Topic
Meteorological Phenomena and Simulations
Type
article
Field-Weighted Citation Impact
10.41
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Generative Data Assimilation of Sparse Weather Station Observations at Kilometer Scales

Michael S. Pritchard, Yair Cohen, Peter Manshausen, Morteza Mardani et al.
8 citations
Journal of Advances in Modeling Earth Systems
Meteorological Phenomena and Simulations
10.41
article

Generative Data Assimilation of Sparse Weather Station Observations at Kilometer Scales

Michael S. Pritchard, Yair Cohen, Peter Manshausen, Morteza Mardani, Karthik Kashinath, Noah Brenowitz, Piyush Garg, Peter Harrington, Simon Byrne
article en
8 citations

Abstract

Abstract Data assimilation of observations into full atmospheric states is essential for weather forecast model initialization. Recently, methods for deep generative data assimilation have been proposed which allow for using new input data without retraining the model. They could also dramatically accelerate the costly data assimilation process used in operational regional weather models. Here, in a central US testbed, we demonstrate the viability of Score‐based Data Assimilation (SDA) in the context of realistically complex km‐scale weather. We train an unconditional diffusion model to generate snapshots of a state‐of‐the‐art km‐scale analysis product, the High Resolution Rapid Refresh. Then, using SDA to incorporate sparse weather station data, the model produces maps of precipitation and surface winds. The generated fields display physically plausible structures, such as gust fronts, and sensitivity tests confirm learned physics through multivariate relationships. Preliminary skill analysis shows the approach already outperforms a naive baseline of the High‐Resolution Rapid Refresh system itself. By incorporating observations from 40 weather stations, 10% lower RMSEs on left‐out stations are attained. Despite some lingering imperfections such as insufficiently disperse ensemble DA estimates, we find the results overall an encouraging proof of concept, and the first at km‐scale. It is a ripe time to explore extensions that combine increasingly ambitious regional state generators with an increasing set of in situ, ground‐based, and satellite remote sensing data streams.

Journal of Advances in Modeling Earth SystemsVol. 17(10)
University of California, Irvine (US), University of Oxford (GB), Nvidia (United States) (US)
Openalex Percentile: Top 1%
Meteorological Phenomena and Simulations
10.41
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.