Unbiased fully nonlinear data assimilation. Part 2: The stochastic particle flow smoother

Abstract Building on the stochastic particle flow filter (SPFF) introduced in Part 1, this study develops a stochastic particle flow smoother (SPFS) for fully nonlinear data assimilation in high‐dimensional dynamical systems. Whereas the SPFF successfully provides unbiased ensemble spread and handles non‐Gaussian distributions in sequential filtering, many applications require historical state estimates over an extended assimilation window. The SPFS is formulated as a strong‐constraint smoother in which observation information is propagated backward in time to optimize the initial ensemble. In this study, two backward‐propagation strategies are examined. One uses the exact adjoint model, and the other uses an ensemble‐averaged sensitivity matrix approximation. Experiments with the 1000‐dimensional Lorenz 96 system demonstrate that the SPFS with an adjoint model achieves superior trajectory fits compared with the filter, particularly in strongly nonlinear regimes, by allowing particles to follow individual gradients and represent multimodal posteriors. In contrast, the ensemble‐averaged sensitivity matrix approximation, though computationally appealing, degrades in highly nonlinear settings and requires shorter assimilation windows. These results establish the SPFS as an effective solution to the fully nonlinear smoothing problem in high‐dimensional systems.

Authors

Institutions

Publication Details

Journal
Quarterly Journal of the Royal Meteorological Society
Published
2026-11-08
DOI
https://doi.org/10.1002/qj.70346
Primary Topic
Meteorological Phenomena and Simulations
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Unbiased fully nonlinear data assimilation. Part 2: The stochastic particle flow smoother

Hao‐Lun Yeh, Peter Jan van Leeuwen
1 links
Quarterly Journal of the Royal Meteorological Society
Meteorological Phenomena and Simulations
article

Unbiased fully nonlinear data assimilation. Part 2: The stochastic particle flow smoother

Hao‐Lun Yeh, Peter Jan van Leeuwen
article en

Abstract

Abstract Building on the stochastic particle flow filter (SPFF) introduced in Part 1, this study develops a stochastic particle flow smoother (SPFS) for fully nonlinear data assimilation in high‐dimensional dynamical systems. Whereas the SPFF successfully provides unbiased ensemble spread and handles non‐Gaussian distributions in sequential filtering, many applications require historical state estimates over an extended assimilation window. The SPFS is formulated as a strong‐constraint smoother in which observation information is propagated backward in time to optimize the initial ensemble. In this study, two backward‐propagation strategies are examined. One uses the exact adjoint model, and the other uses an ensemble‐averaged sensitivity matrix approximation. Experiments with the 1000‐dimensional Lorenz 96 system demonstrate that the SPFS with an adjoint model achieves superior trajectory fits compared with the filter, particularly in strongly nonlinear regimes, by allowing particles to follow individual gradients and represent multimodal posteriors. In contrast, the ensemble‐averaged sensitivity matrix approximation, though computationally appealing, degrades in highly nonlinear settings and requires shorter assimilation windows. These results establish the SPFS as an effective solution to the fully nonlinear smoothing problem in high‐dimensional systems.

Quarterly Journal of the Royal Meteorological Society
Colorado State University (US)
National Science Foundation, U.S. Department of Defense, National Oceanic and Atmospheric Administration
Meteorological Phenomena and Simulations
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon