Inaccuracy of Ensemble-Based Covariance Propagation, Beyond Sampling Error

Modern data assimilation schemes typically use the same discrete dynamical model to evolve the state estimate in time also to approximate the evolution, or propagation, of the estimation error covariance. Ensemble-based methods, such as the ensemble Kalman filter, approximate the evolution of the covariance through the propagation of individual ensemble members. Thus, it is tacitly assumed that if the discrete state propagation and resulting mean state estimates are accurate, then the ensemble-based discrete covariance propagation will be accurate as well, apart from sampling errors due to limited ensemble size. Through a series of numerical experiments supported by analytical results, we demonstrate that this assumption is false when correlation length scales approach grid resolution. We show for states that satisfy advective dynamics, that while the discrete state propagation and ensemble mean state estimates are accurate, the corresponding ensemble covariances can be remarkably inaccurate, well beyond that expected from sampling errors or typical numerical discretization errors. The underlying problem is a fundamental discrepancy between discrete covariance propagation and the continuum covariance dynamics, which we can identify because the exact continuum covariance dynamics are known. Errors in the ensemble covariances, which can be at least one order of magnitude larger than those of the mean state when correlation lengths begin to approach grid scale, cannot be rectified by the usual methods, such as covariance inflation and localization. This work brings to light a fundamental problem for data assimilation schemes that propagate covariances using the same discrete dynamical model used to propagate the state.

Publication Details

Journal
ArXiv.org
Published
2025-08-22
Primary Topic
Geochemistry and Geologic Mapping
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Inaccuracy of Ensemble-Based Covariance Propagation, Beyond Sampling Error

ArXiv.org
Geochemistry and Geologic Mapping
article

Inaccuracy of Ensemble-Based Covariance Propagation, Beyond Sampling Error

article en

Abstract

Modern data assimilation schemes typically use the same discrete dynamical model to evolve the state estimate in time also to approximate the evolution, or propagation, of the estimation error covariance. Ensemble-based methods, such as the ensemble Kalman filter, approximate the evolution of the covariance through the propagation of individual ensemble members. Thus, it is tacitly assumed that if the discrete state propagation and resulting mean state estimates are accurate, then the ensemble-based discrete covariance propagation will be accurate as well, apart from sampling errors due to limited ensemble size. Through a series of numerical experiments supported by analytical results, we demonstrate that this assumption is false when correlation length scales approach grid resolution. We show for states that satisfy advective dynamics, that while the discrete state propagation and ensemble mean state estimates are accurate, the corresponding ensemble covariances can be remarkably inaccurate, well beyond that expected from sampling errors or typical numerical discretization errors. The underlying problem is a fundamental discrepancy between discrete covariance propagation and the continuum covariance dynamics, which we can identify because the exact continuum covariance dynamics are known. Errors in the ensemble covariances, which can be at least one order of magnitude larger than those of the mean state when correlation lengths begin to approach grid scale, cannot be rectified by the usual methods, such as covariance inflation and localization. This work brings to light a fundamental problem for data assimilation schemes that propagate covariances using the same discrete dynamical model used to propagate the state.

ArXiv.org
Openalex Percentile: Top 65%
Geochemistry and Geologic Mapping
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.