Bias‐Eliminating Techniques in the Computation of Power Spectra for Characterizing Gravity Waves: Interleaved Methods and Error Analyses

Abstract Observational data inherently contain noise which manifests as uncertainties in the measured parameters and creates positive biases or noise floors in second‐order products like variances, fluxes, and spectra. Historical methods estimate and subsequently subtract noise floors, but struggle with accuracy. Gardner and Chu (2020, doi.org/10.1364/AO.400375 ) proposed an interleaved data processing method, which inherently eliminates biases from variances and fluxes, and suggested that the method could also eliminate noise floors of power spectra. We investigate the interleaved method for spectral analysis of atmospheric waves through theoretical studies, forward modeling, and demonstration with lidar data. Our work shows that calculating the cross‐power spectral density (CPSD) from two interleaved subsamples does reduce the spectral noise floor significantly. However, only the Co‐PSD (the real part of CPSD) eliminates the noise floor completely, while taking the absolute magnitude of CPSD adds a reduced noise floor back to the spectrum when the sample number is finite. This reduced noise floor can be further minimized through averaging over more observations, completely different from traditional spectrum calculations whose noise floor cannot be reduced by incorporating more samples. We demonstrate the first application of the interleaved method to spectral data, successfully eliminating the noise floor using the Co‐PSD in a forward model and in lidar observations of the vertical wavenumber of gravity waves at McMurdo, Antarctica. This high accuracy is gained by sacrificing precision due to photon‐count splitting, requiring additional observations to counter this effect. We provide quantitative assessment of accuracy and precision as well as application recommendations.

Authors

Institutions

Publication Details

Journal
Earth and Space Science
Published
2024-10-01
DOI
https://doi.org/10.1029/2023ea003499
Citations
3
Primary Topic
Ionosphere and magnetosphere dynamics
Type
article
Field-Weighted Citation Impact
0.99

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Bias‐Eliminating Techniques in the Computation of Power Spectra for Characterizing Gravity Waves: Interleaved Methods and Error Analyses

Jackson Jandreau, Xinzhao Chu
3 citations
Earth and Space Science
Ionosphere and magnetosphere dynamics
0.99
article

Bias‐Eliminating Techniques in the Computation of Power Spectra for Characterizing Gravity Waves: Interleaved Methods and Error Analyses

Jackson Jandreau, Xinzhao Chu
article en
3 citations

Abstract

Abstract Observational data inherently contain noise which manifests as uncertainties in the measured parameters and creates positive biases or noise floors in second‐order products like variances, fluxes, and spectra. Historical methods estimate and subsequently subtract noise floors, but struggle with accuracy. Gardner and Chu (2020, doi.org/10.1364/AO.400375 ) proposed an interleaved data processing method, which inherently eliminates biases from variances and fluxes, and suggested that the method could also eliminate noise floors of power spectra. We investigate the interleaved method for spectral analysis of atmospheric waves through theoretical studies, forward modeling, and demonstration with lidar data. Our work shows that calculating the cross‐power spectral density (CPSD) from two interleaved subsamples does reduce the spectral noise floor significantly. However, only the Co‐PSD (the real part of CPSD) eliminates the noise floor completely, while taking the absolute magnitude of CPSD adds a reduced noise floor back to the spectrum when the sample number is finite. This reduced noise floor can be further minimized through averaging over more observations, completely different from traditional spectrum calculations whose noise floor cannot be reduced by incorporating more samples. We demonstrate the first application of the interleaved method to spectral data, successfully eliminating the noise floor using the Co‐PSD in a forward model and in lidar observations of the vertical wavenumber of gravity waves at McMurdo, Antarctica. This high accuracy is gained by sacrificing precision due to photon‐count splitting, requiring additional observations to counter this effect. We provide quantitative assessment of accuracy and precision as well as application recommendations.

Earth and Space ScienceVol. 11(10)
Cooperative Institute for Research in Environmental Sciences (US), University of Colorado Boulder (US)
National Science Foundation, National Aeronautics and Space Administration, Heliophysics Division
Openalex Percentile: Top 23%
Ionosphere and magnetosphere dynamics
0.99
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.