Impacts and Statistical Mitigation of Missing Data on the 21 cm Power Spectrum: A Case Study with the Hydrogen Epoch of Reionization Array

Abstract The precise characterization and mitigation of systematic effects is one of the biggest roadblocks impeding the detection of the fluctuations of cosmological 21 cm signals. Missing data in radio cosmological experiments, often due to radio frequency interference (RFI), pose a particular challenge to power spectrum analysis as this could lead to the ringing of bright foreground modes in the Fourier space, heavily contaminating the cosmological signals. Here we show that the problem of missing data becomes even more arduous in the presence of systematic effects. Using a realistic numerical simulation, we demonstrate that partially flagged data combined with systematic effects can introduce significant foreground ringing. We show that such an effect can be mitigated through inpainting the missing data. We present a rigorous statistical framework that incorporates the process of inpainting missing data into a quadratic estimator of the 21 cm power spectrum. Under this framework, the uncertainties associated with our inpainting method and its impact on power spectrum statistics can be understood. These results are applied to the latest Phase II observations taken by the Hydrogen Epoch of Reionization Array, forming a crucial component in power spectrum analyses as we move toward detecting 21 cm signals in the ever more noisy RFI environment.

Authors

Institutions

Publication Details

Journal
The Astrophysical Journal
Published
2025-01-27
DOI
https://doi.org/10.3847/1538-4357/ad9b91
Citations
9
Primary Topic
Radio Astronomy Observations and Technology
Type
article
Field-Weighted Citation Impact
10.39

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Impacts and Statistical Mitigation of Missing Data on the 21 cm Power Spectrum: A Case Study with the Hydrogen Epoch of Reionization Array

Bradley Marero, Haoxuan Zheng, Hans Nuwegeld, Tashalee S. Billings et al.
9 citations
The Astrophysical Journal
Radio Astronomy Observations and Technology
10.39
article

Impacts and Statistical Mitigation of Missing Data on the 21 cm Power Spectrum: A Case Study with the Hydrogen Epoch of Reionization Array

Bradley Marero, Haoxuan Zheng, Hans Nuwegeld, Tashalee S. Billings, James Robnett, Piyanat Kittiwisit, Mário G. Santos, Yin-Zhe Ma, M. F. Morales, Ziyaad Halday, Adrian Liu, Aaron Ewall‐Wice, Jacob Burba, Joshua Kerrigan, Dara Storer, G. Bernardi, Nico Eksteen, Philip Bull, Joshua S. Dillon, Peter Sims, David R. DeBoer, J. Hickish, Tyrone Adams, Mathakane Molewa, Cresshim Malgas, Lourence Malan, Adam P. Beardsley, Jianrong Tan, B. K. Gehlot, Hugh Garsden, Steven Murray, N. Razavi‐Ghods, Adam Lanman, Keith Malgas, Hilton Swarts, Adélie Gorce, Daniel Jacobs, Alec Josaitis, T. Cox, Deepthi Gorthi, Eleanor Rath, Nicholas S. Kern, Michael J. Wilensky, Matthew Kolopanis, Paul La Plante, Saurabh Singh, L. McBride, Zachary E. Martinot, Pieter van Wyngaarden, Ruby Byrne, David MacMahon, Robert Pascua, James Aguirre, Steven R. Furlanetto, Andrei Mesinger, Jacqueline N. Hewitt, Yuxiang Qin, B. J. Hazelton, Samir Choudhuri, Judd D. Bowman, Rushelle Baartman, Aaron R. Parsons, Kingsley Gale‐Sides, Lindsay M. Berkhout, N Mohamed-Hinds, Kai-Feng Chen, Steven Carey, Matt Dexter, John Ely
article en
9 citations

Abstract

Abstract The precise characterization and mitigation of systematic effects is one of the biggest roadblocks impeding the detection of the fluctuations of cosmological 21 cm signals. Missing data in radio cosmological experiments, often due to radio frequency interference (RFI), pose a particular challenge to power spectrum analysis as this could lead to the ringing of bright foreground modes in the Fourier space, heavily contaminating the cosmological signals. Here we show that the problem of missing data becomes even more arduous in the presence of systematic effects. Using a realistic numerical simulation, we demonstrate that partially flagged data combined with systematic effects can introduce significant foreground ringing. We show that such an effect can be mitigated through inpainting the missing data. We present a rigorous statistical framework that incorporates the process of inpainting missing data into a quadratic estimator of the 21 cm power spectrum. Under this framework, the uncertainties associated with our inpainting method and its impact on power spectrum statistics can be understood. These results are applied to the latest Phase II observations taken by the Hydrogen Epoch of Reionization Array, forming a crucial component in power spectrum analyses as we move toward detecting 21 cm signals in the ever more noisy RFI environment.

The Astrophysical JournalVol. 979(2)
Institut d'Astrophysique Spatiale (FR)
National Science Foundation, Gordon and Betty Moore Foundation, Massachusetts Institute of Technology, Canadian Institute for Advanced Research, McGill University, European Commission, National Research Foundation, Mitacs, Natural Sciences and Engineering Research Council of Canada, Science and Technology Facilities Council
Openalex Percentile: Top 2%
Radio Astronomy Observations and Technology
10.39
DOIOpen Access PDFOpenAlex
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.