Bayes-SCF: A Bayesian filter to mitigate foreground leakage in the 21-cm power spectrum
Abstract
Missing channels in radio-interferometric visibility data can introduce systematic artefacts into the estimated 21-cm power spectrum. A common workaround is to first estimate the two-frequency correlation C(Δν) and then Fourier-transform it to obtain the power spectrum P(k). This procedure yields an unbiased estimate when the signal is statistically homogeneous (ergodic) along the line-of-sight, but it fails in the presence of non-ergodic foregrounds. Smooth Component Filtering (SCF) has recently been proposed as a solution to this problem, in which the dominant non-ergodic (spectrally smooth) component is removed prior to estimating C(Δν). In existing implementations, the smooth component is estimated by convolving the visibilities with a Hann window along the frequency axis. We demonstrate that this Hann-based SCF performs adequately only when foregrounds are extremely spectrally smooth. It breaks down with increased flagging and when foregrounds exhibit spectral structures. We introduce a Bayesian extension, Bayes-SCF, based on Gaussian Process regression, which overcomes these limitations. Bayes-SCF models the smooth component via a covariance function with a fixed correlation length, enabling controlled and data-driven filtering. Using simulated data, we show that Bayes-SCF robustly recovers the input model 21-cm power spectrum in the presence of spectrally unsmooth foregrounds. The filter is demonstrated to work under different flagging patterns, including 80\% channels being randomly flagged. Bayes-SCF is also effective in a delay-spectrum approach. The primary trade-off introduced by the Bayesian framework is the increased computational cost; future work will focus on optimizing the algorithm and applying it to real Murchison Widefield Array data.
Turn this paper into a full lesson
ArcXiv compiles a staged curriculum from this paper: 8-12 lessons across beginner → advanced, synthesised section guides, visuals, flashcards, a quiz, exercises, and on-demand deep dives per section. Grounded in the abstract, never invented.