Signal detection from spiked noise via asymmetrization
Abstract
The signal plus noise model H=S+Y is a fundamental model in signal detection when a low rank signal S is polluted by noise Y. In the high-dimensional setting, one often uses the leading singular values and corresponding singular vectors of H to conduct the statistical inference of the signal S. Especially, when Y consists of iid random entries, the singular values of S can be estimated from those of H as long as the signal S is strong enough. However, when the Y entries are heteroscedastic or heavy-tailed, this standard approach may fail. Especially in this work, we consider a situation that can easily arise with heteroscedastic or heavy-tailed noise but is particularly difficult to address using the singular value approach, namely, when the noise Y itself may create spiked singular values. It has been a recurring question how to distinguish the signal S from the spikes in Y, as this seems impossible by examining the leading singular values of H. Inspired by the work CCF21, we turn to study the eigenvalues of an asymmetrized model when two samples H1=S+Y1 and H2=S+Y2 are available. We show that by looking into the leading eigenvalues (in magnitude) of the asymmetrized model H1H2*, one can easily detect S. We will primarily discuss the heteroscedastic case and then discuss the extension to the heavy-tailed case. As a byproduct, we also derive the fundamental result regarding the outlier of non-Hermitian random matrix in Tao under the minimal 2nd moment condition.
Turn this paper into a full lesson
ArcXiv compiles a staged curriculum from this paper: 8-12 lessons across beginner → advanced, synthesised section guides, visuals, flashcards, a quiz, exercises, and on-demand deep dives per section. Grounded in the abstract, never invented.