Detection Is Harder Than Estimation in Certain Regimes: Inference for Moment and Cumulant Tensors
Abstract
We study estimation and detection of high-order moment and cumulant tensors from n i.i.d.\ observations of a p-dimensional random vector, with performance measured in tensor spectral norm. Under sub-Gaussianity, we show that the minimax rate for estimating the order-d moment and cumulant tensors is p/n 1. In contrast to covariance estimation, the sample moment tensor is generally not rate-optimal for d 3, and we construct an estimator that attains the minimax rate up to logarithmic factors. On the computational side, we study testing whether the d-th order cumulant tensor vanishes after whitening. Using the low-degree polynomial framework, we provide evidence that detection is computationally hard when n pd/2. At the same time, we identify a regime in which an efficiently computable estimator achieves error smaller than the separation at which low-degree tests can reliably distinguish the null from the alternative. This reveals an unusual reverse detection--estimation gap: computationally efficient detection can be harder than computationally efficient estimation. The underlying reason is that the relevant loss, tensor spectral norm, is itself NP-hard to compute, creating a new form of computational--statistical gap.
Turn this paper into a full lesson
ArcXiv compiles a staged curriculum from this paper: 8-12 lessons across beginner → advanced, synthesised section guides, visuals, flashcards, a quiz, exercises, and on-demand deep dives per section. Grounded in the abstract, never invented.