The Manifold-Index Model: provably and efficiently avoiding the statistical and computational curse of dimensionality
Yantao Wu, Mauro Maggioni
Abstract
We study vector-valued regression with predictors filling a tube around an unknown m-dimensional manifold M in RD. In the Manifold-Index Model, the mean response is F=fΠM, where ΠM is the nearest-point projection onto M and f:Mp is a possibly non-injective link function. Multiscale ANisotropic lOcal Regression (MANOR) estimates tangent planes by multiscale PCA of predictors with similar responses, then refines them by pooling outer products of local slopes. The neighborhoods narrow tangentially while retaining complete normal fibers. We assume a Lipschitz link differential and bounded response noise. For p m, under our geometric and sampling conditions, n independent observations give mean tangent-space error of order n-2/(m+4) and integrated squared prediction error at the m-dimensional nonparametric rate n-4/(m+4), up to logarithmic factors. In a scaling regime with fixed intrinsic dimension, model and scale parameters, and ratio of manifold volume to the m-th power of its reach, the required sample size grows polynomially in D+p, and computation is polynomial in n, D and p. Numerical experiments on curves with non-monotone links and surfaces with vector-valued responses compare observed convergence rates with the theoretical bounds; a Langevin dynamics example tests prediction of hitting probabilities under an approximate manifold-index model.
Create a lesson
Related papers
Bayesian optimization on amortized search space
Tristan Fauvel, Federico Pavone, Titouan Guillou et al.
Exact Bayesian layers via characteristic functions
William H. W. Thompson, Guillaume St-Onge, Laurent Hébert-Dufresne et al.
Flow Matching from Non-Gaussian Sources: A Theory of Efficient Sampling
Yuchen Zhou, Lili Zheng, Yuxin Chen et al.
Conformal Selection for Hierarchical Streaming Data
Zhenyuan Sun, Chengyao Yu, Ruixing Ming et al.
A Statistical Framework for Training Data Auditing of Large Language Models
Shengjie Niu, Yeheng Ge, Jian Huang
Hellinger Decision Trees for Density Ratio Estimation: Finite-Sample Guarantees
Ren-Rui Liu, Zheng-Chu Guo