High-Dimensional Nonsparse Regression under Covariate Shift via Importance-Weighted Partial Least Squares
Youwu Lin, Jianghe Shi, Pei Wang
Abstract
This paper studies high-dimensional nonsparse regression when the data exhibit both strong predictor dependence and covariate shift. Many existing regression methods struggle with highly correlated predictors, while covariate shift can make components learned from source data less effective for target-domain prediction. To address these joint challenges, we develop an importance-weighted partial least squares (IWPLS) method that reweights source observations to reflect the target covariate distribution and extracts response-relevant components for coefficient estimation. The resulting estimator depends on weighted sample covariances, which generally lack the usual Wishart structure even when the target-domain covariates are Gaussian. We therefore combine a perturbation analysis of weighted PLS moments with an influence-function decomposition to establish consistency for the one- and multi-component estimators and asymptotic normality for the one-component estimator. Simulation studies and real-data analyses show that IWPLS outperforms the benchmark methods considered.
Create a lesson
Related papers
Additive Fréchet Regression for Random Objects
Changwon Choi, Wookyeong Song, Hans-Georg Müller et al.
Realized versus Population Reliability: Anytime-Valid Self-Consistency Certification under Correlated Reasoning
Terence D. Agbeyegbe, Toneukarin G. Agbeyegbe
Spatiotemporal Risk-Based Hotspot Dynamics Assessment
José M. Angulo, Ana E. Madrid
Optimal Transport Rank Regression for Robust Multivariate-Response Regression
Yizhe Ding, Yifan Jiang, Runze Li et al.
Statistical Inference with Ill-Conditioned Random Weight Neural Network Sieves
Giovanni Ballarin, Lukas Gonon, Lyudmila Grigoryeva
Causal Effect Estimation Under Uncertain Statistical Surrogacy
Yi Liu, Alexander W. Levis, Shu Yang et al.