Robust PCA for High Dimensional Data based on Characteristic Transformation
Lingyu He, Yanrong Yang, Bo Zhang
Abstract
In this paper, we propose a novel robust Principal Component Analysis (PCA) for high-dimensional data in the presence of various heterogeneities, especially the heavy-tailedness and outliers. A transformation motivated by the characteristic function is constructed to improve the robustness of the classical PCA. Besides the typical outliers, the proposed method has the unique advantage of dealing with heavy-tail-distributed data, whose covariances could be nonexistent (positively infinite, for instance). The proposed approach is also a case of kernel principal component analysis (KPCA) method and adopts the robust and non-linear properties via a bounded and non-linear kernel function. The merits of the new method are illustrated by some statistical properties including the upper bound of the excess error and the behaviors of the large eigenvalues under a spiked covariance model. In addition, we show the advantages of our method over the classical PCA by a variety of simulations. At last, we apply the new robust PCA to classify mice with different genotypes in a biological study based on their protein expression data and find that our method is more accurately on identifying abnormal mice comparing to the classical PCA.
Create a lesson
Related papers
Pseudo-marginal Sampling for Selective Inference
Jiali He, Sifan Liu
AdaFCP: Local Neural Functional Representations for Industrial Change Detection
Dan Zhuang, Xufei Tang, Yejin Wang et al.
Sufficient Dimension Reduction with Multimodal Predictor Objects
Abdul-Nasah Soale
Economics of Selection in Ranking & Selection: Neither Fixed-Precision nor Fixed-Budget
Stephen E. Chick, Zaile Li, L. Jeff Hong
Regression Modeling for the Bloc Basu Bivariate Exponential Distribution: Marginal and Conditional Means
Osama Idais, Eric Nyarko, Ola Alkhuffash
High-Dimensional Nonsparse Regression under Covariate Shift via Importance-Weighted Partial Least Squares
Youwu Lin, Jianghe Shi, Pei Wang