Statistical Properties of Nonparametric MLE under Laplace Noise
Yifei Xiong, Nianqiao Phyllis Ju, Vinayak Rao
Abstract
Local differential privacy (LDP) protects individuals in a dataset by perturbing each measurement before release. For real-valued data, a widely used mechanism is additive Laplace noise. We study the problem of estimating the distribution of the latent confidential data from the privatized observations via the nonparametric maximum likelihood estimator (NPMLE) under an i.i.d. sampling model. We first show that under the Laplace convolution model, the NPMLE admits a finite-dimensional reformulation in which the support is restricted to the observation set. This reduces the original infinite-dimensional optimization over all mixing distributions to an n-dimensional convex optimization over mixture weights, where n is the sample size. We then study the statistical convergence of the NPMLE under the 1-Wasserstein distance, and explicitly connect its convergence rate with the privacy noise scale. Allowing the privacy noise level to change with the sample size, our analysis shows that the NPMLE remains consistent when the Laplace noise grows at a rate slower than n3/16. Conversely, when the Laplace noise is of the order n or larger, no estimator can achieve uniformly consistent recovery of the latent distribution.
Create a lesson
Related papers
Conformal Prediction Through the Lens of Hypothesis Testing: Universality, Impossibility, and Optimality
Ryan J. Tibshirani, Rina Foygel Barber, Aaditya Ramdas
Connecting Riemannian Geometry and Statistical Inference for Correlation Matrices
Argyn Kuketayev
How far can symmetry help? Phase transitions and symmetry selection in sparse functional data analysis
Jocelyn Nembe
Posterior consistency for subdiffusion inverse problems
Haoyu Lu, Shaokang Zu, Junxiong Jia
Dimension comparison for Student's statistic under symmetric unimodality
Jacopo Lenzi
Weighted Estimation by Discrete-time Sparse Domination on Martingale Spaces
Wei Chen, Chaoyue Zhang, Gege Zhang