The general regularisation scheme applied to conditional density estimation

Abstract

The general regularisation scheme, a versatile approach for nonparametric estimation, has been successfully applied to regression, density ratio, and score estimation. In this paper, we introduce a unified framework encompassing these settings and extend it to conditional density estimation, deriving a new estimator with rigorously established convergence rates. We implement the Landweber regularisation, which is computationally more tractable than Tikhonov regularisation in this context. Numerical experiments demonstrate that our estimator matches or outperforms the Nadaraya-Watson estimator in various scenarios, including time series models.