Simple transformation techniques for improved nonparametric regression

Park, B. U.; Kim, W. C.; Ruppert, D.; Jones, M. C.; Signorini, D. F. and Kohn, R. (1997). Simple transformation techniques for improved nonparametric regression. Scandinavian Journal of Statistics, 24(2) pp. 145–163.



We propose and investigate two new methods for achieving less bias in non- parametric regression. We show that the new methods have bias of order h4, where h is a smoothing parameter, in contrast to the basic kernel estimator’s order h2. The methods are conceptually very simple. At the first stage, perform an ordinary non-parametric regression on {xi, Yi} to obtain m^(xi) (we use local linear fitting). In the first method, at the second stage, repeat the non-parametric regression but on the transformed dataset {m^(xi, Yi)}, taking the estimator at x to be this second stage estimator at m^(x). In the second, and more appealing, method, again perform non-parametric regression on {m^(xi, Yi)}, but this time make the kernel weights depend on the original x scale rather than using the m^(x) scale. We concentrate more of our effort in this paper on the latter because of its advantages over the former. Our emphasis is largely theoretical, but we also show that the latter method has practical potential through some simulated examples.

Viewing alternatives


Public Attention

Altmetrics from Altmetric

Number of Citations

Citations from Dimensions

Item Actions