Simple transformation techniques for improved nonparametric regression

Park, B. U.; Kim, W. C.; Ruppert, D.; Jones, M. C.; Signorini, D. F. and Kohn, R. (1997). Simple transformation techniques for improved nonparametric regression. Scandinavian Journal of Statistics, 24(2) pp. 145–163.

DOI: https://doi.org/10.1111/1467-9469.00055

Abstract

We propose and investigate two new methods for achieving less bias in non- parametric regression. We show that the new methods have bias of order h⁴, where h is a smoothing parameter, in contrast to the basic kernel estimator’s order h². The methods are conceptually very simple. At the first stage, perform an ordinary non-parametric regression on {x_i, Y_i} to obtain m^(x_i) (we use local linear fitting). In the first method, at the second stage, repeat the non-parametric regression but on the transformed dataset {m^(x_i, Y_i)}, taking the estimator at x to be this second stage estimator at m^(x). In the second, and more appealing, method, again perform non-parametric regression on {m^(x_i, Y_i)}, but this time make the kernel weights depend on the original x scale rather than using the m^(x) scale. We concentrate more of our effort in this paper on the latter because of its advantages over the former. Our emphasis is largely theoretical, but we also show that the latter method has practical potential through some simulated examples.

Viewing alternatives

Metrics

Item Actions

Export

You can export this page using these formats Digital Object Identifier - DOI