The Open UniversitySkip to content
 

Locally parametric nonparametric density estimation

Hjort, N. L. and Jones, M. C. (1996). Locally parametric nonparametric density estimation. Annals of Statistics, 24(4) pp. 1619–1647.

URL: http://www.jstor.org/stable/2242742
Google Scholar: Look up in Google Scholar

Abstract

This paper develops a nonparametric density estimator with parametric overtones. Suppose f(x, θ) is some family of densities, indexed by a vector of parameters θ. We define a local kernel-smoothed likelihood function which, for each x, can be used to estimate the best local parametric approximant to the true density. This leads to a new density estimator of the form f(x, ô(x)), thus inserting the best local parameter estimate for each new value of x. When the bandwidth used is large, this amounts to ordinary full likelihood parametric density estimation, while for moderate and small bandwidths the method is essentially nonparametric, using only local properties of data and the model. Alternative ways more general than via the local likelihood are also described. The methods can be seen as ways of nonparametrically smoothing the parameter within a parametric class. Properties of this new semiparametric estimator are investigated. Our preferred version has approximately the same variance as the ordinary kernel method but potentially a smaller bias. The new method is seen to perform better than the traditional kernel method in a broad nonparametric vicinity of the parametric model employed, while at the same time being capable of not losing much in precision to full likelihood methods when the model is correct. Other versions of the method are approximately equivalent to using particular higher order kernels in a semiparametric framework. The methodology we develop can be seen as the density estimation parallel to local likelihood and local weighted least squares theory in nonparametric regression.

Item Type: Journal Article
Copyright Holders: 1996 Institute of Mathematical Statistics
ISSN: 0090-5364
Project Funding Details:
Funded Project NameProject IDFunding Body
Not SetNot SetUniversity of Oslo, Dept. of Mathematics
Keywords: bias reduction; density estimation; kernel smoothing; local likelihood; local modelling; parameter smoothing; semiparametric estimation
Academic Unit/Department: Mathematics, Computing and Technology > Mathematics and Statistics
Item ID: 24911
Depositing User: Sarah Frain
Date Deposited: 05 May 2011 11:15
Last Modified: 05 May 2011 11:15
URI: http://oro.open.ac.uk/id/eprint/24911
Share this page:

Actions (login may be required)

View Item
Report issue / request change

Policies | Disclaimer

© The Open University   + 44 (0)870 333 4340   general-enquiries@open.ac.uk