The Open UniversitySkip to content
 

A modified principal component technique based on the LASSO

Jolliffe, I.T.; Trendafilov, N.T. and Uddin, M. (2003). A modified principal component technique based on the LASSO. Journal of Computational and Graphical Statistics, 12(3) pp. 531–547.

Full text available as:
[img]
Preview
PDF (Not Set) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (275Kb)
DOI (Digital Object Identifier) Link: http://dx.doi.org/10.1198/1061860032148
Google Scholar: Look up in Google Scholar

Abstract

In many multivariate statistical techniques, a set of linear functions of the original p variables is produced. One of the more difŽ cult aspects of these techniques is the interpretation of the linear functions, as these functions usually have nonzero coefŽ cients on all p variables.A common approach is to effectively ignore (treat as zero) any coefŽ cients less than some threshold value, so that the function becomes simple and the interpretation becomes easier for the users. Such a procedure can be misleading.There are alternatives to
principal component analysis which restrict the coefficients to a smaller number of possible values in the derivationof the linear functions,or replace the principal components by “principal variables.” This article introduces a new technique, borrowing an idea proposed by
Tibshirani in the context of multiple regressionwhere similar problemsarise in interpreting regression equations. This approach is the so-called LASSO, the “least absolute shrinkage and selection operator,” in which a bound is introduced on the sum of the absolute values of the coefficients, and in which some coefficients consequently become zero.We explore some of the propertiesof the newtechnique,both theoreticallyand using simulationstudies, and apply it to an example.

Item Type: Journal Article
ISSN: 1537-2715
Keywords: Interpretation; Principal component analysis; Simplification
Academic Unit/Department: Mathematics, Computing and Technology > Mathematics and Statistics
Item ID: 3949
Depositing User: Nickolay Trendafilov
Date Deposited: 13 Nov 2006
Last Modified: 04 Dec 2010 05:34
URI: http://oro.open.ac.uk/id/eprint/3949
Share this page:

Altmetrics

Scopus Citations

Actions (login may be required)

View Item
Report issue / request change

Policies | Disclaimer

© The Open University   + 44 (0)870 333 4340   general-enquiries@open.ac.uk