Selection of principal components based on Fisher discriminant ratio

Xiangyan Zeng; Masoud Naghedolfeizi; Sanjeev Arora; Nabil‎ Yousif; Dawit Aberra

doi:10.1117/12.2227045

19 May 2016 Selection of principal components based on Fisher discriminant ratio

Xiangyan Zeng, Masoud Naghedolfeizi, Sanjeev Arora, Nabil‎ Yousif, Dawit Aberra

Proceedings Volume 9871, Sensing and Analysis Technologies for Biomedical and Cognitive Applications 2016; 98710K (2016) https://doi.org/10.1117/12.2227045
Event: SPIE Commercial + Scientific Sensing and Imaging, 2016, Baltimore, MD, United States

Abstract

Principal component analysis transforms a set of possibly correlated variables into uncorrelated variables, and is widely used as a technique of dimensionality reduction and feature extraction. In some applications of dimensionality reduction, the objective is to use a small number of principal components to represent most variation in the data. On the other hand, the main purpose of feature extraction is to facilitate subsequent pattern recognition and machine learning tasks, such as classification. Selecting principal components for classification tasks aims for more than dimensionality reduction. The capability of distinguishing different classes is another major concern. Components that have larger eigenvalues do not necessarily have better distinguishing capabilities. In this paper, we investigate a strategy of selecting principal components based on the Fisher discriminant ratio. The ratio of between class variance to within class variance is calculated for each component, based on which the principal components are selected. The number of relevant components is determined by the classification accuracy. To alleviate overfitting which is common when there are few training data available, we use a cross-validation procedure to determine the number of principal components. The main objective is to select the components that have large Fisher discriminant ratios so that adequate class separability is obtained. The number of selected components is determined by the classification accuracy of the validation data. The selection method is evaluated by face recognition experiments.

Citation Download Citation

Xiangyan Zeng, Masoud Naghedolfeizi, Sanjeev Arora, Nabil‎ Yousif, and Dawit Aberra "Selection of principal components based on Fisher discriminant ratio", Proc. SPIE 9871, Sensing and Analysis Technologies for Biomedical and Cognitive Applications 2016, 98710K (19 May 2016); https://doi.org/10.1117/12.2227045

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available