Constraint principal components for linear discrimination

In many modern data, the number of variables is much higher than the number of observations and the within-group scatter matrix is singular. Then, the Fisher's linear discriminant analysis (LDA) cannot be applied. The work considers a way to circumvent this problem by doing principal component...

Full description

Saved in:
Bibliographic Details
Published inInformation sciences Vol. 645; p. 119353
Main Authors Trendafilov, N., Gallo, M., Simonacci, V., Todorov, V.
Format Journal Article
LanguageEnglish
Published Elsevier Inc 01.10.2023
Subjects
Dimension reduction
Discriminating PCA
Orthogonal rotations
Dimension reduction
Discriminating PCA
Orthogonal rotations
Online AccessGet full text

Cover

More Information
Summary:In many modern data, the number of variables is much higher than the number of observations and the within-group scatter matrix is singular. Then, the Fisher's linear discriminant analysis (LDA) cannot be applied. The work considers a way to circumvent this problem by doing principal component analysis (PCA) enhanced with additional discriminating features. Two approaches are proposed: the original PCs are rotated to maximize the Fisher's LDA criterion, and second, penalized PCs are produced to achieve simultaneous dimension reduction and maximization of the Fisher's LDA criterion. Both approaches are illustrated and compared to other existing methods on several well known data sets.
ISSN:0020-0255
1872-6291
DOI:10.1016/j.ins.2023.119353