A study on three linear discriminant analysis based methods in small sample size problem

In this paper, we make a study on three Linear Discriminant Analysis (LDA) based methods: Regularized Discriminant Analysis (RDA), Discriminant Common Vectors (DCV) and Maximal Margin Criterion (MMC) in the Small Sample Size (SSS) problem. Our contributions are that: 1) we reveal that DCV obtains the same projection subspace as both RDA and wMMC (weighted MMC, a general form of MMC) when RDA's regularization parameter tends to zero and wMMC's weight parameter approaches to +, which builds on close relationships among these three LDA based methods; 2) we offer efficient algorithms to perform RDA and wMMC in the Principal Component Analysis transformed space, which makes them feasible and efficient to applications such as face recognition; 3) we formulate the eigenvalue distribution of wMMC. On one hand, the formulated eigenvalue distribution can guide practitioners in choosing wMMC's projection vectors, and on the other hand, the underlying methodology can be employed in...

• Type: Journal
• Year: 2008
• Where: PR
• Authors: Jun Liu, Songcan Chen, Xiaoyang Tan
• Keywords: Discriminant Analysis, Discriminant Common Vectors, Eigenvalue Distribution, PR 2008