EFFICIENT PSEUDOINVERSE LINEAR DISCRIMINANT ANALYSIS AND ITS NONLINEAR FORM FOR FACE RECOGNITION
Abstract
Pseudoinverse Linear Discriminant Analysis (PLDA) is a classical and pioneer method that deals with the Small Sample Size (SSS) problem in LDA when applied to such applications as face recognition. However, it is expensive in computation and storage due to direct manipulation on extremely large d × d matrices, where d is the dimension of the sample image. As a result, although frequently cited in literature, PLDA is hardly compared in terms of classification performance with the newly proposed methods. In this paper, we propose a new feature extraction method named RSw + LDA, which is (1) much more efficient than PLDA in both computation and storage; and (2) theoretically equivalent to PLDA, meaning that it produces the same projection matrix as PLDA. Further, to make PLDA deal better with data of nonlinear distribution, we propose a Kernel PLDA (KPLDA) method with the well-known kernel trick. Finally, our experimental results on AR face dataset, a challenging dataset with variations in expression, lighting and occlusion, show that PLDA (or RSw + LDA) can achieve significantly higher classification accuracy than the recently proposed Linear Discriminant Analysis via QR decomposition and Discriminant Common Vectors, and KPLDA can yield better classification performance compared to PLDA and Kernel PCA.
References
- IEEE Trans. Patt. Anal. Mach. Intell. 19, 711 (1997), DOI: 10.1109/34.598228. Crossref, Web of Science, Google Scholar
- IEEE Trans. Patt. Anal. Mach. Intell. 27(1), 4 (2005), DOI: 10.1109/TPAMI.2005.9. Crossref, Web of Science, Google Scholar
- Mach. Learn. 20(3), 273 (1995). Web of Science, Google Scholar
-
K. Fukunaga , Introduction to Statistical Pattern Recognition , 2nd edn. ( Academic Press , 1990 ) . Google Scholar -
G. H. Golub and C. F. V. Van Loan , Matrix Computations ( The Johns Hopkins University Press , 1996 ) . Google Scholar - Appl. Stat. 44, 101 (1995), DOI: 10.2307/2986198. Crossref, Web of Science, Google Scholar
- Imag. Vis. Comput. 24(3), 249 (2006), DOI: 10.1016/j.imavis.2005.11.007. Crossref, Web of Science, Google Scholar
- Patt. Recogn. 41(1), 102 (2008), DOI: 10.1016/j.patcog.2007.06.001. Crossref, Web of Science, Google Scholar
- A. M. Martinez and R. Benavente, The AR face database, Technical Report, CVC (1998) . Google Scholar
- Patt. Recogn. Lett. 19(5–6), 385 (1998), DOI: 10.1016/S0167-8655(98)00016-6. Crossref, Web of Science, Google Scholar
- Neural. Comput. 10(5), 1299 (1998). Crossref, Web of Science, Google Scholar
M. Skurichina and R. Duin , Stabilizing classifiers for very small sample size, Int. Conf. Pattern Recognition (1996) pp. 891–896. Google Scholar- Patt. Anal. Appl. 2(1), 44 (1999), DOI: 10.1007/s100440050013. Crossref, Web of Science, Google Scholar
- Opt. Eng. 25(7), 834 (1986). Web of Science, Google Scholar
- J. Cogn. Neurosci. 3(1), 71 (1991), DOI: 10.1162/jocn.1991.3.1.71. Crossref, Web of Science, Google Scholar
- IEEE Trans. Patt. Anal. Mach. Intell. 27(6), 929 (2005). Web of Science, Google Scholar
