Skip to main content
Log in

Kernel optimization-based discriminant analysis for face recognition

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

The selection of kernel function and its parameter influences the performance of kernel learning machine. The difference geometry structure of the empirical feature space is achieved under the different kernel and its parameters. The traditional changing only the kernel parameters method will not change the data distribution in the empirical feature space, which is not feasible to improve the performance of kernel learning. This paper applies kernel optimization to enhance the performance of kernel discriminant analysis and proposes a so-called Kernel Optimization-based Discriminant Analysis (KODA) for face recognition. The procedure of KODA consisted of two steps: optimizing kernel and projecting. KODA automatically adjusts the parameters of kernel according to the input samples and performance on feature extraction is improved for face recognition. Simulations on Yale and ORL face databases are demonstrated the feasibility of enhancing KDA with kernel optimization.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Li J-B, Pan J-S, Chu S-C (2008) Kernel class-wise locality preserving projection. Inf Sci 178(7):1825–1835

    Article  MATH  Google Scholar 

  2. Ma B, Qu H-y, Wong H-s (2007) Kernel clustering-based discriminant analysis. Pattern Recognit 40(1):324–327

    Article  MATH  Google Scholar 

  3. Wu X-H, Zhou J-J (2000) Fuzzy discriminant analysis with kernel methods. Pattern Recognit 39(11):2236–2239

    Article  MathSciNet  Google Scholar 

  4. Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. Fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720

    Article  Google Scholar 

  5. Chawla MPS (2008) Segment classification of ECG data and construction of scatter plots using principal component analysis. Int J Mech Med Biol (JMMB), WSPC 8(3):421–458

    Article  Google Scholar 

  6. Chawla MPS (2007) Parameterization and correction of electrocardiogram signals using independent component analysis. Int J Mech Med Biol (JMMB), WSPC 7(4):355–379

    Article  MathSciNet  Google Scholar 

  7. Chawla MPS, Verma HK, Kumar V (2008) Artifacts and noise removal in electrocardiograms using independent component analysis. Int J Cardiol 129(2):278–281

    Article  Google Scholar 

  8. Chawla MPS (2008) A comparative analysis of principal component and independent component techniques for electrocardiograms. Int J Neural Comput Appl (NCA), Springer (available online 23-7-2008)

  9. Chawla MPS, Verma HK, Kumar V (2008) A new statistical PCA–ICA algorithm for location of R-peaks in ECG. Int J Cardiol 129(1):146–148

    Article  Google Scholar 

  10. Lu J, Plataniotis KN, Venetsanopoulos AN (2003) Face recognition using kernel direct discriminant analysis algorithms. IEEE Trans Neural Netw 14(1):117–226

    Article  Google Scholar 

  11. Müller KR, Mika S, Rätsch G, Tsuda K, Schölkopf B (2001) An introduction to kernel-based learning algorithms. IEEE Trans Neural Netw 12:181–201

    Article  Google Scholar 

  12. Liu Q, Lu H, Ma S (2004) Improving kernel fisher discriminant analysis for face recognition. IEEE Trans Pattern Anal Mach Intell 14(1):42–49

    Google Scholar 

  13. Baudat G, Anouar F (2000) Generalized discriminant analysis using a kernel approach. Neural Comput 12:2385–2404

    Article  Google Scholar 

  14. Ruiz A, López de Teruel PE (2001) Nonlinear kernel-based statistical pattern analysis. IEEE Trans Neural Netw 12:16–32

    Article  Google Scholar 

  15. Lu JW, Plataniotis K, Venetsanopoulos AN (2003) Face recognition using kernel direct discriminant analysis algorithms. IEEE Trans Neural Netw 14(1):117–126

    Article  Google Scholar 

  16. Liang ZZ, Shi PF (2005) Uncorrelated discriminant analysis using a kernel method. Pattern Recognit 38(2):307–310

    Article  MATH  Google Scholar 

  17. Liang Z, Shi P (2004) Efficient algorithm for kernel discriminant anlaysis. Pattern Recognit 37(2):381–384

    Article  Google Scholar 

  18. Huang J, Yuen PC, Chen W-S, Lai JH (2004) Kernel Subspace LDA with optimized kernel parameters on face recognition. In: Proceedings of the sixth IEEE international conference on automatic face and gesture recognition

  19. Wang L, Chan KL, Xue P (2005) A criterion for optimizing kernel parameters in KBDA for image retrieval. IEEE Trans Syst Man Cybern B Cybern 35(3):556–562

    Article  Google Scholar 

  20. Chen W-S, Yuen PC, Huang J, Dai D-Q (2005) Kernel machine-based one-parameter regularized fisher discriminant method for face recognition. IEEE Trans Syst Man Cybern B Cybern 35(4):658–669

    Google Scholar 

  21. Micchelli CA, Pontil M (2005) Learning the kernel function via regularization. J Mach Learn Res 6:1099–1125

    MathSciNet  Google Scholar 

  22. Lanckriet G, Cristianini N, Bartlett P, Ghaoui LE, Jordan MI (2004) Learning the kernel matrix with semidefinte programming. J Mach Learn Res 5:27–72

    Google Scholar 

  23. Dai G, Yeung D-Y (2007) Kernel selection for semi-supervised kernel machines. In: Proceedings of the 24th international conference on machine learning, pp 1457–1465

  24. Xiong H, Swamy MNS, Ahmad MO (2005) Optimizing the kernel in the empirical feature space. IEEE Trans Neural Netw 16(2):460–474

    Article  Google Scholar 

  25. Amari S, Wu S (1999) Improving support vector machine classifiers by modifying kernel functions. Neural Netw 12(6):783–789

    Article  Google Scholar 

  26. Li H, Jiang T, Zhang K (2006) Efficient and robust feature extraction by maximum margin criterion. IEEE Trans Neural Netw 17(1):157–164

    Article  Google Scholar 

  27. Samaria F, Harter A (1994) Parameterisation of a stochastic model for human face identification. In: Proceedings of 2nd IEEE workshop on applications of computer vision

  28. Graham DB, Allinson NM (1998) Face recognition: from theory to applications. Comput Syst Sci 163:446–456

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jun-Bao Li.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Li, JB., Pan, JS. & Lu, ZM. Kernel optimization-based discriminant analysis for face recognition. Neural Comput & Applic 18, 603–612 (2009). https://doi.org/10.1007/s00521-009-0282-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-009-0282-y

Keywords

Navigation