Skip to main content
SpringerLink
Log in

Orthogonal margin discriminant projection for dimensionality reduction

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Dimensionality reduction aims to represent high-dimensional data with much smaller number of features, which plays as a preprocessing step to remove the insignificant and irrelevant features in many machine learning applications, resulting in lower computational cost and better performance of classifiers. In most cases, the data points can be well classified with margin samples which are defined as furthest intra-class samples and nearest inter-class samples. Motivated by this observation, this paper proposes a linear supervised dimensionality reduction method called orthogonal margin discriminant projection (OMDP). After OMDP projection, intra-class data points become more compact and inter-class data points become more separated. Extensive experiments have been conducted to evaluate the proposed OMDP algorithm using several benchmark face data sets. The experimental results confirm the effectiveness of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. http://www.sheffield.ac.uk/eee/research/iel/research/face.

  2. http://www.cad.zju.edu.cn/home/dengcai/Data/FaceData.html.

  3. http://www.uk.research.att.com/facedatabase.html.

  4. http://www.cad.zju.edu.cn/home/dengcai/Data/FaceData.html.

  5. http://cvc.yale.edu/projects/yalefaces/yalefaces.html.

  6. http://rvl1.ecn.purdue.edu/~aleix/aleix_face_DB.html.

  7. http://www.cs.nthu.edu.tw/~htchen/.

References

  1. Tenenbaum JB, de Silva V, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290:2319–2323

    Article  Google Scholar 

  2. Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290:2323–2326

    Article  Google Scholar 

  3. Donoho DL, Grimes C (2003) Hessian eigenmaps: locally linear embedding techniques for high-dimensional data. In: Proceedings of the National Academy of Sciences, vol 100. issue 10, pp 5591–5596

  4. Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396

    Article  MATH  Google Scholar 

  5. Zhang ZY, Zha HY (2004) Principal manifolds and nonlinear dimensionality reduction via tangent space alignment. SIAM J Sci Comput 26(1):313–338

    Article  MathSciNet  MATH  Google Scholar 

  6. Weinberger KQ, Sha F, Saul LK (2004) Learning a kernel matrix for nonlinear dimensionality reduction. In: Proceedings of the twenty-first international conference on Machine learning, ACM, p 106

  7. Turk MA, Pentland AP (1991) Face recognition using eigenfaces. In: IEEE Conf. on Computer Vision and Pattern Recognition. IEEE Computer Society Press, Maui, pp 586–591

  8. Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720

    Article  Google Scholar 

  9. Niyogi X (2004) Locality preserving projections. In: Advances in neural information processing systems 16. Proceedings of the 2003 conference, vol 16. The MIT Press, Cambridge, p 153

  10. Li H, Jiang T, Zhang K (2006) Efficient and robust feature extraction by maximum margin criterion. IEEE Trans Neural Netw 17(1):157–165

  11. Yan S, Xu D, Zhang B et al (2007) Graph embedding and extensions: a general framework for dimensionality reduction. Pattern Anal Mach Intell IEEE Trans 29(1):40–51

    Article  Google Scholar 

  12. Cortes C, Vapnik V (1995) Support vector networks. Mach Learn 20:273–297

    MATH  Google Scholar 

  13. Qiu X, Wu L (2005) Face recognition by stepwise nonparametric margin maximum criterion. In: Computer Vision, 2005. Proceedings of ICCV 2005, vol 2. Tenth IEEE International Conference, IEEE, pp 1567–1572

  14. Blitzer J, Weinberger KQ, Saul LK (2005) Distance metric learning for large margin nearest neighbor classification. In: Advances in neural information processing systems, pp 1473–1480

  15. Wang F, Zhang C (2007) Feature extraction by maximizing the average neighborhood margin. In: Computer vision and pattern recognition, 2007(CVPR’07). IEEE Conference on. IEEE, pp 1–8

  16. Zhao B, Wang F, Zhang C (2008) Maximum margin embedding. In: Data mining, 2008. (ICDM’08). Eighth IEEE international conference on. IEEE, pp 1127–1132

  17. Sugiyama M (2006) Local Fisher discriminant analysis for supervised dimensionality reduction. In: Proceedings of the 23rd international conference on machine learning. ACM, pp 905–912

  18. Cai D, He XF, Han JW, Zhang HJ (2006) Orthogonal laplacianfaces for face recognition. IEEE Trans Image Process 15(11):3608–3614

    Article  Google Scholar 

  19. Gao Q, Ma J, Zhang H et al (2013) Stable orthogonal local discriminant embedding for linear dimensionality reduction. Image Process IEEE Trans 22(7):2521–2531

    Article  MathSciNet  Google Scholar 

  20. Tao Y, Yang J (2010) Quotient vs. difference: comparison between the two discriminant criteria. Neurocomputing 73(10):1808–1817

    Article  Google Scholar 

Download references

Acknowledgments

The authors are very grateful to the anonymous referees for their valuable comments. This work was supported by Science Computing and Intelligent Information Processing of Guangxi Hhigher Education Key Laboratory (No. GXSCIIP201406).

Author information

Authors and Affiliations

  1. College of Information Engineering, Northwest A & F University, Yangling, 712100, Shaanxi Province, China

    Jinrong He

  2. School of Computer, Wuhan University, Wuhan, 430072, China

    Di Wu

  3. Department of Computer Science, Georgia State University, Atlanta, GA, 30303, USA

    Naixue Xiong

  4. School of Science, Wuhan University of Technology, Wuhan, 430070, China

    Chuansheng Wu

  5. Science Computing and Intelligent Information Processing of Guangxi Higher Education Key Laboratory, Guangxi Teachers Education University, Nanning, 530023, China

    Jinrong He

Authors
  1. Jinrong He
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Di Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Naixue Xiong
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Chuansheng Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jinrong He.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

He, J., Wu, D., Xiong, N. et al. Orthogonal margin discriminant projection for dimensionality reduction. J Supercomput 72, 2095–2110 (2016). https://doi.org/10.1007/s11227-015-1453-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-015-1453-5

Keywords

Search

Navigation