Skip to main content
SpringerLink
Log in

Adaptive feature selection based on reconstruction residual and accurately located landmarks for expression-robust 3D face recognition

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

A novel adaptive feature selection based on reconstruction residual and accurately located landmarks for expression-robust 3D face recognition is proposed in this paper. Firstly, the novel facial coarse-to-fine landmarks localization method based on Active Shape Model and Gabor wavelets transformation is proposed to exactly and automatically locate facial landmarks in range image. Secondly, the multi-scale fusion of the pyramid local binary patterns (F-PLBP) based on the irregular segmentation associated with the located landmarks is proposed to extract the discriminative feature. Thirdly, a sparse representation-based classifier based on the adaptive feature selection (A-SRC) using the distribution of the reconstruction residual is presented to select the expression-robust feature and identify the faces. Finally, the experimental evaluation based on FRGC v2.0 indicates that the adaptive feature selection method using F-PLBP combined with the A-SRC can obtain the high recognition accuracy by performing the higher discriminative power to overcome the influence from the facial expression variations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Zhao, W., et al.: Face recognition: a literature survey. ACM Comput. Surv. 35(4), 399–458 (2003)

    Article  Google Scholar 

  2. Bowyer, K.W., et al.: A survey of approaches and challenges in 3D and multi-modal 3D+2D face recognition. Comput. Vis. Image Underst. 101(1), 1–15 (2006)

    Article  Google Scholar 

  3. Cootes, T.F., et al.: The Use of Active Shape Models for Locating Structures in Medical Images. Springer, Berlin Heidelberg (1993)

    Book  Google Scholar 

  4. Elaiwat, S., et al.: 3-D face recognition using curvelet local features. IEEE Signal Process. Lett. 21(2), 172–175 (2014)

    Article  Google Scholar 

  5. Elaiwat, S., et al.: A Curvelet-based approach for textured 3D face recognition. Pattern Recognit. 48(4), 1235–1246 (2015)

    Article  Google Scholar 

  6. Jahanbin, S., Choi, H., Bovik, A.C.: Passive multimodal 2-D+ 3-D face recognition using Gabor features and landmark distances. IEEE Trans. Inf. Forensic Secur. 6(4), 1287–1304 (2011)

    Article  Google Scholar 

  7. Li, H., et al.: Towards 3d face recognition in the real: a registration-free approach using fine-grained matching of 3d keypoint descriptors. Int. J. Comput. Vis. 113(2), 128–142 (2015)

    Article  MathSciNet  Google Scholar 

  8. Ouamane, A., Belahcene, M., Benakcha, A., et al.: Robust multimodal 2D and 3D face authentication using local feature fusion. Signal Image Video Process. 10(1), 129–137 (2016)

    Article  Google Scholar 

  9. Okuwobi, I.P., et al.: Three-dimensional (3D) facial recognition and prediction. Signal Image Video Process. 10, 1–8 (2016)

    Article  Google Scholar 

  10. Ming, Y.: Robust regional bounding spherical descriptor for 3D face recognition and emotion analysis. Image Vis. Comput. 35, 14–22 (2015)

    Article  Google Scholar 

  11. Wright, J., et al.: Robust face recognition via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 31(2), 210–227 (2009)

    Article  Google Scholar 

  12. Donoho, D.L.: Compressed sensing. IEEE Trans. Inf. Theory 52(4), 1289–1306 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  13. Li, H., et al.: Expression-robust 3D face recognition via weighted sparse representation of multi-scale and multi-component local normal patterns. Neurocomputing 133, 179–193 (2014)

    Article  Google Scholar 

  14. Phillips, P.J., et al.: Overview of the face recognition grand challenge. In: Proc. Conf. Comput Vis Pattern Recognit. San Diego, CA, USA, 1,947–954 (2005)

  15. Li, X., Da, F.: Efficient 3D face recognition handling facial expression and hair occlusion. Image Vis. Comput. 30(9), 668–679 (2012)

    Article  Google Scholar 

  16. Liu, J., Da, F., Deng, X., et al.: An Automatic Landmark Localization Method for 2D and 3D Face. In: Proc. Int. Conf. Image and Graphics. Springer International Publishing, 541–551 (2015)

  17. Lei, Y., et al.: An efficient 3D face recognition approach based on the fusion of novel local low-level features. Pattern Recognit. 46(1), 24C37 (2013)

    Article  Google Scholar 

  18. Liang, R., et al.: Bayesian multi-distribution-based discriminative feature extraction for 3D face recognition. Inf. Sci. 320, 406–417 (2015)

    Article  Google Scholar 

  19. Ojala, T., et al.: A comparative study of texture measures with classification based on featured distributions. Pattern Recognit. 29(1), 51–59 (1996)

    Article  Google Scholar 

  20. Qian, X., et al.: PLBP: an effective local binary patterns texture descriptor with pyramid representation. Pattern Recognit. 44(10), 2502–2515 (2011)

    Article  Google Scholar 

  21. Huang, D., et al.: 3D face recognition using elbp-based facial description and local feature hybrid matching. I IEEE Trans. Inf. Forensic Secur. 7(5), 1551–1565 (2012)

    Article  Google Scholar 

  22. Berretti, S., et al.: 3D face recognition using isogeodesic stripes. IEEE Trans. Pattern Anal. Mach. Intell. 32(12), 2162–2177 (2010)

    Article  Google Scholar 

  23. Lei, Y., Bennamoun, M. et al.: A structured template based 3D face recognition approach. In: Proc. 27th Int. Conf. Image Vis. Comput., New Zealand. 2012. Dunedin, New Zealand: ACM. (2012)

  24. Smeets, D., et al.: MeshSIFT: local surface features for 3D face recognition under expression variations and partial data. Comput. Vis. Image Underst. 117(2), 158–169 (2013)

    Article  Google Scholar 

  25. Zhang, L., et al.: 3D face recognition based on multiple keypoint descriptors and sparse representation. PLoS ONE 9(6), e100120 (2014)

    Article  Google Scholar 

Download references

Acknowledgements

This research is supported by National Natural Science Foundation of China (Nos. 51475092, 61405034), and Fundamental Research Funds for the Central Universities (No. KYLX15_0117). The authors would like to thank A. Enis Cetin, Ph.D. Editor in Chief, associate editor and two anonymous reviewers who gave valuable comments and helpful suggestions for our manuscript.

Author information

Authors and Affiliations

  1. School of Automation, Southeast University, Nanjing, 210096, Jiangsu, China

    Xing Deng, Feipeng Da & Haijian Shao

  2. Key Laboratory of Measurement and Control for Complex System, Ministry of Education, Southeast University, Nanjing, 210096, Jiangsu, China

    Xing Deng, Feipeng Da & Haijian Shao

Authors
  1. Xing Deng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Feipeng Da
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Haijian Shao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Feipeng Da.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Deng, X., Da, F. & Shao, H. Adaptive feature selection based on reconstruction residual and accurately located landmarks for expression-robust 3D face recognition. SIViP 11, 1305–1312 (2017). https://doi.org/10.1007/s11760-017-1087-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-017-1087-6

Keywords

Search

Navigation