Skip to main content
SpringerLink
Log in

Context-Sensitive Self-Updating for Adaptive Face Recognition

  • Chapter
  • First Online:
Adaptive Biometric Systems

Part of the book series: Advances in Computer Vision and Pattern Recognition ((ACVPR))

Abstract

Performance of state-of-the-art face recognition (FR) systems is known to be significantly affected by variations in facial appearance, caused mainly by changes in capture conditions and physiology. While individuals are often enrolled to a FR system using a limited number of reference face captures, adapting facial models through re-enrollment or through self-updating with highly confident operational captures has been shown to maintain or improve performance. However, frequent re-enrollment and updating can become very costly, and facial models may be corrupted if misclassified face captures are used for self-updating. This chapter presents an overview of adaptive FR systems that perform self-updating of facial models using operational (unlabelled) data. Adaptive template matching systems are first revised, with a particular focus on system complexity control using template management techniques. A new context-sensitive self-updating approach is proposed to self-update only when highly confident operational data depict new capture conditions. This allows to enhance the modelling of intra-class variations , while mitigating the growth of the system by filtering out redundant information, thus reducing the need to use costly template management techniques during operations. A particular implementation is proposed, where highly confident templates are added according to variations in illumination conditions detected using a global luminance distortion measures. Experimental results using three publicly available FR databases indicate that this approach enables to maintain a level of classification performance comparable to standard self-updating template matching systems, while significantly reducing the memory and computational complexity over time.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Depending on the classification system, a facial model may be defined as either a set of one or more reference face captures (template matching) or a statistical model estimated from reference captures (statistical classification).

  2. 2.

    A concept can be defined as the underlying data distribution of the problem under specific operating conditions [10].

  3. 3.

    This value has been determined experimentally as an optimal trade-off between accuracy and computational complexity using a nearest neighbour classifier with Euclidean distance.

  4. 4.

    Department of Electrical and Electronic Engineering.

References

  1. Niinuma, N., Park, U., Jain, A.: Soft biometric traits for continuous user authentication. IEEE Trans. Inf. Forensics Secur. 5(4), 771780 (2010)

    Article  Google Scholar 

  2. Pagano, C., Granger, E., Sabourin, R., Marcialis, G., Roli, F.: Adaptive ensembles for face recognition in changing video surveillance environments. Inf. Sci. 286, 75-101 (2014)

    Article  Google Scholar 

  3. De-la Torre, M., Granger, E., Radtke, P.V., Sabourin, R., Gorodnichy, D.O.: Partially-supervised learning from facial trajectories for face recognition in video surveillance. Information Fusion (2014)

    Google Scholar 

  4. Pagano, C., Granger, E., Sabourin, R., Gorodnichy, D.O.: Detector ensembles for face recognition in video surveillance. In: Neural Networks (IJCNN), The 2012 International Joint Conference on, pp. 1-8. IEEE (2012)

    Google Scholar 

  5. De Marsico, M., Nappi, M., Riccio, D., Wechsler, H.: Robust face recognition for uncontrolled pose and illumination changes. IEEE Trans. Syst Man Cybern. 43(1), 149-163 (2012)

    Article  Google Scholar 

  6. Wright, J., Yang, A., Ganesh, A., Sastry, S.: Robust face recognition via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 31(2), 210-227 (2009)

    Article  Google Scholar 

  7. Jafri, R., Arabnia, H.: A survey of face recognition techniques. J. Inf. Process. Syst. 5(2), 41-68 (2009)

    Article  Google Scholar 

  8. Li, S.Z., Jain, A.K.: Handbook of Face Recognition, 2nd edn. Springer Publishing Company, Incorporated (2011)

    Google Scholar 

  9. Rattani, A.: Adaptive biometric system based on template update procedures. Ph.D. thesis. University of Cagliari, Italy (2010)

    Google Scholar 

  10. Narasimhamurthy, A., Kuncheva, L.I.: A framework for generating data to simulate changing environments. In: Proceedings of the 25th IASTED International Multi-Conference: Artificial Intelligence And Applications, pp. 84-389 (2007)

    Google Scholar 

  11. Roli, F., Didaci, L., Marcialis, G.: Adaptive biometric systems that can improve with use. In: Ratha, N., Govindaraju, V. (eds.) Advances in Biometrics, pp. 447-471. Springer, London (2008)

    Chapter  Google Scholar 

  12. Nagy, G.: Classifiers that improve with use. Procs. Conference on Pattern Recognition and Multimedia, vol. 103, pp. 79-86. IEICE, Tokyo, Japan (2004)

    Google Scholar 

  13. Roli, F., Marcialis, G.L.: Semi-supervised pca-based face recognition using self-training. In: Structural, Syntactic, and Statistical Pattern Recognition, pp. 560-568. Springer (2006)

    Google Scholar 

  14. Jiang, X., Ser, W.: Online fingerprint template improvement. Pattern Anal. Mach. Intell. IEEE Trans. 24(8), 1121-1126 (2002)

    Article  Google Scholar 

  15. Ryu, C., Kim, H., Jain, A.K.: Template adaptation based fingerprint verification. In: 18th IEEE International Conference on Pattern Recognition, ICPR 2006, vol. 4, pp. 582-585 (2006)

    Google Scholar 

  16. Rattani, A., Freni, B., Marcialis, G.L., Roli, F.: Template update methods in adaptive biometric systems: A critical review. Lecture Notes in Computer Science (included Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 5558, 847-856 (2009)

    Google Scholar 

  17. Marcialis, G.L., Rattani, A., Roli, F.: Biometric template update: an experimental investigation on the relationship between update errors and performance degradation in face verification. In: Structural, Syntactic, and Statistical Pattern Recognition, pp. 684-693. Springer (2008)

    Google Scholar 

  18. Freni, B., Marcialis, G.L., Roli, F.: Replacement algorithms for fingerprint template update. In: Image Analysis and Recognition, pp. 884-893. Springer (2008)

    Google Scholar 

  19. Rattani, A., Marcialis, G.L., Roli, F.: A multi-modal dataset, protocol and tools for adaptive biometric systems: a benchmarking study. Int. J. Biometrics 5(4), 266-287 (2013)

    Article  Google Scholar 

  20. Goh, R., Liu, L., Liu, X., Chen, T.: The cmu face in action (fia) database. In: Proceedings of Analysis and Modelling of Faces and Gestures. Second International Workshop. AMFG 2005, pp. 255-63. Springer, Berlin (2005)

    Google Scholar 

  21. Phillips, P.J., Flynn, P.J., Scruggs, T., Bowyer, K.W., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.: Overview of the face recognition grand challenge. In: Proceedings of the 2005 Conference on Computer Vision and Pattern Recognition (CVPR’05), pp. 947-954. IEEE (2005)

    Google Scholar 

  22. Turk, M.A., Pentland, A.P.: Face recognition using eigenfaces. In: Proceedings of 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 586-91. IEEE (1991)

    Google Scholar 

  23. Ahonen, T., Hadid, A., Pietikainen, M.: Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2037-2041 (2006)

    Article  MATH  Google Scholar 

  24. Riedmiller, M.: Advanced supervised learning in multi-layer perceptrons from backpropagation to adaptive learning algorithms. Comput. Stan. Interfaces 16(3), 265-278 (1994)

    Article  Google Scholar 

  25. Carpenter, G.A., Grossberg, S., Reynolds, J.H.: Artmap. Supervised real-time learning and classification of nonstationary data by a self-organizing neural network. Neural Netw. 4(5), 565-588 (1991)

    Article  Google Scholar 

  26. Duda, R.O., Hart, P.E.: Pattern recognition and scene analysis (1973)

    Google Scholar 

  27. Zhu, X.: Semi-supervised learning literature survey (2005)

    Google Scholar 

  28. Rattani, A., Marcialis, G.L., Roli, F.: Capturing large intra-class variations of biometric data by template co-updating. In: Computer Vision and Pattern Recognition Workshops, 2008. CVPRW’08. IEEE Computer Society Conference on, pp. 1-6. IEEE (2008)

    Google Scholar 

  29. Rattani, A., Marcialis, G.L., Roli, F.: Self adaptive systems: An experimental analysis of the performance over time. In: Computational Intelligence in Biometrics and Identity Management (CIBIM), 2011 IEEE Workshop on, pp. 36-43. IEEE (2011)

    Google Scholar 

  30. Liu, X., Chen, T., Thornton, S.M.: Eigenspace updating for non-stationary process and its application to face recognition. Pattern Recogn. 36(9), 1945-1959 (2003)

    Article  MATH  Google Scholar 

  31. Didaci, L., Marcialis, G.L., Roli, F.: Analysis of unsupervised template update in biometric recognition systems. Pattern Recogn. Lett. 37, 151-160 (2014)

    Article  Google Scholar 

  32. Wang, Z., Bovik, A.C.: A universal image quality index. Signal Process. Lett. IEEE 9(3), 81-84 (2002)

    Article  Google Scholar 

  33. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600-612 (2004)

    Article  Google Scholar 

  34. Marcialis, G.L., Roli, F., Fadda, G.: A novel method for head pose estimation based on the “virtuvian man”. Int. J. Mach. Learn. Cybern. 5(11), 111-124 (2014)

    Article  Google Scholar 

  35. Gorodnichy, D.O.: Video-based framework for face recognition in video. In: Proceedings of 2nd Canadian Conference on Computer and Robot Vision, pp. 330-338 (2005)

    Google Scholar 

  36. Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vis. 57, 137-154 (2004)

    Article  Google Scholar 

  37. Doddington, G., Liggett, W., Martin, A., Przybocki, M., Reynolds, D.: Sheep, goats, lambs and wolves: A statistical analysis of speaker performance in the nist 1998 speaker recognition evaluation. Tech. rep, DTIC Document (1998)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Lab. d’Imagerie, de Vision et d’Intelligence Artificielle, École de Technologie Supérieure, Université du Québec, Montreal, Canada

    C. Pagano, E. Granger & R. Sabourin

  2. Pattern Recognition and Applications Group, Department of Electrical and Electronic Engineering, University of Cagliari, Cagliari, Italy

    P. Tuveri, G. L. Marcialis & F. Roli

Authors
  1. C. Pagano
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. E. Granger
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. R. Sabourin
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. P. Tuveri
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. G. L. Marcialis
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. F. Roli
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to C. Pagano .

Editor information

Editors and Affiliations

  1. Michigan State University, East Lansing, Michigan, USA

    Ajita Rattani

  2. University of Cagliari, Cagliari, Italy

    Fabio Roli

  3. ETS, Montréal, Québec, Canada

    Eric Granger

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Pagano, C., Granger, E., Sabourin, R., Tuveri, P., Marcialis, G.L., Roli, F. (2015). Context-Sensitive Self-Updating for Adaptive Face Recognition. In: Rattani, A., Roli, F., Granger, E. (eds) Adaptive Biometric Systems. Advances in Computer Vision and Pattern Recognition. Springer, Cham. https://doi.org/10.1007/978-3-319-24865-3_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-24865-3_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-24863-9

  • Online ISBN: 978-3-319-24865-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation