Skip to main content
SpringerLink
Log in
Book cover

IAPR Workshop on Multimodal Pattern Recognition of Social Signals in Human-Computer Interaction

MPRSS 2014: Multimodal Pattern Recognition of Social Signals in Human-Computer-Interaction pp 130–140Cite as

Online Smart Face Morphing Engine with Prior Constraints and Local Geometry Preservation

  • Conference paper
  • First Online:

  • 781 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 8869))

Abstract

We present an online system for automatic smart face morphing, which can be accessed at http://facewarping.com. This system morphs the user-uploaded image to “beautify” it by embedding features from a user-selected celebrity. This system consists of three major modules: facial feature point detection, geometry embedding, and image warping. To embed the features of a celebrity face and at the same time preserve the features of the original face, we formulate an optimization problem which we call prior multidimensional scaling (prior MDS). We propose an iterated Levenberg-Marquardt algorithm (ILMA) to efficiently solve prior MDS in the general case. This online system allows the user to configure the morphing parameters, and has been tested under different conditions.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   34.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   44.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Kagian, A., Dror, G., Leyvand, T., Cohen-Or, D., Ruppin, E.: A humanlike predictor of facial attractiveness. In: Advances in Neural Information Processing Systems (NIPS), Vancouver, B.C., Canada, pp. 649–656 (2006)

    Google Scholar 

  2. Eisenthal, Y., Dror, G., Ruppin, E.: Facial attractiveness: beauty and the machine. Neural Comput. 18(1), 119–142 (2006)

    Article  Google Scholar 

  3. Altwaijry, H., Belongie, S.: Relative ranking of facial attractiveness. In: Workshop on the Applications of Computer Vision (WACV), Clearwater Beach, FL, USA, pp. 117–124. IEEE (2013)

    Google Scholar 

  4. Leyvand, T., Cohen-Or, D., Dror, G., Lischinski, D.: Data-driven enhancement of facial attractiveness. ACM Trans. Graph. (TOG) 27(3), 38 (2008)

    Article  Google Scholar 

  5. Milborrow, S., Nicolls, F.: Locating facial features with an extended active shape model. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part IV. LNCS, vol. 5305, pp. 504–513. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  6. Zhou, Y., Gu, L., Zhang, H.J.: Bayesian tangent shape model: Estimating shape and pose parameters via Bayesian inference. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Madison, WI, USA, vol. 1, pp. I–109. IEEE (2003)

    Google Scholar 

  7. Bookstein, F.L.: Principal warps: thin-plate splines and the decomposition of deformations. IEEE Trans. PAMI 11(6), 567–585 (1989)

    Article  MATH  Google Scholar 

  8. Lee, S., Wolberg, G., Chwa, K.Y., Shin, S.Y.: Image metamorphosis with scattered feature constraints. IEEE Trans. Vis. Comput. Graph. 2(4), 337–354 (1996)

    Article  Google Scholar 

  9. Martinez, A.M.: The AR face database. CVC Technical Report 24 (1998)

    Google Scholar 

  10. Zhang, X., Zhang, L., Wang, X.J., Shum, H.Y.: Finding celebrities in billions of web images. IEEE Trans. Multimedia 14(4), 995–1007 (2012)

    Article  Google Scholar 

  11. Cao, X., Wei, Y., Wen, F., Sun, J.: Face alignment by explicit shape regression. Int. J. Comput. Vis. 107(2), 177–190 (2014)

    Article  MathSciNet  Google Scholar 

  12. Zhou, E., Fan, H., Cao, Z., Jiang, Y., Yin, Q.: Extensive facial landmark localization with coarse-to-fine convolutional network cascade. In: IEEE International Conference on Computer Vision Workshops (ICCVW), Sydney, NSW, Australia, pp. 386–391. IEEE (2013)

    Google Scholar 

  13. Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active shape models-their training and application. Comput. Vis. Image Underst. 61(1), 38–59 (1995)

    Article  Google Scholar 

  14. Milborrow, S., Morkel, J., Nicolls, F.: The MUCT landmarked face database. Pattern Recogn. Assoc. S. Afr. 201 (2010)

    Google Scholar 

  15. Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Kauai, HI, USA, vol. 1, p. I-511. IEEE (2001)

    Google Scholar 

  16. Borg, I., Groenen, P.J.F.: Modern Multidimensional Scaling: Theory and Applications. Springer Series in Statistics, 2nd edn. Springer, New York (2005)

    Google Scholar 

  17. Kruskal, J.B.: Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika 29, 1–27 (1964)

    Article  MathSciNet  MATH  Google Scholar 

  18. de Leeuw, J.: Applications of convex analysis to multidimensional scaling. In: Barra, J.R., Brodeau, F., Romier, G., Cutsem, B.V. (eds.) Recent Developments in Statistics, pp. 133–146. North Holland Publishing Company, Amsterdam (1977)

    Google Scholar 

  19. Williams, C.K.: On a connection between kernel PCA and metric multidimensional scaling. Mach. Learn. 46(1), 11–19 (2002)

    Article  MATH  Google Scholar 

  20. Levenberg, K.: A method for the solution of certain non-linear problems in least squares. Q. Appl. Math. 2, 164–168 (1944)

    MathSciNet  MATH  Google Scholar 

  21. Marquardt, D.: An algorithm for least-squares estimation of nonlinear parameters. J. Soc. Ind. Appl. Math. 11(2), 431–441 (1963)

    Article  MathSciNet  MATH  Google Scholar 

  22. Arun, K.S., Huang, T.S., Blostein, S.D.: Least-squares fitting of two 3-D point sets. IEEE Trans. PAMI 9(5), 698–700 (1987)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical, Computer, and Systems Engineering, Rensselaer Polytechnic Institute, Troy, NY, 12180, USA

    Quan Wang, Yu Wang & Zuoguan Wang

Authors
  1. Quan Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yu Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zuoguan Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Quan Wang .

Editor information

Editors and Affiliations

  1. University of Ulm, Universität Ulm, Ulm, Germany

    Friedhelm Schwenker

  2. University of Southern California, Playa Vista, California, USA

    Stefan Scherer

  3. University of Southern California, Playa Vista, California, USA

    Louis-Philippe Morency

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Wang, Q., Wang, Y., Wang, Z. (2015). Online Smart Face Morphing Engine with Prior Constraints and Local Geometry Preservation. In: Schwenker, F., Scherer, S., Morency, LP. (eds) Multimodal Pattern Recognition of Social Signals in Human-Computer-Interaction. MPRSS 2014. Lecture Notes in Computer Science(), vol 8869. Springer, Cham. https://doi.org/10.1007/978-3-319-14899-1_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-14899-1_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-14898-4

  • Online ISBN: 978-3-319-14899-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation