Mauricio Radovan
ABSTRACT
During its almost forty years of existence, facial animation has seen a host of technologies being invented, then fading into obsolescence. The modelling and animation methods have mostly been dictated by the available hardware, which greatly evolved through the years. Many animation desiderata that have been considered dreams at the time are now reality while ever new frontiers are encountered and explored. This paper provides an overview of the historically used technologies and attempts to predict the future trends in the field of facial animation as it permeates the entertainment industry with its feature films and computer games; the broad field of visualisation in science, including medical science and forensic analysis; and the fast growing field of information and communication technology and human-computer interaction.
- Anderson, K. and Mcowan, P. W. 2006. A real-time automated system for the recognition of human facial expressions. IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics 36(1), 96--105. Google Scholar
Digital Library
- Beier, T. and Neely, S. 1992. Feature-based image metamorphosis. In Proceedings of SIGGRAPH 1992, 35--42. Google ScholarDigital Library
- Blanz, V., Basso, C., Poggio, T. and Vetter, T. 2003. Reanimating faces in images and video. In Proceedings of Eurographics 22, 641--650.Google ScholarCross Ref
- Borshukov, G. and Lewis, J. P. 2003. Realistic human face rendering for 'The Matrix Reloaded'. In Proceedings of SIGGRAPH 2003, Sketches & applications: in conjunction with the 30th annual conference on Computer graphics and interactive techniques. Google ScholarDigital Library
- Borshukov, G., Piponi, D., Larsen, O., Lewis, J. P. and Tempelaar-Lietz, C. 2003. Universal capture - image-based facial animation for 'The Matrix Reloaded'. In Proceedings of SIGGRAPH 2003, Sketches & applications: in conjunction with the 30th annual conference on Computer graphics and interactive techniques. Google ScholarDigital Library
- Bregler, C., Covell, M. and Slaney, M. 1997. Video rewrite: driving visual speech with audio. In Proceedings of SIGGRAPH 1997, 353--360. Google ScholarDigital Library
- Bui, T. D. 2004. Creating emotions and facial expressions for embodied agents. PhD Thesis. Department of Computer Science, University of Twente, Netherlands.Google Scholar
- Chadwick, J., Haumann, D. and Parent, R. 1989. Layered construction for deformable animated characters, Computer Graphics, 23(3):234--243, 1989. Google ScholarDigital Library
- Chai, J., Xiao, J. and Hodgins, J. 2003. Vision-based control of 3D facial animation. Eurographics/SIGGRAPH Symposium on Computer Animation (SCA). 193--206. Google ScholarDigital Library
- Chuang, E. and Bregler, C. 2002. Performance driven facial animation using blendshape interpolation. Computer Science Technical Report, Stanford University. CS-TR-2002-02.Google Scholar
- Chuang, E. and Bregler, C. 2005. Mood swings: expressive speech animation. ACM Transactions on Graphics 24(2), 331--347. Google ScholarDigital Library
- Combining visualisation and interaction to facilitate scientific exploration and discovery. 2006. Call for participation. http://emotion-research.net/workshop_folder/workshop.2006-05-05.6982158711. Accessed on 12 May 2006.Google Scholar
- Cosatto, E. and Graf, H. P. 2000. Photo-realistic talking heads from image samples. IEEE Transactions on Multimedia 2(3), 152--163. Google ScholarDigital Library
- Deng, Z., Chiang, P. Y., Fox, P. and Neumann, U. 2006. Animating blendshape faces by cross-mapping motion capture data. ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (I3D), Redwood City, CA. 43--48. Google ScholarDigital Library
- Doenges P, Lavagetto F, Ostermann J, Pandzic Is, Petajan E. 1997. MPEG-4: Audio/video and synthetic graphics/audio for mixed media. Image Communications Journal, 5(4).Google Scholar
- Ekman, P., Friesen, W. V. and Hager, J. C. 2002. Facial action coding system: The manual. HTML demonstration version, human face, Salt Lake City, UT, 2002. (revised edition) http://face-and-emotion.com/dataface/facs/manual/TitlePage.html. Accessed on 1 May, 2006Google Scholar
- Ezzat, T., Geiger, G. and Poggio, T. 2002. Trainable videorealistic speech animation. In Proceedings of SIGGRAPH 2002, 388--397. Google ScholarDigital Library
- Guenter, B., Grimm, C., Wood, D., Malvar, H. and Pighin, F. 1998. Making faces. In Proceedings of SIGGRAPH 1998, 55--66. Google ScholarDigital Library
- Gulz, A. and Haake, M. 2006. Design of animated pedagogical agents - A look at their look. International Journal of Human-Computer Studies 64(4), 322--339. Google ScholarDigital Library
- Gutierrez-Osuna, R., Kakumanu, P. K., Esposito, A., Garcia, O. N., Bojorquez, A., Castillo, J. L. and Rudomin, I. 2005. Speech-driven facial animation with realistic dynamics. IEEE Transactions on Multimedia 7(1). 33--42. Google ScholarDigital Library
- Hertzmann, A. 2003. Machine Learning for Computer Graphics: A Manifesto and Tutorial. http://citeseer.ist.psu.edu/hertzmann03machine.html. Accessed on 1 August 2006.Google Scholar
- Joshi, P., Tien, W. C., Desbrun, M. and Pighin, F. 2003. Learning controls for blend shape based realistic facial animation. Eurographics/SIGGRAPH Symposium on Computer Animation (SCA). 187--192. Google ScholarDigital Library
- Kahler, K., Haber, J. and Seidel, H. P. 2001. Geometry-based muscle modelling for facial animation. In GI'01 Proceedings, 37--46. Google ScholarDigital Library
- Kahler, K., Haber, J., Yamauchi, H., and Seidel, H. P. 2002. Head shop: Generating animated head models with anatomical structure. In Proceedings of SIGGRAPH 2002, Symposium on Computer Animation (SCA-02), Spencer, S. N., Ed., ACM Press, New York, 55--64. Google ScholarDigital Library
- Kahler, K. 2003. A head model with anatomical structure for facial modelling and animation. PhD Thesis, Universität des Saarlandes, Saarbrücken, SaarlandGoogle Scholar
- Kalra, P., Mangili, A., Magnenat Thalmann, N. and Thalmann, D. 1991. 3D interactive free form deformations for facial expressions. In Compugraphics '91 Proceedings, Lisbon, Portugal. 129--141.Google Scholar
- Kalra, P., Mangili, A., Magnenat Thalmann, N and Thalmann, D. 1992. Simulation of facial muscle action based on rational free form deformations. In Eurographics '92 Proceedings, Cambridge, 59--69.Google Scholar
- Kalra, P. and Magnenat-Thalmann, N. 1994. Modelling of vascular expressions in facial animation. Computer Animation, 50--58.Google Scholar
- Kshirsagar, S., Garchery, S., Sannier, G. and Magnenat-Thalmann, N. 2003. Synthetic faces: Analysis and applications. International Journal of Imaging Systems and Technology 13(1), 65--73. DOI: 10.1002/ima.10043.Google ScholarCross Ref
- Ko, H. S., Choi, K. J., Choi, M. G., Tak, S., Choe, B. and Song, O. Y. 2003. Research problems for creating digital actors. Eurographics 2003 STAR - State of The Art Report.Google Scholar
- Kouadio, C., Poulin, P. and Lachapelle, P. 1998. Real-time facial animation based upon a bank of 3D facial expressions. In Proceedings of Computer Animation '98 Conference. IEEE Computer Society Press. 128. Google ScholarDigital Library
- Krenn, B, Neumayr, B, Gstrein, M and Grice, M. 2004. Lifelike agents for the Internet: A cross-cultural case study. In Agent Culture: Human-Agent Interaction in a Multicultural World, PAYR, S AND TRAPPL, R. Eds. Lawrence Erlbaum Associates, NJ, 197--229.Google Scholar
- Krinidis, S., Buciu, I. and Pitas, I. 2003. Facial expression analysis and synthesis: A survey. In Proceedings of the 10th international Conference on Human-Computer Interaction (HCI 2003), Crete, Greece, June 22--27. Volume 4, 1432--1436.Google Scholar
- Lewis, J. P., Mooser, J., Deng, Z. and Neumann, U. 2005. Reducing blendshape interference by selected motion attenuation. In Proceedings of SIGGRAPH 2005, Symposium on Interactive 3D Graphics and Games (13D), 25--29. Google ScholarDigital Library
- Maurel, W., 1999, 3D Modeling of the human upper limb including the biomechanics of joints, muscles and soft tissues. PhD thesis. Ecole Polytechnique Federale De Lausanne, Lausanne, SwitzerlandGoogle Scholar
- Noh, J. Y. and Neumann, U. 1998. A survey of facial modelling and animation techniques. Technical Report 99--705, University of Southern California.Google Scholar
- Ochs, M., Niewiadomski, R., Pelachaud, C. and Sadek, D. 2005. Intelligent expressions of emotions. ACII (Affective Computing and Intelligent Interaction) 2005: 707--714. Google ScholarDigital Library
- Oka, M., Tsutsui, K., Ohba, A., Kurauchi, Y. and Tago, T. 1987. Real-time manipulation of texture-mapped surfaces. In Proceedings of 1987, 181--188. Google ScholarDigital Library
- Ostermann, J. 1998. Animation of synthetic faces in MPEG-4. In Computer Animation'98, Philadelphia, USA, pages 49--51. Google ScholarDigital Library
- Ostermann, J. and Weissenfeld, A. 2004. Talking Faces - technologies and applications. In Proceedings of the 17th International Conference on Pattern Recognition 3, 826--833. Google ScholarDigital Library
- Pandzic, I. S., Capin, T. K., Magnenat-Thalmann, N. and Thalmann, D. 1996. Towards natural communication in networked collaborative virtual environments. FIVE '96.Google Scholar
- Parke, F. I. 1972. Computer generated animation of faces. In Proceedings of the ACM annual conference 1, Boston, Massachusetts, United States, SESSION: SIGGRAPH 1 - Computer graphics, 451--457 Google ScholarDigital Library
- Parke F. I. and Waters, K. 1996. Computer facial animation. AK Peters, Wellesley, MA, ISBN 1-56881-014-8. Google ScholarDigital Library
- Pasquariello, S. and Pelechaud, C. 2001. Greta: a simple facial animation engine. 6th On-Line World Conference on Soft Computing in Industrial Applications, Session on Soft Computing for Intelligent 3D Agents, September.Google Scholar
- Pelachaud, C. 2005. Multimodal expressive embodied conversational agents. 13th ACM International Conference on Multimedia, November 6-11, 2005, Singapore. ACM 2005, ISBN 1-59593-044-2. 683--689. Google ScholarDigital Library
- Pighin, F., Hecker, J., Lichinski, D., Szeliski, R. and Salesin, D. H. 1998. Synthesizing realistic facial expressions from photographs. In Proceedings of the 25th annual conference on Computer graphics and interactive techniques. 75--84. Google ScholarDigital Library
- Ravyse, I. 2006. Facial analysis and synthesis. PhD Thesis, Free University of Brussels. http://www.etro.vub.ac.be/Personal/icravyse/RavysephDThesis.pdf. Accessed on 1 August 2006.Google Scholar
- Reutersward, K., Flynn, J., Roble, D and Museth, K. 2005. Model flowing: capturing and tracking of deformable geometry. In Proceedings of SIGGRAPH 2005, sketch. Google ScholarDigital Library
- Sederberg, T. W. and Parry, S. R. 1986. Free-form deformation of solid geometric models. In Proceedings of the 13th Annual Conference on Computer Graphics and Interactive Techniques, 151--160. Google ScholarDigital Library
- Sifakis, E., Neverov, I. and Fedkiw, R. 2005. Automatic determination of facial muscle activations from sparse motion capture marker data. In Proceedings of SIGGRAPH 2005, Skin & faces, 417--425. Google ScholarDigital Library
- Steinke, F., Schölkopf, B. and Blanz, V. 2005. Support vector machines for 3D shape processing. Eurographics, Computer Graphics forum 24(3).Google Scholar
- Tang, S., Liew. A. W. C. and Yan, H. 2004. Lip-sync in human face animation based on video analysis and spline models, In Proceedings of the 10th International Multimedia Modelling Conference (MMM'04). 102--108. Google ScholarDigital Library
- Teran, J., Sifakis, E., Salinas-Blemker, S., NG-THOW-HING, V., Lau, C., and Fedkiw, R. 2005. Creating and simulating skeletal muscle from the visible human data set. IEEE Transactions on Visualisation and Computer Graphics 11(3), 317--328. Google ScholarDigital Library
- Terzopoulos, D. Lee, Y. and Vasilesco, M. A. O. 2004. Model-based and image-based methods for facial synthesis, analysis and recognition. In Proceedings of the 6th IEEE International Conference on Automatic Face and Gesture Recognition (FG'04), Seoul, Korea, 3--8. Google ScholarDigital Library
- Terzopoulos, D. and Waters, K. 1990. Physically-based facial modeling, analysis and animation. Journal of Visualization and Computer Animation. 73--80.Google ScholarCross Ref
- Waters, K. 1987. A muscle model for animating three-dimensional facial expressions. Computer Graphics (SIGGRAPH 1987) 21(4), 17--24. Google ScholarDigital Library
- Williams, L. 1990. Performance-driven facial animation. In Proceedings of the 17th Annual Conference on Computer Graphics and Interactive Techniques, Dallas, TX, USA, ISBN 0-201-50933-4, 235--242. Google ScholarDigital Library
- Zhang, L., Snavely, N., Curless, B. and Seitz, S. 2004. Spacetime faces: high resolution capture for modelling and animation. In Proceedings of SIGGRAPH 2004, 548--558. Google ScholarDigital Library
- Zhang, Q., Liu, Z., Guo, B., Terzopoulos, D. and Shum, H. 2006. Geometry-driven photorealistic facial expression synthesis. IEEE Transactions on Visualisation and Computer Graphics 12(1), 48--60. Google ScholarDigital Library
- Zhang, Y., Prakash, E. C. and Sung, E. 2001. Real-time physically-based facial expression animation using mass-spring system. In Computer Graphics International 2001 Proceedings, 347--350. Google ScholarDigital Library
Index Terms
- Facial animation in a nutshell: past, present and future
Recommendations
Artist friendly facial animation retargeting
This paper presents a novel facial animation retargeting system that is carefully designed to support the animator's workflow. Observation and analysis of the animators' often preferred process of key-frame animation with blendshape models informed our ...
Artist friendly facial animation retargeting
SA '11: Proceedings of the 2011 SIGGRAPH Asia ConferenceThis paper presents a novel facial animation retargeting system that is carefully designed to support the animator's workflow. Observation and analysis of the animators' often preferred process of key-frame animation with blendshape models informed our ...
A Video-Based System for Hand-Driven Stop-Motion Animation
Stop-motion is a well-established animation technique but is often laborious and requires craft skills. A new video-based system can animate the vast majority of everyday objects in stop-motion style, more flexibly and intuitively. Animators can perform ...
Comments