Abstract
In the context of post-production for the movie industry, localization of a 3D face in an image sequence is a topic, with a growing interest. It’s not only a face detection (already done!), but an accurate 3D face localization, an accurate face expression recognition, coupled with the localization, allowing to track a real “living” faces (with speech and emotion). To obtain a faithful tracking, the 3D face model has to be very accurate, and the deformation of the face (the behavior model) has to be realistic. In this paper, we present a new easy-to-use face behavior model, and a tracking system based upon image analysis/synthesis collaboration. This tracking algorithm is computing, for each image of a sequence, the 6 parameters of the 3D face model position and rotation, and the 14 behavior parameters (the amount of each behavior in the behavior space). The result is a moving face, in 3D, with speech and emotions which is not discriminable from the image sequence from which it was extracted.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Horowitz, B., Pentland, A., Sclaroff, S.: Non-rigid motion and structure from contour. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 288–293 (1991)
Blake, A., Isard, M.: Active contours. Springer, London (1998)
Drummond, T., Cipolla, R.: Real-time tracking of complex structures for visual servoing. In: British Machine Vision Conference, Nottingham, pp. 574–583 (1999)
Terzopoulos, A.W.D., Kass, M.: Constraints on deformable models: Recovering 3d shape and nonrigid motion, vol. 1, pp. 91–123
Duchon, J.: Splines minimizing rotation invariant semi-norms in sobolev spaces. In: Constructive Theory of Functions of Several Variables, pp. 85–100 (1977)
Gagalowicz, A.: Modeling complex indoor scenes using an analysis/synthesis framework. In: Scientific Visualisation advances and Challenges (1994)
Bouville, C., Breton, G., Pel, D.: Face engine; a 3d facial animation engine for real time applications. In: Proceedings of 6th International Conference on 3D Web Technology, pp. 15–22 (2001)
Gee, A.H., Cipolla, R.: Fast visual tracking by temporal consensus. In: Image and Vision Computing, pp. 105–114 (1996)
Ju, X., Siebert, P.: Conforming generic animatable models to 3d scanned data. In: Conference on Human Modeling, Paris (2001)
Lowe, D.G.: Robust model-based motion tracking through the integration of search and estimation. International Journal of Computer Vision 8(2), 113–122 (1992)
Buzuloiu, V., Malciu, M., Preteux, F.: 3d global head pose estimation: A robust approach. In: Proceedings International Workshop on Synthetic-Natural Hybrid Coding and Three Dimensional Imaging (IWSNHC3DI 1999), Santorini, Greece
Gagalowicz, A., Gérard, P., Vézien, J.M.: Three dimensional model-based tracking using texture learning and matching. In: Proceedings of SCIA 1999 conference, Kanger-lussaq, Groenland (1999)
Ekman, P., Friesen, W.: Facial action coding system. Facial Action Coding System (1978)
Parke, F.I., Waters, K.: Computer facial animation. A. K. Peters, Wellesley (1996)
Vtracker, http://www.famoustech.com/3d/products/profacevideo.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Roussel, R., Gagalowicz, A. (2005). A Hierarchical Face Behavior Model for a 3D Face Tracking Without Markers. In: Gagalowicz, A., Philips, W. (eds) Computer Analysis of Images and Patterns. CAIP 2005. Lecture Notes in Computer Science, vol 3691. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11556121_105
Download citation
DOI: https://doi.org/10.1007/11556121_105
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28969-2
Online ISBN: 978-3-540-32011-1
eBook Packages: Computer ScienceComputer Science (R0)