Abstract
For facial video coding/decoding in mobile communication, a 2D/3D model-based system was proposed: (1)Online appearance model and cylinder head model were combined to track 3D facial motion in particle filter; (2)3D facial animation was produced combining parameterized model and muscular model; (3)3D hair was synthesized by hair detection and 3D hair model; (4)3D coding/decoding of foreground and 2D coding/decoding of background were stitched. At ultra-low bit-rate, the object experiment confirmed the advantage between coding efficiency and decoding quality of it, and the between subjects experiment indicated the suitability of subjective face identification by it.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Liu, Y.C., et al.: A virtual teleconferencing system based on face detection and 3d animation in a low bandwidth environment. JIST 20(4), 323–332 (2010)
Wang, M., Hong, R., et al.: Movie2comics: Towards a lively video content presentation. IEEE Trans. on Multimedia 14(3), 858–870 (2012)
Zhang, W., Wang, Q., Tang, X.: Real Time Feature Based 3-D Deformable Face Tracking. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part II. LNCS, vol. 5303, pp. 720–732. Springer, Heidelberg (2008)
Wang, Q., et al.: Real-time bayesian 3-d pose tracking. TCSVT 16(12), 1533–1541 (2006)
Cascia, M.L., et al.: Fast, reliable head tracking under varying illumination: an approach based on registration of texture mapped 3d models. TPAMI 22(4), 322–336 (2000)
Ahlberg, J.: Model-based coding: Extraction, coding, and evaluation of face model parameters. PhD thesis, Linköping University, Sweden (2002)
Matthews, I., et al.: 2d vs. 3d deformable face models: Representational power, construction, and real-time fitting. IJCV 75(1), 93–113 (2007)
Jepson, A.D., et al.: Robust online appearance models for visual tracking. TPAMI 25(10), 1296–1311 (2003)
Lui, Y.M., et al.: Adaptive appearance model and condensation algorithm for robust face tracking. TSMC 40(3), 437–448 (2010)
Dornaika, F., Davoine, F.: Simultaneous facial action tracking and expression recognition in the presence of head motion. IJCV 76(3), 257–281 (2008)
Zhou, S., et al.: Visual tracking and recognition using appearance-adaptive models in particle filters. TIP 13(11), 1491–1506 (2004)
Wen, Z., Huang, T.S.: Capturing subtle facial motions in 3d face tracking. In: ICCV (2003)
Xiao, J., et al.: Robust full-motion recovery of head by dynamic templates and registration techniques. IJIST 13, 85–94 (2003)
Fidaleo, D., Medioni, G.G., Fua, P., Lepetit, V.: An Investigation of Model Bias in 3D Face Tracking. In: Zhao, W., Gong, S., Tang, X. (eds.) AMFG 2005. LNCS, vol. 3723, pp. 125–139. Springer, Heidelberg (2005)
Parke, F.I., Waters, K.: Computer facial animation. Wellesley (1996)
Blanz, V., et al.: Reanimating faces in images and video. Computer Graph (2003)
Wang, W.M., et al.: A physically-based modeling and simulation framework for facial animation. In: ICIG (2009)
Marcos, S., Bermejo, J.G.G., Zalama, E.: A realistic facial animation suitable for human-robot interfacing. In: ICIRS (2008)
Ward, K., et al.: A survey on hair modeling: styling, simulation, and rendering. TVCG 13(2), 213–234 (2007)
Eisert, P., et al.: Model-aided coding: a new approach to incorporate facial animation into motion-compensated video coding. TCSVT 10(3), 344–358 (2000)
Balc, K., et al.: Xface open source project and smil-agent scripting language for creating and animating embodied conversational agents. In: ICM (2007)
Kampmann, M.: Automatic 3-d face mode adaption for model-based coding of videophone sequences. TCSVT 12(3), 172–182 (2002)
Grassberger, P.: The pruned-enriched rosenbluth method: simulations of theta polymers of chain length up to 1, 000, 000. Physical Review E 56, 3682–3693 (1997)
Yacoob, Y., Davis, L.S.: Detection and analysis of hair. TPAMI 28(7), 1164–1169 (2006)
Levin, A., et al.: Spectral matting. In: CVPR (2007)
Kanade, T., et al.: Comprehensive database for facial expression analysis. In: International Conference on AFGR (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yu, J., Wang, Z., Cao, Y. (2013). 2D/3D Model-Based Facial Video Coding/Decoding at Ultra-Low Bit-Rate. In: Li, S., et al. Advances in Multimedia Modeling. Lecture Notes in Computer Science, vol 7733. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35728-2_2
Download citation
DOI: https://doi.org/10.1007/978-3-642-35728-2_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35727-5
Online ISBN: 978-3-642-35728-2
eBook Packages: Computer ScienceComputer Science (R0)