Abstract
This paper proposes an affine motion compensated prediction (AMCP) method to predict the complex changes between the successive frames in panoramic video coding. A panoramic video is an image-based rendering (IBR) technique [1] which provides users with a large field of view (e.g. 360 degree) on surrounding dynamic scenes. It includes not only the translational motions but also the non-translational motions, such as zooming and rotation etc. However, the traditional motion compensated prediction is a translational motion compensated prediction (TMCP) which cannot predict non-translational changes between panoramic images accurately. The AMCP can model the non-translational motion effects of panoramic video accurately by using six motion coefficients which are estimated by Gauss Newton iterative minimization algorithm [2]. Simulated results show that the gain of coding performance is up to about 1.3 dB when using AMCP compared with TMCP in panoramic video coding.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Shum, H.Y., Kang, S.B., Chan, S.C.: Survey of image-based representations and compression techniques. IEEE Transaction on Circuit and Systems for Video Technology 13(11), 1020–1037 (2003)
Fletcher, R.: Practical Methods for Optimization, 2nd edn. John Wiley & Sons, Chichester (1987)
Wong, T.T., Fu, C.W., Heng, P.A., Leung, C.-S.: The plenoptic illumination function. IEEE Transaction on Multimedia 4(3), 361–371 (2002)
Szeliski, R., Shum, H.Y.: Creating full view panoramic image mosaics and texture-mapped models. Computer Graphics (SIGGRAPH’97), pp. 251–258 (August 1997)
Chen, S.E.: Quick Time VR – an image-based approach to virtual environment navigation. Computer Graphics (SIG-GRAPH’95), pp. 29–38 (August 1995)
Ng, K.T., Chan, S.C., Shum, H.Y.: On the data compression and transmission aspects of panoramic video. IEEE Transaction on Circuit and Systems for Video Technology 15(1), 82–95 (2005)
Li, Y., Shum, H.Y., Tang, C.K., Szeliski, R.: Stereo reconstruction from multiperspective panorama. IEEE Transaction on Pattern Analysis and Machine Intelligence 26, 45–62 (2004)
Yamada, K., Ichikawa, T., Naemura, T., Aizawa, K., Saito, T.: Generation of a disparity panorama using a 3-camera capturing system. IEEE Transaction on Image Process 2, 772–775 (2000)
Tang, W.K., Wong, T.T., Heng, P.A.: A system for real-time panorama generation and display in tele-immersive applications. IEEE Transaction on Multimedia 7(2), 280–292 (2005)
Schechner, Y.Y., Nayar, S.K.: Generalized mosaicing: polarization panorama. IEEE Transaction on Pattern Analysis and Machine Intelligence 27(4), 631–636 (2005)
Wiegand, T., Steinbach, E., Girod, B.: Affine multipicture motion-compensated prediction. IEEE Transaction on Circuit and Systems for Video Technology 15(2), 197–209 (2005)
Karczewicz, M., Nieweglowski, J., Haavisto, P.: Video coding using motion compensation with polynomial motion vector fields. Signal Process: Image Commun 10, 63–91 (1997)
Utgikar, A., Badawy, W., Seetharaman, G., Bayoumi, M.: Affine scheme in mesh-based video motion compensation. In: Proc. IEEE Workshop SIPS 2003, pp. 159–164 (August 2003)
Huang, J.C., Hsieh, W.S.: Automatic feature-based global motion estimation in video sequences. IEEE Transaction on Consum Electron 50(3), 911–915 (2004)
Servais, M., Vlachos, T., Davies, T.: Affine motion compensation using a content-based mesh. Proc. IEEE Vis. Image Signal Process 152(4), 415–423 (2005)
Keller, Y., Averbuch, A.: Fast motion estimation using bidirectional gradient methods. IEEE Transaction on Image Process 13(8), 1042–1054 (2004)
Gahlots, A., Arya, S., Ghosh, D.: Object-based affine motion estimation. In: Proc. Conf. TENCON 2003, vol. 13, pp. 1343–1347 (October 2003)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Jiali, Z., Yongdong, Z., Yanfei, S., Guangnan, N. (2007). Panoramic Video Coding Using Affine Motion Compensated Prediction. In: Sebe, N., Liu, Y., Zhuang, Y., Huang, T.S. (eds) Multimedia Content Analysis and Mining. MCAM 2007. Lecture Notes in Computer Science, vol 4577. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73417-8_18
Download citation
DOI: https://doi.org/10.1007/978-3-540-73417-8_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73416-1
Online ISBN: 978-3-540-73417-8
eBook Packages: Computer ScienceComputer Science (R0)