Timo Stich
ABSTRACT
We present a method for image interpolation which is able to create high-quality, perceptually convincing transitions between recorded images. By implementing concepts derived from human vision, the problem of a physically correct image interpolation is relaxed to an image interpolation that is perceived as physically correct by human observers. We find that it suffices to focus on exact edge correspondences, homogeneous regions and coherent motion to compute such solutions. In our user study we confirm the visual quality of the proposed image interpolation approach. We show how each aspect of our approach increases the perceived quality of the interpolation results, compare the results obtained by other methods and investigate the achieved quality for different types of scenes.
- Baker, S., and Matthews, I. 2004. Lucas-Kanade 20 Years On: A unifying framework. International Journal of Computer Vision 56, 3, 221--255. Google Scholar
Digital Library
- Barron, J., Fleet, D., and Beauchemin, S. 1994. Performance of Optical Flow Techniques. International Journal of Computer Vision 12, 1, 43--77. Google ScholarDigital Library
- Beier, T., and Neely, S. 1992. Feature-based image metamorphosis. In Proc. ACM Conference on Computer Graphics (SIGGRAPH), 35--42. Google ScholarDigital Library
- Belongie, S., Malik, J., and Puzicha, J. 2001. Matching Shapes. In Proc. of the IEEE International Conference on Computer Vision (ICCV), 454--461.Google Scholar
- Bertsekas, D. 1992. Auction algorithms for network flow problems: A tutorial introduction. Computational Optimization and Applications 1, 7--66.Google ScholarCross Ref
- Buehler, C., Bosse, M., McMillan, L., Gortler, S., and Cohen, M. 2001. Unstructured lumigraph rendering. In Proc. ACM Conference on Computer Graphics (SIGGRAPH), 425--432. Google ScholarDigital Library
- Canny, J. 1986. A Computational Approach To Edge Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 8, 679--714. Google ScholarDigital Library
- Carranza, J., Theobalt, C., Magnor, M., and Seidel, H. P. 2003. Free-viewpoint video of human actors. In Proc. ACM Conference on Computer Graphics (SIGGRAPH), 569--577. Google ScholarDigital Library
- Chen, S., and Williams, L. 1993. View interpolation for image synthesis. In Proc. ACM Conference on Computer Graphics (SIGGRAPH), 279--288. Google ScholarDigital Library
- Debevec, P., Borshukov, G., and Yu, Y. 1998. Efficient view-dependent image-based rendering with projective texture-mapping. In Proc. Eurographics Rendering Workshop (EGRW), 105--116.Google Scholar
- Felzenszwalb, P., and Huttenlocher, D. 2004. Efficient Graph-Based Image Segmentation. International Journal of Computer Vision 59, 167--181. Google ScholarDigital Library
- Fu, M. F., Au, O., and Chan, W. C. 2002. Temporal interpolation using wavelet domain motion estimation and motion compensation. IEEE Conference on Image Processing (ICIP), 393--396.Google Scholar
- Gibson, J. 1955. The Perception of the Visual World. Cambridge UP.Google Scholar
- Gortler, S., Grzeszczuk, R., Szeliski, R., and Cohen, M. 1996. The Lumigraph. In Proc. ACM Conference on Computer Graphics (SIGGRAPH), 43--54. Google ScholarDigital Library
- Heeger, D., Boynton, G., Demb, J., Seidemann, E., and Newsome, W. 1999. Motion opponency in visual cortex. J. Neurosci. 19 (Aug), 7162--7174.Google ScholarCross Ref
- Horn, B., and Schunck, B. 1981. Determining Optical Flow. Artificial Intelligence 17, 185--203.Google ScholarDigital Library
- Isaksen, A., McMillan, L., and Gortler, S. 2000. Dynamically reparameterized light fields. In Proc. ACM Conference on Computer Graphics (SIGGRAPH), 297--306. Google ScholarDigital Library
- Jain, J., and Jain, A. 1981. Displacement Measurement and Its Application in Interframe Image Coding. IEEE Transactions on Communications 29, 12, 1799--1808.Google ScholarCross Ref
- Levoy, M., and Hanrahan, P. 1996. Light field rendering. In Proc. ACM Conference on Computer Graphics (SIGGRAPH), 31--42. Google ScholarDigital Library
- Lucas, B., and Kanade, T. 1981. An iterative image registration technique with an application to stereo vision. In Proc. Seventh International Joint Conference on Artificial Intelligence, 674--679.Google Scholar
- Mark, W., McMillan, L., and Bishop, G. 1997. Post-Rendering 3D Warping. In Proc. of the Symposium on Interactive 3D Graphics, 7--16. Google ScholarDigital Library
- Marr, D., and Hildreth, E. 1980. Theory of Edge Detection. Proc. of the Royal Society of London. Series B, Biological Sciences 207, 187--217.Google ScholarCross Ref
- Matusik, W., and Pfister, H. 2004. 3D TV: A scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes. In Proc. ACM Conference on Computer Graphics (SIGGRAPH), 814--824. Google ScholarDigital Library
- Matusik, W., Buehler, C., Raskar, R., Gortler, S., and McMillan, L. 2000. Image-based visual hulls. In Proc. ACM Conference on Computer Graphics (SIGGRAPH), 369--374. Google ScholarDigital Library
- McMillan, L., and Bishop, G. 1995. Plenoptic modeling: An image-based rendering system. Proc. ACM Conference on Computer Graphics (SIGGRAPH) (Aug.), 39--46. Google ScholarDigital Library
- Myszkowski, K., Tawara, T., Akamine, H., and Seidel, H.-P. 2001. Perception-guided global illumination solution for animation rendering. In Proc. ACM Conference on Computer Graphics (SIGGRAPH), 221--230. Google ScholarDigital Library
- O'Sullivan, C., Howlett., S., Mcdonnell, R., Y. Morvan, and K. O'Conor, K. 2004. Perceptually adaptive graphics. In Eurographics, State-of-the-art-Report 6.Google Scholar
- Qian, N., and Andersen, R. 1997. A physiological model for motion-stereo integration and a unified explanation of Pulfrich-like phenomena. Vision Res. 37 (Jun), 1683--1698.Google ScholarCross Ref
- Ramanarayanan, G., Ferwerda, J., Walter, B., and Bala, K. 2007. Visual equivalence: Towards a new standard for image fidelity. In Proc. ACM Conference on Computer Graphics (SIGGRAPH), 654--663. Google ScholarDigital Library
- Reichardt, W. 1961. Autocorrelation, a principle for the evaluation of sensory information by the central nervous system. In Sensory communication, W. Rosenblith, Ed. New York: MIT Press-Willey, 303--317.Google Scholar
- Ren, X., and Malik, J. 2003. Learning a classification model for segmentation. In Proc. of the IEEE International Conference on Computer Vision (ICCV), 10--17. Google ScholarDigital Library
- Ruzon, M., and Tomasi, C. 1999. Color Edge Detection with the Compass Operator. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 160--166.Google Scholar
- Schaefer, S., McPhail, T., and Warren, J. 2006. Image deformation using moving least squares. In Proc. ACM Conference on Computer Graphics (SIGGRAPH), 533--540. Google ScholarDigital Library
- Seitz, S. M., and Dyer, C. R. 1996. View morphing. In Proc. ACM Conference on Computer Graphics (SIGGRAPH), 21--30. Google ScholarDigital Library
- Snavely, N., Seitz, S., and Szeliski, R. 2006. Photo tourism: exploring photo collections in 3d. In Proc. ACM Conference on Computer Graphics (SIGGRAPH), 835--846. Google ScholarDigital Library
- Tourapis, A., Cheong, H., Liou, M., and Au, O. 2001. Temporal Interpolation of Video Sequences Using Zonal Based Algorithms. In IEEE Conference on Image Processing (ICIP), 895--898.Google Scholar
- Vangorp, P., Laurijssen, J., and Dutr, P. 2007. The influence of shape on the perception of material reflectance. In Proc. ACM Conference on Computer Graphics (SIGGRAPH), 1--9. Google ScholarDigital Library
- Vedula, S., Baker, S., and Kanade, T. 2005. Image based spatio-temporal modeling and view interpolation of dynamic events. ACM Transactions on Graphics 24, 2 (April), 240--261. Google ScholarDigital Library
- Wallach, H. 1935. Ueber visuell wahrgenommene bewe-gungsrichtung. Psychologische Forschung 20, 325--380.Google ScholarCross Ref
- Wallraven, C., Bülthoff, H. H., Fischer, J., Cunningham, D. W., and Bartz, D. 2007. The evaluation of real-world and computer-generated stylized facial expressions. ACM Transactions on Applied Perception 4, 3, 1--24. Google ScholarDigital Library
- Wertheimer, M. 1938. Laws of organization in perceptual forms. In A Source Book of Gestalt Psychology, W. Ellis, Ed. Kegan Paul, Trench, Trubner & Co. Ltd., 71--88.Google Scholar
- Wolberg, G. 1998. Image morphing: A survey. Visual Computer 14, 360--372.Google ScholarCross Ref
- Wood, D., Azuma, D., Aldinger, K., Curless, B., Duchamp, T., Salesin, D., and Stuetzle, W. 2000. Surface light fields for 3D photography. In Proc. ACM Conference on Computer Graphics (SIGGRAPH), 287--296. Google ScholarDigital Library
- Zitnick, C., Kang, S., Uyttendaele, M., Winder, S., and Szeliski, R. 2004. High-quality video view interpolation using a layered representation. In Proc. ACM Conference on Computer Graphics (SIGGRAPH), 600--608. Google ScholarDigital Library
Index Terms
- Perception-motivated interpolation of image sequences
Recommendations
Perception-motivated interpolation of image sequences
We present a method for image interpolation that is able to create high-quality, perceptually convincing transitions between recorded images. By implementing concepts derived from human vision, the problem of a physically correct image interpolation is ...
Rational Interpolation Splines with Region Control and Image Interpolation Application
AbstractIn this work, we deal with the region control of interpolation curves and surfaces using a class of rational interpolation splines in one and two dimensions. Simple sufficient data-dependent constraints are derived on the local control ...
An Isophote-Oriented Image Interpolation Method
ISCSCT '08: Proceedings of the 2008 International Symposium on Computer Science and Computational Technology - Volume 01This paper presents an isophote-oriented image interpolation method that attempts to produce smooth reconstructions of the image’s level curves while still maintaining image fidelity. The proposed method employs an interpolation kernel that is obtained ...
Comments