Johannes Kopf
Dani Lischinski
ABSTRACT
Image analysis and enhancement tasks such as tone mapping, colorization, stereo depth, and photomontage, often require computing a solution (e.g., for exposure, chromaticity, disparity, labels) over the pixel grid. Computational and memory costs often require that a smaller solution be run over a downsampled image. Although general purpose upsampling methods can be used to interpolate the low resolution solution to the full resolution, these methods generally assume a smoothness prior for the interpolation.
We demonstrate that in cases, such as those above, the available high resolution input image may be leveraged as a prior in the context of a joint bilateral upsampling procedure to produce a better high resolution solution. We show results for each of the applications above and compare them to traditional upsampling methods.
Supplemental Material
- Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., and Cohen, M. 2004. Interactive digital photomontage. ACM Transactions on Graphics 23, 3 (Proc. SIGGRAPH 2004), 294--302. Google Scholar
Digital Library
- Barash, D. 2002. A fundamental relationship between bilateral filtering, adaptive smoothing, and the nonlinear diffusion equation. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 6, 844--847. Google ScholarDigital Library
- Boykov, Y., Veksler, O., and Zabih, R. 2001. Fast approximate energy minimization via graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 11, 1222--1239. Google ScholarDigital Library
- Durand, F., and Dorsey, J. 2002. Fast bilateral filtering for the display of high-dynamic-range images. ACM Transactions on Graphics 21, 3 (Proc. SIGGRAPH 2002), 257--266. Google ScholarDigital Library
- Durand, F., Holzschuch, N., Soler, C., Chan, E., and Sillion, F. X. 2005. A frequency analysis of light transport. ACM Transactions on Graphics 24, 3 (Proc. SIGGRAPH 2005), 1115--1126. Google ScholarDigital Library
- Eisemann, E., and Durand, F. 2004. Flash photography enhancement via intrinsic relighting. ACM Transactions on Graphics 23, 3 (Proc. SIGGRAPH 2004), 673--678. Google ScholarDigital Library
- Elad, M. 2002. On the bilateral filter and ways to improve it. IEEE Transactions on Image Processing 11, 10, 1141--1151. Google ScholarDigital Library
- Fattal, R., Lischinski, D., and Werman, M. 2002. Gradient domain high dynamic range compression. ACM Transactions on Graphics 21, 3 (Proc. SIGGRAPH 2002), 249--256. Google ScholarDigital Library
- Flint, G. 2007. The Gigapxl Project.Google Scholar
- Kopf, J., Uyttendaele, M., Deussen, O., and Cohen, M. F. 2007. Capturing and viewing gigapixel images. ACM Transactions on Graphics 26, 3 (Proc. SIGGRAPH 2007). Google ScholarDigital Library
- Levin, A., Lischinski, D., and Weiss, Y. 2004. Colorization using optimization. ACM Transactions on Graphics 23, 3 (Proc. SIGGRAPH 2004), 689--694. Google ScholarDigital Library
- Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. 2006. Interactive local adjustment of tonal values. ACM Transactions on Graphics 25, 3 (Proc. SIGGRAPH 2006), 646--653. Google ScholarDigital Library
- Paris, S., and Durand, F. 2006. A fast approximation of the bilateral filter using a signal processing approach. Proceedings of ECCV 2006). Google ScholarDigital Library
- Petschnigg, G., Szeliski, R., Agrawala, M., Cohen, M., Hoppe, H., and Toyama, K. 2004. Digital photography with flash and no-flash image pairs. ACM Transactions on Graphics 23, 3 (Proc. SIGGRAPH 2004), 664--672. Google ScholarDigital Library
- Ramanath, R., and Snyder, W. 2003. Adaptive demosaicking. Journal of Electronic Imaging 12, 4, 633--642.Google ScholarCross Ref
- Reinhard, E., Ward, G., Pattanaik, S., and Debevec, P. 2005. High Dynamic Range Imaging. Morgan Kaufmann.Google Scholar
- Sawhney, H. S., Guo, Y., Hanna, K., Kumar, R., Adkins, S., and Zhou, S. 2001. Hybrid stereo camera: an ibr approach for synthesis of very high resolution stereoscopic image sequences. Proceedings of SIGGRAPH 2001, 451--460. Google ScholarDigital Library
- Scharstein, D., and Szeliski, R. 2002. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. International Journal of Computer Vision 47, 1--3, 7--42. Google ScholarDigital Library
- Szeliski, R. 2006. Locally adapted hierarchical basis preconditioning. ACM Transactions on Graphics 25, 3 (Proc. SIGGRAPH 2006), 1135--1143. Google ScholarDigital Library
- Tomasi, C., and Manduchi, R. 1998. Bilateral filtering for gray and color images. Proceedings of ICCV 1998, 839--846. Google ScholarDigital Library
- Weiss, B. 2006. Fast median and bilateral filtering. ACM Transactions on Graphics 25, 3 (Proc. SIGGRAPH 2006), 519--526. Google ScholarDigital Library
- Wolberg, G. 1990. Digital Image Warping. IEEE Computer Society Press, Los Alamitos, CA. Google ScholarDigital Library
- Yatziv, L., and Sapiro, G. 2006. Fast image and video colorization using chrominance blending. IEEE Transactions on Image Processing 15, 5, 1120--1129. Google ScholarDigital Library
Index Terms
- Joint bilateral upsampling
Recommendations
Joint bilateral upsampling
Image analysis and enhancement tasks such as tone mapping, colorization, stereo depth, and photomontage, often require computing a solution (e.g., for exposure, chromaticity, disparity, labels) over the pixel grid. Computational and memory costs often ...
Fast multi-scale joint bilateral texture upsampling
Special Issue: CAD/Graphics 2009We present a new approach using a multi-scale joint bilateral filter for upsampling the synthesized texture generated by optimization-based methods. Our method is based on the following motivation: if the available exemplar texture is used as a priority ...
Enhancement of dynamic depth scenes by upsampling for precise super-resolution (UP-SR)
Multi-frame super-resolution is the process of recovering a high resolution image or video from a set of captured low resolution images. Super-resolution approaches have been largely explored in 2-D imaging. However, their extension to depth videos is ...
Comments