Jorge Lopez-Moreno
ABSTRACT
Recent works in image editing are opening up new possibilities to manipulate and enhance input images. Within this context, we leverage well-known characteristics of human perception along with a simple depth approximation algorithm to creatively relight images for the purpose of generating non-photorealistic renditions that would be difficult to achieve with existing methods. Our realtime implementation on graphics hardware allows the user to efficiently explore artistic possibilities for each image. We show results produced with four different styles proving the versatility of our approach, and validate our assumptions and simplifications by means of a user study.
- Akers, D., Losasso, F., Klingner, J., Agrawala, M., Rick, J., and Hanrahan, P. 2003. Conveying shape and features with image-based relighting. In VIS '03: Proceedings of the 14th IEEE Visualization 2003 (VIS'03), IEEE Computer Society, Washington, DC, USA, 46. Google Scholar
Digital Library
- Alton, J. 1945. Painting with Light. Berkeley: University of California Press.Google Scholar
- Bae, S., Paris, S., and Durand, F. 2006. Two-scale tone management for photographic look. ACM Trans. Graph. 25, 3, 637--645. Google ScholarDigital Library
- Belhumeur, P. N., Kriegman, D. J., and Yuille, A. L. 1999. The bas-relief ambiguity. Int. J. Comput. Vision 35, 1, 33--44. Google ScholarDigital Library
- Civardi, G. 2006. Drawing Light and Shade: Understanding Chiaroscuro (The Art of Drawing). Search Press.Google Scholar
- DeCarlo, D., and Santella, A. 2002. Stylization and abstraction of photographs. ACM Trans. Graph. 21, 3. Google ScholarDigital Library
- Durand, F. 2002. An invitation to discuss computer depiction. In NPAR '02: Proceedings of the 2nd international symposium on Non-photorealistic animation and rendering, ACM, New York, NY, USA, 111--124. Google ScholarDigital Library
- Durou, J.-D., Falcone, M., and Sagona, M. 2008. Numerical methods for shape-from-shading: A new survey with benchmarks. Comput. Vis. Image Underst. 109, 1, 22--43. Google ScholarDigital Library
- Elder, J. H., and Zucker, S. W. 1996. Computing contour closure. In In Proc. 4th European Conference on Computer Vision, 399--412. Google ScholarDigital Library
- Gooch, B., and Gooch, A. 2001. Non-Photorealistic Rendering. Google ScholarDigital Library
- Gooch, B., Reinhard, E., and Gooch, A. 2004. Human facial illustrations: creation and psychophysical evaluation. ACM Trans. Graph. 23, 1, 27--44. Google ScholarDigital Library
- Gutierrez, D., Lopez-Moreno, J., Fandos, J., Seron, F. J., Sanchez, M. P., and Reinhard, E. 2008. Depicting procedural caustics in single images. ACM Trans. Graph. 27, 5, 1--9. Google ScholarDigital Library
- I.T.U. 1990. Basic Parameter Values for the HDTV Standard for the Studio and for International Programme Exchange. Geneva, ch. ITU-R Recommendation BT.709, Formerly CCIR Rec. 709.Google Scholar
- Johnston, S. F. 2002. Lumo: illumination for cel animation. In NPAR '02: Proceedings of the 2nd international symposium on Non-photorealistic animation and rendering, ACM, New York, NY, USA, 45--ff. Google ScholarDigital Library
- Kahrs, J., Calahan, S., Carson, D., and Poster, S. 1996. Pixel cinematography: A lighting approach for computer graphics. In ACM SIGGRAPH Course Notes, 433--442.Google Scholar
- Kang, S. B., 1998. Depth painting for image-based rendering applications. U.S. Patent no. 6,417,850, granted July 9, 200.Google Scholar
- Khan, E. A., Reinhard, E., Fleming, R., and Bülthoff, H. 2006. Image-based material editing. ACM Transactions on Graphics (SIGGRAPH 2006) 25, 3, 654--663. Google ScholarDigital Library
- Koenderink, J., Doorn, A. V., Kappers, A., and Todd, J. 2001. Ambiguity and the mental eye in pictorial relief. Perception 30, 4, 431--448.Google ScholarCross Ref
- Langer, M., and Bülthoff, H. H. 2000. Depth discrimination from shading under diffuse lighting. Perception 29, 6, 649--660.Google ScholarCross Ref
- Langer, M., and Zucker, S. 1997. Casting light on illumination: A computational model and dimensional analysis of sources. Computer Vision and Image Understanding 65, 322--335. Google ScholarDigital Library
- Li, Y., Sun, J., Tang, C.-K., and Shum, H.-K. 2004. Lazy snapping. In Siggraph, ACM, Los Angeles, California, 303--308. Google ScholarDigital Library
- Loffler, G. 2008. Perception of contours and shapes: Low and intermediate stage mechanisms. Vision research (May).Google Scholar
- Marr, D. 1982. Vision. W. H. Freeman and Company, New York.Google Scholar
- McCann, J., and Pollard, N. S. 2008. Real-time gradientdomain painting. ACM Trans. Graph. 27, 3, 1--7. Google ScholarDigital Library
- Mould, D., and Grant, K. 2008. Stylized black and white images from photographs. In NPAR '08: Proceedings of the 6th international symposium on Non-photorealistic animation and rendering, ACM, New York, NY, USA, 49--58. Google ScholarDigital Library
- Oh, B. M., Chen, M., Dorsey, J., and Durand, F. 2001. Image-based modeling and photo editing. In SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniques, ACM, New York, NY, USA, 433--442. Google ScholarDigital Library
- Okabe, M., Zeng, G., Matsushita, Y., Igarashi, T., Quan, L., and yeung Shum, H. 2006. Single-view relighting with normal map painting. In In Proceedings of Pacific Graphics 2006, 27--34.Google Scholar
- O'Shea, J. P., Banks, M. S., and Agrawala, M. 2008. The assumed light direction for perceiving shape from shading. In ACM Applied Perception in Graphics and Visualization (APGV), 135--142. Google ScholarDigital Library
- Ostromoukhov, V. 1999. Digital Facial Engraving. ACM Press/ACM SIGGRAPH, New York, 417--424. Google ScholarDigital Library
- Ostrovsky, Y., Cavanagh, P., and Sinha, P. 2005. Perceiving illumination inconsistencies in scenes. Perception 34, 1301--1314.Google ScholarCross Ref
- Raskar, R., Tan, K.-H., Feris, R., Yu, J., and Turk, M. 2004. Non-photorealistic camera: depth edge detection and stylized rendering using multi-flash imaging. In SIGGRAPH '04: ACM SIGGRAPH 2004 Papers, ACM, New York, NY, USA, 679--688. Google ScholarDigital Library
- Rother, C., Kolmogorov, V., and Blake, A. 2004. GrabCut: Interactive foreground extraction using iterated graph cuts. In Siggraph, ACM, Los Angeles, California, 309--314. Google ScholarDigital Library
- Rusinkiewicz, S., Burns, M., and DeCarlo, D. 2006. Exaggerated shading for depicting shape and detail. In SIGGRAPH '06: ACM SIGGRAPH 2006 Papers, ACM, New York, NY, USA, 1199--1205. Google ScholarDigital Library
- Snavely, N., Zitnick, C. L., Kang, S. B., and Cohen, M. 2006. Stylizing 2.5-d video. In NPAR '06: Proceedings of the 4th international symposium on Non-photorealistic animation and rendering, ACM, New York, NY, USA, 63--69. Google ScholarDigital Library
- Strothotte, T., and Schlechtweg, S. 2002. Non-Photorealistic Computer Graphics. Google ScholarDigital Library
- Tatarchuk, N. 2006. Shader X5. Charles River Media, ch. Practical Parallax Occlusion Mapping, 75--105.Google Scholar
- Todo, H., Anjyo, K., Baxter, W., and Igarashi, T. 2007. Locally controllable stylized shading. In SIGGRAPH '07: ACM SIGGRAPH 2007 papers, ACM, New York, NY, USA, 17. Google ScholarDigital Library
- Tomasi, C., and Manduchi, R. 1998. Bilateral filtering for gray and color images. In Proceedings of the IEEE International Conference on Computer Vision, 836--846. Google ScholarDigital Library
- Yan, C.-R., Chi, M.-T., Lee, T.-Y., and Lin, W.-C. 2008. Stylized rendering using samples of a painted image. IEEE Transactions on Visualization and Computer Graphics 14, 2, 468--480. Google ScholarDigital Library
- Zatzarinni, R., Tal, A., and Shamir, A. 2009. Relief analysis and extraction. ACM Transactions on Graphics, (Proceedings of SIGGRAPH ASIA 2009) 28, 5. Google ScholarDigital Library
Index Terms
- Stylized depiction of images based on depth perception
Recommendations
Dynamic stylized shading primitives
NPAR '11: Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and RenderingShading appearance in illustrations, comics and graphic novels is designed to convey illumination, material and surface shape characteristics at once. Moreover, shading may vary depending on different configurations of surface distance, lighting, ...
Locally controllable stylized shading
Recent progress in non-photorealistic rendering (NPR) has led to many stylized shading techniques that efficiently convey visual information about the objects depicted. Another crucial goal of NPR is to give artists simple and direct ways to express the ...
Extended papers from NPAR 2010: Non-photorealistic, depth-based image editing
Recent works in image editing are opening up new possibilities to manipulate and enhance input images. Within this context, we leverage well-known characteristics of human perception along with a simple depth approximation algorithm to generate non-...
Comments