Steve Zelinka
Michael Garland
Skip Abstract Section
Abstract
We present techniques for accelerated texture synthesis from example images. The key idea of our approach is to divide the task into two phases: analysis, and synthesis. During the analysis phase, which is performed once per sample texture, we generate a <i>jump map</i>. Using the jump map, the synthesis phase is capable of synthesizing texture similar to the analyzed example at interactive rates. We describe two such synthesis phase algorithms: one for creating images, and one for directly texturing manifold surfaces. We produce texture images at rates comparable to the fastest alternative algorithms, and produce textured surfaces an order of magnitude faster than current alternative approaches. We further develop a new, faster patch-based algorithm for image synthesis, which improves the quality of our results on ordered textures. We show how controls used for specifying texture synthesis on surfaces may be used on images as well, allowing interesting new image-based effects, and highlight modelling applications enabled by the speed of our approach.
- Arikan, O. and Forsyth, D. A. 2002. Interactive motion generation from examples. In Proceedings of SIGGRAPH 2002. ACM SIGGRAPH, San Antonio, TX, 483--490. Google Scholar
- Ashikhmin, M. 2001. Synthesizing natural textures. In Proceedings of 2001 ACM Symposium on Interactive 3D Graphics. ACM SIGGRAPH, North Carolina, 217--226. Google Scholar
- Ashikhmin, M. 2003. Fast texture transfer. IEEE Comput. Graph. Appl. 23, 4, 38--43. Google ScholarDigital Library
- Bagomjakov, A. and Gotsman, C. 2002. Universal rendering sequences for transparent vertex caching of progressive meshes. Comput. Graph. Forum 21, 2, 137--148.Google ScholarCross Ref
- Bertalmio, M., Vese, L., Sapiro, G., and Osher, S. 2003. Simultaneous structure and texture image inpainting. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2003). Vol. 2. IEEE Computer Society, 707--712.Google Scholar
- Carr, N. A. and Hart, J. C. 2002. Meshed atlases for real-time procedural solid texturing. ACM Trans. Graph. 21, 2 (Apr.), 106--131. Google ScholarDigital Library
- Cohen, M. F., Shade, J., Hiller, S., and Deussen, O. 2003. Wang tiles for image and texture generation. ACM Trans. Graph., SIGGRAPH 2003 22, 2 (July), 286--294. Google Scholar
- Criminisi, A., Perez, P., and Toyama, K. 2003. Object removal by exemplar-based inpainting. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2003). Vol. 2. IEEE Computer Society, 721--728.Google Scholar
- De Bonet, J. S. 1997. Multiresolution sampling procedure for analysis and synthesis of texture images. In Proceedings of SIGGRAPH '97. ACM SIGGRAPH, Los Angeles, CA, 361--368. Google Scholar
- Dischler, J.-M., Maritaud, K., Lévy, B., and Ghazanfarpour, D. 2002. Texture particles. In Eurographics 2002 Conference Proceedings. Eurographics Association, Saarbr ucken, Germany.Google Scholar
- Drori, I., Cohen-Or, D., and Yeshurun, H. 2003. Fragment-based image completion. ACM Trans. Graph., SIGGRAPH 2003 22, 2 (July), 303--312. Google Scholar
- Ebert, D., Musgrave, K., Peachey, D., Perlin, K., and Worley, S. 1994. Texturing and Modeling: A Procedural Approach. AP Professional, Cambridge, MA. Google Scholar
- Efros, A. A. and Freeman, W. T. 2001. Image quilting for texture synthesis and transfer. In Proceedings of SIGGRAPH 2001. ACM SIGGRAPH, Los Angeles, CA, 341--346. Google Scholar
- Efros, A. A. and Leung, T. K. 1999. Texture synthesis by non-parametric sampling. In IEEE International Conference on Computer Vision. IEEE Computer Society, Corfu, Greece, 1033--1038. Google Scholar
- Fleischer, K. W., Laidlaw, D. H., Currin, B. L., and Barr, A. H. 1995. Cellular texture generation. In Proceedings of SIGGRAPH '95. ACM SIGGRAPH, Los Angeles, CA, 239--248. Google Scholar
- Harrison, P. 2001. A non-hierarchical procedure for re-synthesis of complex textures. In Winter School of Computer Graphics (WSCG'01) 2001, V. Skala, Ed. 190--197.Google Scholar
- Heeger, D. J. and Bergen, J. R. 1995. Pyramid-based texture analysis/synthesis. In SIGGRAPH '95 Proceedings. ACM SIGGRAPH, 229--238. Google Scholar
- Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., and Salesin, D. H. 2001. Image analogies. In Proceedings of SIGGRAPH 2001. ACM SIGGRAPH, Los Angeles, CA, 327--340. Google Scholar
- Hertzmann, A. and Seitz, S. M. 2003. Shape and materials by example: A photometric stereo approach. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR '03). Vol. 1. IEEE Computer Society, Madison, WI, 533--540. Google Scholar
- Jia, J. and Tang, C. K. 2003. Image repairing: Robust image synthesis by adaptive nd tensor voting. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2003). Vol. 1. IEEE Computer Society, 643--650. Google Scholar
- Jollife, I. T. 1986. Principal Component Analysis. Springer-Verlag, New York.Google Scholar
- Kovar, L., Gleicher, M., and Pighin, F. 2002. Motion graphs. In Proceedings of SIGGRAPH 2002. ACM SIGGRAPH, San Antonio, TX, 473--482. Google Scholar
- Kwatra, V., Schödl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut textures: Image and video synthesis using graph cuts. ACM Trans. Graph., SIGGRAPH 2003 22, 2 (July), 277--286. Google Scholar
- Lee, J., Chai, J., Reitsma, P. S. A., Hodgins, J. K., and Pollard, N. S. 2002. Interactive control of avatars animated with human motion data. In Proceedings of SIGGRAPH 2002. ACM SIGGRAPH, San Antonio, TX, 491--500. Google Scholar
- Legakis, J., Dorsey, J., and Gortler, S. J. 2001. Feature-based cellular texturing for architectural models. In Proceedings of SIGGRAPH 2001. ACM SIGGRAPH, Los Angeles, CA, 309--316. Google Scholar
- Leung, T. K. and Malik, J. 1999. Recognizing surfaces using three-dimensional textons. In IEEE International Conference on Computer Vision (ICCV '99). IEEE Computer Society, Kerkya, Greece. Google Scholar
- Liang, L., Liu, C., Xu, Y.-Q., Guo, B., and Shum, H.-Y. 2001. Real-time texture synthesis by patch-based sampling. ACM Trans. Graph. (TOG) 20, 3, 127--150. Google ScholarDigital Library
- Liu, C., Shum, H.-Y., and Zhang, C.-S. 2001. A two-step approach to hallucinating faces: Global parametric model and local non-parametric model. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR '01). Vol. 1. IEEE Computer Society, Kauai, Hawaii, 192--198.Google Scholar
- Magda, S. and Kriegman, D. 2003. Fast texture synthesis on arbitrary meshes. In Proceedings of the Eurographics Symposium on Rendering 2003. Eurographics Association, Leuven, Belgium, 82--89. Google Scholar
- Mount, D. M. 1998. Ann programming manual. Tech. rep., Department of Computer Science, University of Maryland, College Park, Maryland.Google Scholar
- Nealen, A. and Alexa, M. 2003. Hybrid texture synthesis. In Proceedings of the Eurographics Symposium on Rendering 2003. Eurographics Association, Leuven, Belgium, 97--105. Google Scholar
- Neyret, F. and Cani, M.-P. 1999. Pattern-based texturing revisited. In Proceedings of SIGGRAPH '99. ACM SIGGRAPH, Los Angeles, CA, 235--242. Google Scholar
- Piponi, D. and Borshukov, G. 2000. Seamless texture mapping of subdivision surfaces by model pelting and texture blending. In Proceedings of SIGGRAPH 2000. ACM SIGGRAPH, New Orleans, LA, 471--478. Google Scholar
- Praun, E., Finkelstein, A., and Hoppe, H. 2000. Lapped textures. In Proceedings of SIGGRAPH 2000. ACM SIGGRAPH, New Orleans, LA, 465--470. Google Scholar
- Sagan, H. 1994. Space-Filling Curves. Springer-Verlag, New York.Google Scholar
- Sander, P. V., Gortler, S. J., Snyder, J., and Hoppe, H. 2002. Signal-specialized parameterization. In Proceedings of the Thirteenth Eurographics Workshop on Rendering Techniques. Eurographics Association, Pisa, Italy, 87--98. Google Scholar
- Schödl, A., Szeliski, R., Salesin, D., and Essa, I. 2000. Video textures. In Proceedings of SIGGRAPH 2000. ACM SIGGRAPH, New Orleans, LA, 489--498. Google Scholar
- Sheffer, A. and Hart, J. C. 2002. Seamster: Inconspicuous low-distortion texture seam layout. In Proceedings of IEEE Visualization 2002. IEEE Computer Society, Boston, MA, 291--298. Google Scholar
- Soler, C., Cani, M.-P., and Angelidis, A. 2002. Hierarchical pattern mapping. In Proceedings of SIGGRAPH 2002. ACM SIGGRAPH, San Antonio, TX, 673--680. Google Scholar
- Tong, X., Zhang, J., Liu, L., Wang, X., Guo, B., and Shum, H.-Y. 2002. Synthesis of bidirectional texture functions on arbitrary surfaces. In Proceedings of SIGGRAPH 2002. ACM SIGGRAPH, San Antonio, TX, 665--672. Google Scholar
- Turk, G. 2001. Texture synthesis on surfaces. In Proceedings of SIGGRAPH 2001. ACM SIGGRAPH, Los Angeles, CA, 347--354. Google ScholarDigital Library
- Wei, L.-Y. and Levoy, M. 2000. Fast texture synthesis using tree-structured vector quantization. In Proceedings of SIGGRAPH 2000. ACM SIGGRAPH, New Orleans, LA, 479--488. Google Scholar
- Wei, L.-Y. and Levoy, M. 2001. Texture synthesis over arbitrary manifold surfaces. In Proceedings of SIGGRAPH 2001. ACM SIGGRAPH, Los Angeles, CA, 355--360. Google Scholar
- Wei, L.-Y. and Levoy, M. 2002. Order-independent texture synthesis. Tech. Rep. TR-2002-01, Computer Science Department, Stanford University. Apr.Google Scholar
- Welsh, T., Ashikhmin, M., and Mueller, K. 2002. Transferring color to grayscale images. In Proceedings of SIGGRAPH 2002. ACM SIGGRAPH, San Antonio, TX, 277--280. Google Scholar
- Xu, Y.-Q., Guo, B., and Shum, H. 2000. Chaos mosaic: Fast and memory efficient texture synthesis. Tech. Rep. MSR-TR-2000-32, Microsoft Research. April.Google Scholar
- Ying, L., Hertzmann, A., Biermann, H., and Zorin, D. 2001. Texture and shape synthesis on surfaces. In Proceedings of the Twelfth Eurographics Workshop on Rendering Techniques. Eurographics Assocation, London, UK, 301--312. Google Scholar
- Zelinka, S. and Garland, M. 2002. Towards real-time texture synthesis with the jump map. In Proceedings of the Thirteenth Eurographics Workshop on Rendering Techniques. Eurographics Association, Pisa, Italy, 99--104. Google Scholar
- Zelinka, S. and Garland, M. 2003. Interactive texture synthesis on surfaces using jump maps. In Proceedings of the Eurographics Symposium on Rendering 2003. Eurographics Association, Leuven, Belgium, 90--96. Google Scholar
- Zhang, J., Zhou, K., Velho, L., Guo, B., and Shum, H.-Y. 2003. Synthesis of progressively variant texture on arbitrary surfaces. ACM Trans. Graph., SIGGRAPH 2003 22, 2 (July), 295--302. Google Scholar
Index Terms
- Jump map-based interactive texture synthesis
Recommendations
Geometry texture synthesis based on Laplacian texture image
In this paper, we present a new method to synthesize geometric texture details on an arbitrary surface from a sample texture patch. The key idea is to use Laplacian texture images to represent geometric texture details, which in turn facilitate simple ...
Towards real-time texture synthesis with the jump map
EGRW '02: Proceedings of the 13th Eurographics workshop on RenderingWhile texture synthesis has been well-studied in recent years, real-time techniques remain elusive. To help facilitate real-time texture synthesis, we divide the task of texture synthesis into two phases: a relatively slow analysis phase, and a real-time ...
Interactive texture synthesis on surfaces using jump maps
EGRW '03: Proceedings of the 14th Eurographics workshop on RenderingWe introduce a new method for fast texture synthesis on surfaces from examples. We generalize the image-based jump map texture synthesis algorithm, which partitions the task of texture synthesis into a slower analysis phase and a fast synthesis phase, by ...
Comments