Skip to main content
Log in

Shadow based texture registration for 3D modeling of outdoor scenes

Machine Vision and Applications Aims and scope Submit manuscript

Abstract

This paper presents a novel method for the registration of texture images with a 3D model of outdoor scenes. We pose image registration as an optimization problem that uses knowledge of the sun’s position to estimate shadows in a scene, and use the shadows produced as a cue to solve for the registration parameters. Results are presented on a controlled experiment and for a large scale model of an archaeological site in Sicily.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

References

  1. Allen, P., Feiner, S., Troccoli, A., Benko, H., Ishak, E., Smith, B.: Seeing into the past: Creating a 3D modeling pipeline for archaeological visualization. In: Proceedings of 2nd International Symposium on 3D Data Processing, Visualization and Transmission (2004)

  2. Ansar A., Daniilidis K. (2003). Linear pose estimation from points or lines. IEEE Trans. Pattern Anal. Mach. Intell. 25(5): 578–589. DOI http://dx.doi.org/10.1109/TPAMI.2003. 1195992

    Article  Google Scholar 

  3. Bernardini F., Rushmeier H. (2002) The 3D model acquisition pipeline. Computer Graphics Forum 21(2): 149–172

    Article  Google Scholar 

  4. Bernardini F., Rushmeier H., Martin I.M., Mittleman J., Taubin G. (2002) Building a digital model of Michelangelo’s Florentine Pietà. IEEE Comput. Graph. Appl. 22(1): 59–67

    Article  Google Scholar 

  5. Bouguet, J.Y.: Camera calibration toolbox for Matlab. (2001). Http://www.vision.caltech.edu/bouguet/calib_doc

  6. Curless, B., Levoy, M.: A volumetric method for building complex models from range images. In: Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, pp. 303–312. ACM Press (1996)

  7. Daum, M., Dudek, G.: On 3-d surface reconstruction using shape from shadows. In: CVPR ’98: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p. 461. IEEE Computer Society, Washington (1998)

  8. Funka-Lea, G., Bajcsy, R.: Combining color and geometry for the active, visual recognition of shadows. In: ICCV ’95: Proceedings of the 5th International Conference on Computer Vision, p. 203. IEEE Computer Society, Washington (1995)

  9. Hartley R., Zisserman A. (2000) Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge

    MATH  Google Scholar 

  10. Ikeuchi, K., Nakazawa, A., Nishino, K., Oishi, T.: Creating virtual buddha statues through observation. In: IEEE Workshop on Applications of Computer Vision in Architecture, vol.~1 (2003)

  11. Ingber L. (1989) Very fast simulated re-annealing. Math. Comput. Modelling 12(8): 967–973

    Article  MATH  MathSciNet  Google Scholar 

  12. Irvin R.B., David M., McKeown J. (1989) Methods for exploiting the relationship between buildings and their shadows in aerial imagery. IEEE Trans. Syst. Man Cybern. 19(6): 1564–1575

    Article  Google Scholar 

  13. Kriegman, D.J., Belhumeur, P.N.: What shadows reveal about object structure. In: ECCV ’98: Proceedings of the 5th European Conference on Computer Vision, vol. II, pp. 399–414. Springer, Berlin Heidelberg New York (1998)

  14. Lensch H.P., Heidrich W., Seidel H.P. (2001) A silhouette-based algorithm for texture registration and stitching. Graph. Models 63(4): 245–262

    Article  MATH  Google Scholar 

  15. Levoy, M., Pulli, K., Curless, B., Rusinkiewicz, S., Koller, D., Pereira, L., Ginzton, M., Anderson, S., Davis, J., Ginsberg, J., Shade, J., Fulk, D.: The digital Michelangelo project: 3D scanning of large statues. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 131–144 (2000)

  16. Liu, L., Stamos, I.: Automatic 3d to 2d registration for the photorealistic rendering of urban scenes. In: CVPR ’05: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), vol. 2, pp. 137–143. IEEE Computer Society, Washington (2005). DOI http://dx.doi.org/10.1109/CVPR.2005.80

  17. Pulli, K., Cohen, M., Duchamp, T., Hoppe, H., Shapiro, L., Stuetzle, W.: View-based rendering: Visualizing real objects from scanned range and color data. In: Rendering Techniques ’97, pp. 23–34. Springer, Berlin Heidelberg New York (1997)

  18. Reda, I., Andreas, A.: Solar position algorithm for solar radiation applications. Tech. Rep., National Renewable Enery Laboratory, Golden, Colorado (2003)

  19. Rocchini, C., Cignomi, P., Montani, C., Scopigno, R.: Multiple textures stitching and blending on 3D objects. In: Rendering Techniques ’99, Eurographics, pp. 119–130. Springer, Wien (1999)

  20. Salvador E., Cavallaro A., Ebrahimi T. (2004). Cast shadow segmentation using invariant color features. Comput. Vis. Image Underst. 95(2): 238–259. DOI http://dx.doi.org/ 10.1016/j.cviu.2004.03.008

    Article  Google Scholar 

  21. Sato I., Sato Y., Ikeuchi K. (2003). Illumination from shadows. IEEE Trans. Pattern Anal. Mach. Intell. 25(3): 290–300. DOI http://dx.doi.org/10.1109/TPAMI.2003.1182093

    Article  Google Scholar 

  22. Segal, M., Korobkin, C., van Widenfelt, R., Foran, J., Haeberli, P.: Fast shadows and lighting effects using texture mapping. In: Proceedings of the 19th annual conference on Computer graphics and interactive techniques, pp. 249–252. ACM Press (1992)

  23. Stamos, I., Allen, P.K.: Automatic registration of 2-D with 3-D imagery in urban environments. In: Proceedings of the 8th International Conference On Computer Vision (ICCV-01), pp. 731–737. IEEE Computer Society, Los Alamitos, CA (2001)

  24. Yu Y., Chang J.T. (2005). Shadow graphs and 3d texture reconstruction. Int. J. Comput. Vis. 62(1–2): 35–60 DOI http:// dx.doi.org/ 10.1007/s11263-005-4634-5

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Peter Allen.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Troccoli, A., Allen, P. Shadow based texture registration for 3D modeling of outdoor scenes. Machine Vision and Applications 18, 65–72 (2007). https://doi.org/10.1007/s00138-006-0048-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-006-0048-9

Keywords

Navigation