Skip to main content
Log in

3D scanning of cultural heritage with consumer depth cameras

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Three dimensional reconstruction of cultural heritage objects is an expensive and time-consuming process. Recent consumer real-time depth acquisition devices, like Microsoft Kinect, allow very fast and simple acquisition of 3D views. However 3D scanning with such devices is a challenging task due to the limited accuracy and reliability of the acquired data. This paper introduces a 3D reconstruction pipeline suited to use consumer depth cameras as hand-held scanners for cultural heritage objects. Several new contributions have been made to achieve this result. They include an ad-hoc filtering scheme that exploits the model of the error on the acquired data and a novel algorithm for the extraction of salient points exploiting both depth and color data. Then the salient points are used within a modified version of the ICP algorithm that exploits both geometry and color distances to precisely align the views even when geometry information is not sufficient to constrain the registration. The proposed method, although applicable to generic scenes, has been tuned to the acquisition of sculptures and in this connection its performance is rather interesting as the experimental results indicate.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

References

  1. Andreetto M, Brusco N, Cortelazzo G (2004) Automatic 3d modeling of textured cultural heritage objects. Image Process IEEE Trans 13(3):354–369

    Article  Google Scholar 

  2. Argan GC (2001) Il secondo Novecento - L’Arte Moderna. Sansoni

  3. Bernardini F, Rushmeier H (2002) The 3d model acquisition pipeline. In: Computer graphics forum. 21: 149–172

  4. Besl PJ, McKay ND (1992) A method for registration of 3-d shapes. IEEE Trans on PAMI 14(2):239–256

    Article  Google Scholar 

  5. Cappelletto E, Zanuttigh P, Cortelazzo GM (2013) Handheld scanning with 3d cameras. In: Multimedia Signal Processing (MMSP), 2013 I.E. 15th International Workshop on 367–372

  6. Cui Y, Schuon S, Derek C, Thrun S, Theobalt C (2010) 3d shape scanning with a time-of-flight camera. In: In Proc. of CVPR 2010

  7. Cui Y, Schuon S, Thrun S, Stricker D, Theobalt C (2013) Algorithms for 3d shape scanning with a depth camera. Pattern Analysis Mach Intell IEEE Trans 35(5):1039–1050

    Article  Google Scholar 

  8. Dal Mutto C, Zanuttigh P, Cortelazzo G (2010) A probabilistic approach to tof and stereo data fusion. In: 3DPVT, Paris, France

  9. Dal Mutto C, Zanuttigh P, Cortelazzo GM (2012) Time-of-flight cameras and microsoft Kinect. Springer briefs in electrical and computer engineering, Springer

  10. El-Hakim S, Beraldin JA, Picard M, Godin G (2004) Detailed 3d reconstruction of large-scale heritage sites with integrated techniques. Comput Graph Appl IEEE 24(3):21–29

    Article  Google Scholar 

  11. Fossati A, Gall J, Grabner H, Ren X, Konolige K (eds) (2013) Consumer depth cameras for computer vision: research topics and applications. advances in computer vision and pattern recognition, Springer

  12. Henry P, Krainin M, Herbst E, Ren X, Fox D (2012) Rgb-d mapping: using kinect-style depth cameras for dense 3d modeling of indoor environments. Int J Robot Res 31(5):647–663

    Article  Google Scholar 

  13. Herrera CD, Kannala J, Heikkilä J (2012) Joint depth and color camera calibration with distortion correction. Pattern Analysis Mach Intell IEEE Trans 34(10):2058–2064

    Article  Google Scholar 

  14. Holzer S, Rusu RB, Dixon M, Gedikli S, Navab N (2012) Adaptive neighborhood selection for real-time surface normal estimation from organized point cloud data using integral images. In: Proc. of IROS, 2684–2689

  15. Khoshelham K (2011) Accuracy analysis of kinect depth data. In: Proc. of ISPRS workshop laser scanning, 38

  16. Khoshelham K, Elberink SO (2012) Accuracy and resolution of kinect depth data for indoor mapping applications. Sensors 12(2):1437–1454

    Article  Google Scholar 

  17. Khosravani A, Lingenfelder M, Wenzel K, Fritsch D (2012) Co-registration of kinect point clouds based on image and object space observations. In: Proceedings of LC3D workshop

  18. Laurentini A (1994) The visual hull concept for silhouette-based image understanding. Pattern Analysis Mach Intell IEEE Trans 16(2):150–162

    Article  Google Scholar 

  19. Levoy M, Pulli K, Curless B, Rusinkiewicz S, Koller D, Pereira L, Ginzton M, Anderson S, Davis J, Ginsberg J, Shade J, Fulk D (2000) The digital Michelangelo project: 3d scanning of large statues. In: Proceedings of the 27th annual conference on computer graphics and interactive techniques, SIGGRAPH’00 131–144

  20. Mara H, Kampel M, Niccolucci F, Sablatnig R (2007) Ancient coins and ceramics - 3d and 2d documentation for preservation and retrieval of lost heritage. In: 2nd ISPRS international workshop 3D-ARCH 2007

  21. Newcombe RA, Izadi S, Hilliges O, Molyneaux D, Kim D, Davison A, Kohli P, Shotton J, Hodges S, Fitzgibbon A (2011) Kinectfusion: real-time dense surface mapping and tracking. In: Proc. of IEEE ISMAR

  22. Pavlidis G, Koutsoudis A, Arnaoutoglou F, Tsioukas V, Chamzas C (2007) Methods for 3d digitization of cultural heritage. J Cult Herit 8(1):93–98

    Article  Google Scholar 

  23. PCL (2013) Point cloud library (pcl). http://pointclouds.org/

  24. Pollefeys M, Proesmans M, Koch R, Vergauwen M, Van Gool L (2008) Detailed model acquisition for virtual reality. In: Virtual reality in archaeology, ArcheoPress 71–77

  25. ReconstructMe (2013) Reconstructme. http://reconstructme.net/

  26. Remondino F (2011) Heritage recording and 3d modeling with photogrammetry and 3d scanning. Remote Sens 3(6):1104–1138

    Article  Google Scholar 

  27. Rusinkiewicz S, Levoy M (2001) Efficient variants of the icp algorithm. In: Proc. of 3-D digital imaging and modeling. 145–152

  28. Seitz S, Curless B, Diebel J, Scharstein D, Szeliski R (2006) A comparison and evaluation of multi-view stereo reconstruction algorithms. In: Proc. of CVPR 1: 519–528

  29. Shotton J, Fitzgibbon A, Cook M, Sharp T, Finocchio M, Moore R, Kipman A, Blake A (2011) Real-time human pose recognition in parts from a single depth image. In: Proceedings of CVPR

  30. Skanect (2013) Skanect. http://skanect.manctl.com/

  31. Snavely N, Seitz SM, Szeliski R (2008) Modeling the world from internet photo collections. Int J Comput Vision 80(2):189–210

    Article  Google Scholar 

  32. Sprickerhof J, Nüchter A, Lingemann K, Hertzberg J (2009) An explicit loop closing technique for 6d slam. In: Proc. of ECMR

  33. Tomasi C, Manduchi R (1998) Bilateral filtering for gray and color images. In: Proc. ICCV

  34. Tong J, Zhou J, Liu L, Pan Z, Yan H (2012) Scanning 3d full human bodies using kinects. Vis Comput Grap IEEE Trans 18(4):643–650

    Article  Google Scholar 

  35. Torsello A, Rodolá E, Albarelli A (2011) Sampling relevant points for surface registration. In: Proc. of 3DIMPVT 2011

  36. Whelan T, Johannsson H, Kaess M, Leonard J, McDonald J (2012) Robust tracking for real-time dense RGB-D mapping with Kintinuous. Tech. rep., MIT

  37. Young MK, Theobalt C, Diebel J, Kosecka J, Miscusik B, Thrun S (2009) Multi-view image and tof sensor fusion for dense 3d reconstruction. In: Proc. of ICCV workshops 1542–1549

Download references

Acknowledgments

We would like to thank Luca Palmieri for his contributions to the color fusion algorithm. Thanks also to Fabio Dominio and Francesco Michielin for their help in the acquisition of the experimental results data.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Pietro Zanuttigh.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cappelletto, E., Zanuttigh, P. & Cortelazzo, G.M. 3D scanning of cultural heritage with consumer depth cameras. Multimed Tools Appl 75, 3631–3654 (2016). https://doi.org/10.1007/s11042-014-2065-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-014-2065-4

Keywords

Navigation