Dan Raviv
ABSTRACT
Invariant shape descriptors are instrumental in numerous shape analysis tasks including deformable shape comparison, registration, classification, and retrieval. Most existing constructions model a 3D shape as a two-dimensional surface describing the shape boundary, typically represented as a triangular mesh or a point cloud. Using intrinsic properties of the surface, invariant descriptors can be designed. One such example is the recently introduced heat kernel signature, based on the Laplace-Beltrami operator of the surface. In many applications, however, a volumetric shape model is more natural and convenient. Moreover, modeling shape deformations as approximate isometries of the volume of an object, rather than its boundary, better captures natural behavior of non-rigid deformations in many cases. Here, we extend the idea of heat kernel signature to robust isometry-invariant volumetric descriptors, and show their utility in shape retrieval. The proposed approach achieves state-of-the-art results on the SHREC 2010 large-scale shape retrieval benchmark.
- S. Belongie, J. Malik, and J. Puzicha. Shape matching and object recognition using shape contexts. Trans. PAMI, pages 509--522, 2002. Google Scholar
Digital Library
- M. Ben-Chen, O. Weber, and C. Gotsman. Characterizing shape using conformal factors. In Proc. 3DOR, 2008. Google ScholarDigital Library
- P. Bérard, G. Besson, and S. Gallot. Embedding riemannian manifolds by their heat kernel. Geometric and Functional Analysis, 4(4):373--398, 1994.Google ScholarCross Ref
- S. Biasotti, S. Marini, M. Mortara, and G. Patané. An overview on properties and efficacy of topological skeletons in shape modeling. In Proc. SMI, pages 245--254, 2003. Google ScholarDigital Library
- A. M. Bronstein, M. M. Bronstein, A. M. Bruckstein, and R. Kimmel. Analysis of two-dimensional non-rigid shapes. IJCV, 78(1):67--88, 2008. Google ScholarDigital Library
- A. M. Bronstein, M. M. Bronstein, U. Castellani, B. Falcidieno, A. Fusiello, A. Godil, L. J. Guibas, I. Kokkinos, Z. Lian, M. Ovsjanikov, G. Patané, M. Spagnuolo, and R. Toldo. Shrec 2010: robust large-scale shape retrieval benchmark. In Proc. 3DOR, 2010.Google Scholar
- A. M. Bronstein, M. M. Bronstein, and R. Kimmel. Generalized multidimensional scaling: a framework for isometry-invariant partial surface matching. PNAS, 103(5):1168--1172, 2006.Google ScholarCross Ref
- A. M. Bronstein, M. M. Bronstein, and R. Kimmel. Numerical geometry of non-rigid shapes. Springer-Verlag New York Inc, 2008. Google ScholarDigital Library
- A. M. Bronstein, M. M. Bronstein, M. Ovsjanikov, and L. J. Guibas. Shape google: a computer vision approach to invariant shape retrieval. In Proc. NORDIA, 2009.Google Scholar
- M. M. Bronstein and I. Kokkinos. Scale-invariant heat kernel signatures for non-rigid shape recognition. In Proc. CVPR, 2010.Google ScholarCross Ref
- U. Clarenz, M. Rumpf, and A. Telea. Robust feature detection and local classification for surfaces based on moment analysis. Trans. Visualization and Computer Graphics, 10(5):516--524, 2004. Google ScholarDigital Library
- A. Dubrovina and R. Kimmel. Matching shapes by eigendecomposition of the Laplace-Beltrami operator. In Proc. 3DPVT, 2010.Google Scholar
- A. Elad and R. Kimmel. Bending invariant representations for surfaces. In Proc. CVPR, pages 168--174, 2001.Google ScholarCross Ref
- R. Gal, A. Shamir, and D. Cohen-Or. Pose-oblivious shape signature. Trans. Visualization and Computer Graphics, 13(2):261--271, 2007. Google ScholarDigital Library
- N. Gelfand, N. J. Mitra, L. J. Guibas, and H. Pottmann. Robust global registration. In Proc. SGP, 2005. Google ScholarDigital Library
- M. Hilaga, Y. Shinagawa, T. Kohmura, and T. Kunii. Topology matching for fully automatic similarity estimation of 3D shapes. In Proc. Computer Graphics and Interactive Techniques, pages 203--212, 2001. Google ScholarDigital Library
- A. Ion, G. Peyré, Y. Haxhimusa, S. Peltier, W. G. Kropatsch, and L. Cohen. Shape matching using the geodesic eccentricity transform--a study. In Proc. Workshop of the Austrian Association for Pattern Recognition (OAGM/AAPR), 2007.Google Scholar
- P. W. Jones, M. Maggioni, and R. Schul. Manifold parametrizations by eigenfunctions of the Laplacian and heat kernels. PNAS, 105(6):1803, 2008.Google ScholarCross Ref
- M. Kazhdan, T. Funkhouser, and S. Rusinkiewicz. Rotation invariant spherical harmonic representation of 3D shape descriptors. In Proc. SGP, pages 156--164, 2003. Google ScholarDigital Library
- M. Kazhdan, T. Funkhouser, and S. Rusinkiewicz. Symmetry descriptors and 3D shape matching. In Proc. SGP, pages 115--123, 2004. Google ScholarDigital Library
- H. Ling and D. W. Jacobs. Shape classification using the inner-distance. Trans. PAMI, 29(2):286--299, 2007. Google ScholarDigital Library
- D. Lowe. Distinctive image features from scale-invariant keypoint. IJCV, 2004. Google ScholarDigital Library
- F. Mémoli and G. Sapiro. A theoretical and computational framework for isometry invariant recognition of point cloud data. Foundations of Computational Mathematics, 5:313--346, 2005. Google ScholarDigital Library
- N. J. Mitra, L. J. Guibas, J. Giesen, and M. Pauly. Probabilistic fingerprints for shapes. In Proc. SGP, 2006. Google ScholarDigital Library
- M. Novotni and R. Klein. 3D Zernike descriptors for content based shape retrieval. In Proc. ACM Symp. Solid Modeling and Applications, pages 216--225, 2003. Google ScholarDigital Library
- R. Osada, T. Funkhouser, B. Chazelle, and D. Dobkin. Shape distributions. TOG, 21(4):807--832, 2002. Google ScholarDigital Library
- E. Paquet, M. Rioux, A. Murching, T. Naveen, and A. Tabatabai. Description of shape information for 2-D and 3-D objects. Signal Processing: Image Communication, 16(1--2):103--122, 2000.Google Scholar
- D. Raviv, A. M. Bronstein, M. M. Bronstein, and R. Kimmel. Symmetries of non-rigid shapes. In Proc. NRTL, 2007.Google ScholarCross Ref
- M. Reuter, F.-E. Wolter, and N. Peinecke. Laplace-spectra as fingerprints for shape matching. In Proc. ACM Symp. Solid and Physical Modeling, pages 101--106, 2005. Google ScholarDigital Library
- R. Rustamov. Robust volumetric shape descriptor. In Proc. 3DOR, 2010. Google ScholarDigital Library
- R. M. Rustamov. Laplace-Beltrami eigenfunctions for deformation invariant shape representation. In Proc. SGP, pages 225--233, 2007. Google ScholarDigital Library
- P. Shilane and T. Funkhauser. Selecting distinctive 3D shape descriptors for similarity retrieval. In Proc. Shape Modelling and Applications, 2006. Google ScholarDigital Library
- P. Shilane, P. Min, M. Kazhdan, and T. Funkhouser. The Princeton shape benchmark. In Proc. SMI, pages 167--178, 2004. Google ScholarDigital Library
- J. Sivic and A. Zisserman. Video google: A text retrieval approach to object matching in videos. In Proc. CVPR, 2003.Google ScholarCross Ref
- R. Sumner and J. Popović. Deformation transfer for triangle meshes. In Proc. Conf. Computer Graphics and Interactive Techniques, pages 399--405, 2004. Google ScholarDigital Library
- J. Sun, M. Ovsjanikov, and L. J. Guibas. A concise and provably informative multi-scale signature based on heat diffusion. In Proc. SGP, 2009. Google ScholarDigital Library
- H. Sundar, D. Silver, N. Gagvani, and S. Dickinson. Skeleton based shape matching and retrieval. In Proc. SMI, volume 130, 2003. Google ScholarDigital Library
- A. Tal, M. Elad, and S. Ar. Content based retrieval of VRML objects - an iterative and interactive approach. In Proc. Eurographics Workshop on Multimedia, 2001. Google ScholarDigital Library
- N. Thorstensen and R. Keriven. Non-rigid shape matching using geometry and photometry. In Proc. CVPR, 2009.Google Scholar
- R. Toldo, U. Castellani, and A. Fusiello. Visual vocabulary signature for 3D object retrieval and partial matching. In Proc. 3DOR, 2009. Google ScholarDigital Library
- A. Zaharescu, E. Boyer, K. Varanasi, and R. Horaud. Surface feature detection and description with applications to mesh matching. In Proc. CVPR, 2009.Google ScholarCross Ref
- C. Zhang and T. Chen. Efficient feature extraction for 2D/3D objects in meshrepresentation. In Proc. ICIP, volume 3, 2001.Google ScholarCross Ref
Index Terms
- Volumetric heat kernel signatures
Recommendations
Interpolated eigenfunctions for volumetric shape processing
Special Issue on 3DOR 2010This paper introduces a set of volumetric functions suitable for geometric processing of volumes. We start with Laplace–Beltrami eigenfunctions on the bounding surface and interpolate them into the interior using barycentric coordinates. The ...
Novel correspondence-based approach for consistent human skeleton extraction
This paper presents a novel base-points-driven shape correspondence (BSC) approach to extract skeletons of articulated objects from 3D mesh shapes. The skeleton extraction based on BSC approach is more accurate than the traditional direct skeleton ...
Progressive Shape-Distribution-Encoder for 3D Shape Retrieval
MM '15: Proceedings of the 23rd ACM international conference on MultimediaIn this paper, we propose a deep shape descriptor by learning the shape distributions at different diffusion time via a progressive deep shape-distribution-encoder. First, we develop a shape distribution representation with the kernel density estimator ...
Comments