Skip to main content
SpringerLink
Log in

Thesaurus-based 3D Object Retrieval with Part-in-Whole Matching

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

Research in content-based 3D retrieval has already started, and several approaches have been proposed which use in different manner a similarity assessment to match the shape of the query against the shape of the objects in the database. However, the success of these solutions are far from the success obtained by their textual counterparts.

A major drawback of most existing 3D retrieval solutions is their inability to support partial queries, that is, a query which does not need to be formulated by specifying a whole query shape, but just a part of it, for example a detail of its overall shape, just like documents are retrieved by specifying words and not whole texts. Recently, researchers have focused their investigation on 3D retrieval which is solved by partial shape matching. However, at the extent of our knowledge, there is still no 3D search engine that provides an indexing of the 3D models based on all the interesting subparts of the models.

In this paper we present a novel approach to 3D shape retrieval that uses a collection-aware shape decomposition combined with a shape thesaurus and inverted indexes to describe and retrieve 3D models using part-in-whole matching. The proposed method clusters similar segments obtained trough a multilevel decomposition of models, constructing from such partition the shape thesaurus. Then, to retrieve a model containing a sub-part similar to a given query, instead of looking on a large set of subparts or executing partial matching between the query and all models in the collection, we just perform a fast global matching between the query and the few entries in the thesaurus. With this technique we overcame the time complexity problems associated with partial queries in large collections.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Agathos, A., Pratikakis, I., Perantonis, S., Sapidis, N., & Azariadis, P. (2007). 3D mesh segmentation methodologies for cad applications. Computer-Aided Design and Applications, 4(6), 827–841.

    Google Scholar 

  • Anderberg, M. R. (1973). Cluster analysis for applications. San Diego: Academic Press.

    MATH  Google Scholar 

  • Ansary, T. F., Daoudi, M., & Vandeborre, J. P. (2007a). A Bayesian 3D search engine using adaptive views clustering. IEEE Transactions on Multimedia, 9(1), 78–88.

    Article  Google Scholar 

  • Ansary, T. F., Daoudi, M., & Vandeborre, J. P. (2007b). 3d-models search engine from photos. In Proceedings of ACM international conference on image and video retrieval (CIVR 2007). Amsterdam, The Netherlands.

  • Assfalg, J., Bimbo, A. D., & Pala, P. (2006). Content-based retrieval of 3d models through curvature maps: a cbr approach exploiting media conversion. Multimedia Tools and Applications, 31(1), 29–50.

    Article  Google Scholar 

  • Attene, M. (2006). ‘efpisoft’. http://efpisoft.sourceforge.net/

  • Attene, M., Falcidieno, B., & Spagnuolo, M. (2006a). Hierarchical mesh segmentation based on fitting primitives. Visual Computer, 22(3), 181–193.

    Article  Google Scholar 

  • Attene, M., Biasotti, S., Mortara, M., Patanè, G., Spagnuolo, M., & Falcidieno, B. (2006b). Computational methods for understanding 3d shapes. Computers & Graphics, 30(3), 323–333 doi:10.1016/j.cag.2006.02.007.

    Article  Google Scholar 

  • Baeza-Yates, R. A., & Ribeiro-Neto, B. (1999). Modern Information Retrieval. Reading: Addison-Wesley.

    Google Scholar 

  • Bentley, J. L. (1975). Multidimensional binary search trees used for associative searching. Communications of the ACM, 18(9), 509–517.

    Article  MATH  MathSciNet  Google Scholar 

  • Bespalov, D., Shokoufandeh, A., Regli, W. C., & Sun, W. (2003). Scale-space representation of 3d models and topological matching. In Proceedings of the 8th ACM symposium on solid modeling and applications (pp. 208–215). New York: ACM Press.

    Chapter  Google Scholar 

  • Biasotti, S., Marini, S., Spagnuolo, M., & Falcidieno, B. (2006). Sub-part correspondence by structural descriptors of 3d shapes. Computer-Aided Design, 38(9), 1002–1019.

    Article  Google Scholar 

  • Brin, S., & Page, L. (1998). The anatomy of a large-scale hypertextual web search engine. Computer Networks ISDN Systems, 30(1–7), 107–117.

    Article  Google Scholar 

  • Bustos, B., Keim, D. A., Saupe, D., Schreck, T., & Vranić, D. V. (2005). Feature-based similarity search in 3d object databases. ACM Computing Surveys, 37(4), 345–387.

    Article  Google Scholar 

  • Campbell, R. J., & Flynn, P. J. (2001). A survey of free-form object representation and recognition techniques. Computer Vision and Image Understanding, 81(2), 166–210.

    Article  MATH  Google Scholar 

  • Chen, D. Y., Tian, X. P., Shen, Y. T., & Ouhyoung, M. (2003). On visual similarity based 3d model retrieval. Computer Graphics Forum, 22(3), 223–232.

    Article  Google Scholar 

  • Cormack, G. V., Palmer, C. R., & Clarke, C. L. A. (1998). Efficient construction of large test collections. In SIGIR’98: proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval (pp. 282–289). New York: ACM. http://doi.acm.org/10.1145/290941.291009

    Chapter  Google Scholar 

  • Cornea, N. D., Demirci, M. F., Silver, D., Shokoufandeh, A., Dickinson, S. J., & Kantor, P. B. (2005). 3d object retrieval using many-to-many matching of curve skeletons. In SMI’05: proceedings of the international conference on shape modeling and applications 2005 (pp. 368–373). Los Alamitos: IEEE Computer Society.

    Google Scholar 

  • Crouch, C. J. (1988). A cluster-based approach to thesaurus construction. In SIGIR’88: proceedings of the 11th annual international ACM SIGIR conference on research and development in information retrieval (pp. 309–320). New York: ACM. http://doi.acm.org/10.1145/62437.62467.

    Chapter  Google Scholar 

  • Curran, J. R., & Moens, M. (2002). Improvements in automatic thesaurus extraction. In Proceedings of the ACL-02 workshop on unsupervised lexical acquisition (pp. 59–66). Morristown: Association for Computational Linguistics. doi:10.3115/1118627.1118635.

    Chapter  Google Scholar 

  • Fonseca, M. J., & Jorge, J. A. (2003). Indexing high-dimensional data for content-based retrieval in large databases. In Proceedings of the 8th international conference on database systems for advanced applications (DASFAA’03) (pp. 267–274). Los Alamitos: IEEE Computer Society.

    Google Scholar 

  • Funkhouser, T., Min, P., Kazhdan, M., Chen, J., Halderman, A., Dobkin, D., & Jacobs, D. (2003). A search engine for 3d models. ACM Transactions on Graphics, 22(1), 83–105.

    Article  Google Scholar 

  • Funkhouser, T., Kazhdan, M., Shilane, P., Min, P., Kiefer, W., Tal, A., Rusinkiewicz, S., & Dobkin, D. (2004). Modeling by example. ACM Transactions on Graphics, 23(3), 652–663. http://doi.acm.org/10.1145/1015706.1015775.

    Article  Google Scholar 

  • Funkhouser, T., Kazhdan, M., Min, P., & Shilane, P. (2005). Shape-based retrieval and analysis of 3d models. Communications of the ACM, 48(6), 58–64.

    Article  Google Scholar 

  • Gal, R., & Cohen-Or, D. (2006). Salient geometric features for partial shape matching and similarity. ACM Transactions on Graphics, 25(1), 130–150.

    Article  Google Scholar 

  • Jayanti, S., Kalyanaraman, Y., Iyer, N., & Ramani, K. (2006). Developing an engineering shape benchmark for cad models. Computer-Aided Design, 39(9), 939–953.

    Article  Google Scholar 

  • Johnson, A. E., & Hebert, M. (1997). Recognizing objects by matching oriented points. In Proceedings of the 1997 conference on computer vision and pattern recognition (CVPR’97) (p. 684). Los Alamitos: IEEE Computer Society.

    Chapter  Google Scholar 

  • Joyce, T., & Needham, R. M. (1997). The thesaurus approach to information retrieval. Readings in information retrieval, pp. 15–20.

  • Kanungo, T., Mount, D. M., Netanyahu, N. S., Piatko, C. D., Silverman, R., & Wu, A. Y. (2002). An efficient k-means clustering algorithm: Analysis and implementation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(7), 881–892.

    Article  Google Scholar 

  • Kazhdan, M. (2004). Shape representation and algorithms for 3d model retrieval. Ph.D. thesis, Princeton University.

  • Kazhdan, M., Funkhouser, T., & Rusinkiewicz, S. (2003). Rotation invariant spherical harmonic representation of 3d shape descriptors. In L. Kobbelt, P. Schroder, & H. Hoppe (Eds.), Proceedings of the 2003 eurographics/ACM SIGGRAPH symposium on geometry processing (pp. 156–164). Aire-la-Ville: Eurographics Association.

    Google Scholar 

  • Kogan, J. (2007). Introduction to clustering large and high-dimensional data. Cambridge: Cambridge University Press.

    MATH  Google Scholar 

  • Lloyd, S. P. (1982). Least squares quantization in pcm. IEEE Transactions on Information Theory, 28(2), 129–137.

    Article  MATH  MathSciNet  Google Scholar 

  • Lou, K., Prabhakar, S., & Ramani, K. (2004). Content-based three-dimensional engineering shape search. International conference on data engineering, p. 754.

  • Lv, Q., Josephson, W., Wang, Z., Charikar, M., & Li, K. (2006). Ferret: a toolkit for content-based similarity search of feature-rich data. SIGOPS Operating Systems Review, 40(4), 317–330.

    Article  Google Scholar 

  • Milne, D. N., Witten, I. H., & Nichols, D. M. (2007). A knowledge-based search engine powered by wikipedia. In CIKM’07: proceedings of the sixteenth ACM conference on conference on information and knowledge management (pp. 445–454). New York: ACM. http://doi.acm.org/10.1145/1321440.1321504.

    Chapter  Google Scholar 

  • Paquet, E., & Rioux, M. (1997). Nefertiti: A query by content software for three-dimensional models databases management. 3dim, p. 345.

  • Ruge, G. (1997). Automatic detection of thesaurus relations for information retrieval applications. In Foundations of computer science: potential–theory–cognition (pp. 499–506). London: Springer. To Wilfried Brauer on the occasion of his sixtieth birthday.

    Chapter  Google Scholar 

  • Ruiz-Correa, S., Shapiro, L. G., & Meila, M. (2003). A new paradigm for recognizing 3-d object shapes from range data. In ICCV’03: proceedings of the ninth IEEE international conference on computer vision (p. 1126). Los Alamitos: IEEE Computer Society.

    Chapter  Google Scholar 

  • Shilane, P., & Funkhouser, T. (2007). Distinctive regions of 3d surfaces. ACM Transactions on Graphics, 26(2), 7.

    Article  Google Scholar 

  • Silverstein, C., Marais, H., Henzinger, M., & Moricz, M. (1999). Analysis of a very large web search engine query log. SIGIR Forum, 33(1), 6–12.

    Article  Google Scholar 

  • Suzuki, M. T., Kato, T., & Otsu, N. (2000). A similarity retrieval of 3d polygonal models using rotation invariant shape descriptors. In Proceedings of IEEE international conference on systems, man and cybernetics (Vol. 4, pp. 2946–2952). Los Alamitos: IEEE Computer Society.

    Google Scholar 

  • Suzuki, M. T., Yaginuma, Y., & Sugimoto, Y. Y. (2003). A 3d model retrieval system for cellular phones. In Proceedings of IEEE international conference on systems, man and cybernetics (Vol. 4, pp. 3846–3851). Los Alamitos: IEEE Computer Society.

    Google Scholar 

  • Suzuki, M. T., Yaginuma, Y., Yamada, T., & Shimizu, Y. (2005a). A partial shape matching method for 3d model databases. In Proceedings of the ninth IASTED international conference on software engineering and applications (SEA2005) (pp. 389–394). Calgary: ACTA Press.

    Google Scholar 

  • Suzuki, M. T., Yaginuma, Y., & Shimizu, Y. (2005b). A partial shape matching technique for 3d model retrieval systems. In ACM SIGGRAPH 2005 posters (p. 128). New York: ACM Press.

    Chapter  Google Scholar 

  • Tierny, J., Vandeborre, J. P., & Daoudi, M. (2009). Partial 3d shape retrieval by reeb pattern unfolding. Computer Graphics Forum, 28, 41–55.

    Article  Google Scholar 

  • Vranić, D. V. (2004). 3d model retrieval. Ph.D. thesis, University of Leipzig, Germany.

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, INESC-ID/IST/Technical University of Lisbon, Lisbon, Portugal

    Alfredo Ferreira, Manuel J. Fonseca & Joaquim A. Jorge

  2. Instituto di Matematica Applicata e Tecnologie Informatiche, Consiglio Nazionale delle Ricerche, Genova, Italy

    Simone Marini, Marco Attene, Michela Spagnuolo & Bianca Falcidieno

Authors
  1. Alfredo Ferreira
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Simone Marini
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Marco Attene
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Manuel J. Fonseca
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Michela Spagnuolo
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Joaquim A. Jorge
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Bianca Falcidieno
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Alfredo Ferreira.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ferreira, A., Marini, S., Attene, M. et al. Thesaurus-based 3D Object Retrieval with Part-in-Whole Matching. Int J Comput Vis 89, 327–347 (2010). https://doi.org/10.1007/s11263-009-0257-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11263-009-0257-6

Keywords

Search

Navigation