skip to main content
10.1145/2072545.2072547acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Hierarchical spatial matching for medical image retrieval

Published:29 November 2011Publication History

ABSTRACT

Content-based medical image retrieval is likely becoming an important tool to provide valuable information to assist physician to make critical diagnosis decisions. While most existing works perform the retrieval based on low-level visual features, the pathological spatial context, which is critical for analysis of the disease characteristics, has been less studied. We thus aim to effectively extract and represent the spatial context of pathological tissues, and design a novel hierarchical spatial matching (HSM) method based on the spatial pyramid matching. Our method is able to (1) handle the translation variations of the main pathological object; (2) describe the spatial information surrounding the pathological object in an adaptive scale; and (3) compute image similarities with an optimally weighted distance function. The proposed method shows better retrieval performance comparing to the other widely used techniques.

References

  1. U. Avni, H. Greenspan, M. Sharon, E. Konen, and J. Goldberger. X-ray image categorization and retrieval using patch-based visual words representation. ISBI, pages 350--353, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. P. Bugatti, M. Silva, A. Traina, C. Traina, and P. Marques. Content-based retrieval of medical images: from context to perception. CBMS, pages 1--8, 2009.Google ScholarGoogle ScholarCross RefCross Ref
  3. J. Feulner, S. Zhou, E. Angelopoulou, S. Seifert, A. Cavallaro, J. Hornegger, and D. Comaniciu. Comparing axial CT slices in quantized N-dimensional SURF descriptor space to estimate the visible body region. Comput Med Imaging Graph, 35(3):227--236, 2011.Google ScholarGoogle ScholarCross RefCross Ref
  4. B. Fischer, A. Brosig, P. Welter, C. Grouls, R. Gunther, and T. Deserno. Content-based image retrieval applied to bone age assessment. SPIE, page 762412, 2010.Google ScholarGoogle Scholar
  5. A. Frome, Y. Singer, F. Sha, and J. Malik. Learning globally-consistent local distance functions for shape-based image retrieval and classification. ICCV, pages 1--8, 2007.Google ScholarGoogle ScholarCross RefCross Ref
  6. T. Harada, H. Nakayama, and Y. Kuniyoshi. Improving local descriptors by embedding global and local spatial information. ECCV, pages 736--749, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. S. Lazebnik, C. Schmid, and J. Ponce. Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. CVPR, pages 2169--2178, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. D. Lowe. Distinctive image features from scale-invariant keypoints. IJCV, 60(2):91--110, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. H. Muller, N. Michoux, D. Bandon, and A. Geissbuhler. A review of content-based image retrieval systems in medical applications - clinical benefits and future directions. Int J Med Inform, 73:1--23, 2004.Google ScholarGoogle ScholarCross RefCross Ref
  10. M. Rahman, S. Antani, and G. Thoma. A medical image retrieval framework in correlation enhanced visual concept feature space. CBMS, pages 1--4, 2009.Google ScholarGoogle ScholarCross RefCross Ref
  11. Y. Song, W. Cai, S. Eberl, M. Fulham, and D. Feng. Thoracic image case retrieval with spatial and contextual information. ISBI, pages 1885--1888, 2011.Google ScholarGoogle ScholarCross RefCross Ref
  12. L. Sorensen, M. Loog, P. Lo, H. Ashraf, A. Dirksen, R. Duin, and M. Bruijne. Image dissimilarity-based quantification of lung disease from CT. MICCAI, pages 37--44, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. D. Unay, A. Ekin, and R. Jasinschi. Local structure-based region-of-interest retrieval in brain MR images. IEEE Trans. Inf. Technol. Biomed., 14(4):897--903, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. H. Zaidi and I. Naqa. PET-guided delineation of radiation therapy treatment volumes: a survey of image segmentation techniques. Eur J Nucl Med Mol Imaging, 37:2165--2187, 2010.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Hierarchical spatial matching for medical image retrieval

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      MMAR '11: Proceedings of the 2011 international ACM workshop on Medical multimedia analysis and retrieval
      November 2011
      70 pages
      ISBN:9781450309912
      DOI:10.1145/2072545

      Copyright © 2011 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 29 November 2011

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Upcoming Conference

      MM '24
      MM '24: The 32nd ACM International Conference on Multimedia
      October 28 - November 1, 2024
      Melbourne , VIC , Australia

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader