Skip to main content

Advertisement

Log in

A New Family of Distance Functions for Perceptual Similarity Retrieval of Medical Images

  • Published:
Journal of Digital Imaging Aims and scope Submit manuscript

Abstract

A long-standing challenge of content-based image retrieval (CBIR) systems is the definition of a suitable distance function to measure the similarity between images in an application context which complies with the human perception of similarity. In this paper, we present a new family of distance functions, called attribute concurrence influence distances (AID), which serve to retrieve images by similarity. These distances address an important aspect of the psychophysical notion of similarity in comparisons of images: the effect of concurrent variations in the values of different image attributes. The AID functions allow for comparisons of feature vectors by choosing one of two parameterized expressions: one targeting weak attribute concurrence influence and the other for strong concurrence influence. This paper presents the mathematical definition and implementation of the AID family for a two-dimensional feature space and its extension to any dimension. The composition of the AID family with L p distance family is considered to propose a procedure to determine the best distance for a specific application. Experimental results involving several sets of medical images demonstrate that, taking as reference the perception of the specialist in the field (radiologist), the AID functions perform better than the general distance functions commonly used in CBIR.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig 1
Fig 2
Fig 3
Fig 4
Fig 5
Fig 6
Fig 7
Fig 8
Fig 9
Fig 10
Fig 11
Fig 12
Fig 13
Fig 14
Fig 15
Fig 16
Fig 17

Similar content being viewed by others

References

  1. Lehmann TM, Güld MO, Thies C, Fischer B, Keysers D, Kohnen M, Shubert H, Wein BB: Content-based image retrieval in medical applications for picture archiving and communication systems. Proc SPIE 5033:109–117, 2003

    Article  Google Scholar 

  2. Zhang H, Su Z: Relevance feedback in CBIR. In: Zhou X, Pu P Eds. Visual and Multimedia Information Management. 1st edition. New York: Springer, 2002, pp 21–36

    Google Scholar 

  3. Mathews I, Baker S: Active appearance models revisited. Int J Comput Vis 60(2):135–164, 2004

    Article  Google Scholar 

  4. Bregler C, Malik J: Learning Appearance Based Models: Hierarchical Mixtures of Experts Approach Based on Generalized Second Moments. Technical Report No. UCB/CSD-96-897, EECS Department, University of California, Berkeley, 1996

  5. Cootes TF, Taylor CJ: Statistical models of appearance for medical image analysis and computer vision. Proc SPIE Medical Imaging 4322:238–248, 2001

    Google Scholar 

  6. Müller H, Michoux N, Bandon D, Geissbuhler A: A review of content-based image retrieval systems in medical applications—clinical benefits and future directions. Med Inform 73:1–23, 2004

    Article  Google Scholar 

  7. Doi K: Current status and future potential of computer-aided diagnosis in medical imaging. Br J Radiol 78:3–19, 2005

    Article  Google Scholar 

  8. Yin T-K, Chiu N-T: A computer-aided diagnosis for locating abnormalities in bone scintigraphy by a fuzzy system with a three-step minimization approach. IEEE Trans Med Imag 23(5):639–654, 2004

    Article  Google Scholar 

  9. Doi K: Diagnostic Imaging over the last 50 years: research and development in medical imaging science and technology. Phys Med Biol 51(13):5–27, 2006

    Article  Google Scholar 

  10. Giger ML, Karssemeijer N, Armato SG: Computer-aided diagnosis in medical imaging. IEEE Trans Med Imag 20(12):1205–1208, 2001

    Article  CAS  Google Scholar 

  11. Kinoshita SK, Marques PMA, Pereira Jr RR, Rodrigues JAH, Rangayyan RM: Content-based retrieval of mammograms using visual features related to breast density patterns. J Digit Imaging 20(2):172–190, 2007

    Article  PubMed  Google Scholar 

  12. Antani SK, Natarajan M, Long JL, Long LR, Thoma GR: Developing a comprehensive system for content-based image retrieval of image and text from a national survey. SPIE Med Imaging 5748:152–161, 2005

    Google Scholar 

  13. Inoue M, Ueda N: Retrieving lightly annotated images using image similarities. Proceedings of the ACM Symposium on Applied Computing—SAC, Santa Fé, USA, 2005, pp 1031–1037

  14. Bueno JM, Chino F, Traina AJM, Traina Jr C, Marques PMA: How to add content-based image retrieval capability in a PACS. Proceedings of the IEEE International Conference on Computer Based Medical Systems—CBMS, Maribor, Slovenia, 2002, pp 321–326

  15. Antani SK, Long LR, Thoma GR: Content-based image retrieval for large biomedical image archives. Proceedings of the 11th World Congress on Medical Informatics (MEDINFO), San Francisco, USA, 2004, pp 829–833

  16. Lee CS, Tschai HJ, Kuo YH, Ko WT, Cheng YH, Wang CC: PACS: construction and application to medical image enhancement. Proceedings of the Third International Conference on Knowledge-Based Intelligent Information Engineering Systems, 1999, pp 246–249

  17. Kak A, Pavlopoulou C: Content-based image retrieval from large medical databases. Proceedings of the First International Symposium on 3D Data Processing Visualization and Transmission, Padova, Italy, 2002, pp 138–147

  18. Lehmann TM, Wein BB, Greenspan H: Integration of content-based image retrieval to picture archiving and communication systems. Proceedings of the Med Inf Europe (MIE), St Malo, France, CD-ROM, 2003

  19. Traina Jr C, Traina AJM, Seeger B, Faloutsos C: Slim-trees: high performance metric trees minimizing overlap between nodes. Proceedings of the International Conference on Extending Database Technology, Konstanz, Germany, 2000, pp 51–65

  20. Chávez E, Navarro G, Baeza-Yates R, Marroquin JL: Searching in metric spaces. ACM Comp Surv 33(3):273–321, 2001

    Article  Google Scholar 

  21. Santini S, Jain R: Similarity measures. IEEE Trans Pattern Anal Machine Intell 21(9):871–883, 1999

    Article  Google Scholar 

  22. Rubner Y, Tomasi C: Perceptual metrics for image database navigation. Boston, USA: Kluwer, 2001

    Google Scholar 

  23. Hiransakolwong N, Hua K A, Koompairojn S, Vu K, Lang SD: An adaptive distance computation technique for image retrieval systems. Proceedings of the ACM Symposium on Applied Computing (SAC), Santa Fe, USA, 2005, pp 1195–1199

  24. Vasconcelos N: On the efficient evaluation of probabilistic similarity functions for image retrieval. IEEE Trans Inf Theory 50(7):1482–1496, 2004

    Article  Google Scholar 

  25. Akleman E, Chen J: Generalized distance functions. Proceedings of the International Conference on Shape Modeling and Applications, Aizuwakamatsu, Japan, 1999

  26. Aggarwal CC, Hinneburg A, Keim DA: On the surprising behavior of distance metrics in high dimensional spaces. Proceedings of the 8th International Conference on Database Theory (ICDT), London, England, 2001, pp 420–434

  27. Theodoridis S, Koutroumbas K: Pattern Recognition. New York: Academic, 1999

    Google Scholar 

  28. Gibbs AL, Su FE: On choosing and bounding probability metrics. Int Stat Rev 70(3):419–435, 2002

    Article  Google Scholar 

  29. Zhang DS, Lu G: Evaluation of similarity measurement for image retrieval. Proceedings of the IEEE International Conference on Neural Networks & Signal Processing, Nanjing, China, 2003, pp 928–931

  30. Wilson DR, Martinez TR: Improved heterogeneous distance functions. J Artificial Intelligence Res 6:1–34, 1997

    Google Scholar 

  31. Tversky A: Features of similarity. Psychol Rev 84(4):327–352, 1977

    Article  Google Scholar 

  32. Tversky A, Gati I: Similarity, separability and the triangle inequality. Psychol Rev 89(1):123–154, 1982

    Article  PubMed  CAS  Google Scholar 

  33. Chang EY, Li B, Li C: Toward preception-based image retrieval. Proceedings of the IEEE Workshop on Content-Based Access of Image and Video Libraries, Hilton Head, USA, 2000, pp 101–105

  34. Vasconcelos N, Lippman A: A unifying view of image similarity. Proceedings of the International Conference on Pattern Recognition (ICPR), 2000

  35. Felipe JC: Development of methods for extraction, comparison and analysis of intrinsic features of medical images, aiming at content-based perceptual retrieval. Ph.D. Thesis, Department of Computer Sciences—ICMC, University of São Paulo at São Carlos, Brazil, 163 p (in Portuguese), 2005

  36. Haralick RM, Shanmugan K, Dinstein I: Textural features for image classification. IEEE Trans Syst Man Cybernet 3(6):610–621, 1973

    Article  Google Scholar 

  37. Baeza-Yates R, Ribeiro-Neto B: Modern Information Retrieval. New York: ACM Press, 1999

    Google Scholar 

  38. Balan AGR, Traina AJM, Traina Jr C: Fractal analysis of image textures for indexing and retrieval by content. Proceedings of the 18th IEEE Symposium on Computer-Based Medical Systems (CBMS), Dublin, Ireland, 2005, pp 581–586

  39. Felipe JC, Traina AJM, Traina Jr C: Retrieval by content of medical images using texture for tissue identification. Proceedings of the 16th IEEE Symposium on Computer-Based Medical Systems (CBMS), New York, 2003, pp 175–180

Download references

Acknowledgments

The authors are grateful to the radiologists from HC-FMRP, Ribeirão Preto, Brazil who participated in the experimental studies and the researchers from the CCIFM-FMRP who provided the images for the experiments. This research has been supported, in part, by the Brazilian National Research Council (CNPq) under grants 52.1685/98-6, 860.068/00-7 and 35.0852/94-4 and by the Sao Paulo State Research Foundation (FAPESP) under grant 04/02215-5.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Joaquim Cezar Felipe.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Felipe, J.C., Traina, C. & Traina, A.J.M. A New Family of Distance Functions for Perceptual Similarity Retrieval of Medical Images. J Digit Imaging 22, 183–201 (2009). https://doi.org/10.1007/s10278-007-9084-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10278-007-9084-x

Key words

Navigation