Abstract
A long-standing challenge of content-based image retrieval (CBIR) systems is the definition of a suitable distance function to measure the similarity between images in an application context which complies with the human perception of similarity. In this paper, we present a new family of distance functions, called attribute concurrence influence distances (AID), which serve to retrieve images by similarity. These distances address an important aspect of the psychophysical notion of similarity in comparisons of images: the effect of concurrent variations in the values of different image attributes. The AID functions allow for comparisons of feature vectors by choosing one of two parameterized expressions: one targeting weak attribute concurrence influence and the other for strong concurrence influence. This paper presents the mathematical definition and implementation of the AID family for a two-dimensional feature space and its extension to any dimension. The composition of the AID family with L p distance family is considered to propose a procedure to determine the best distance for a specific application. Experimental results involving several sets of medical images demonstrate that, taking as reference the perception of the specialist in the field (radiologist), the AID functions perform better than the general distance functions commonly used in CBIR.
Similar content being viewed by others
References
Lehmann TM, Güld MO, Thies C, Fischer B, Keysers D, Kohnen M, Shubert H, Wein BB: Content-based image retrieval in medical applications for picture archiving and communication systems. Proc SPIE 5033:109–117, 2003
Zhang H, Su Z: Relevance feedback in CBIR. In: Zhou X, Pu P Eds. Visual and Multimedia Information Management. 1st edition. New York: Springer, 2002, pp 21–36
Mathews I, Baker S: Active appearance models revisited. Int J Comput Vis 60(2):135–164, 2004
Bregler C, Malik J: Learning Appearance Based Models: Hierarchical Mixtures of Experts Approach Based on Generalized Second Moments. Technical Report No. UCB/CSD-96-897, EECS Department, University of California, Berkeley, 1996
Cootes TF, Taylor CJ: Statistical models of appearance for medical image analysis and computer vision. Proc SPIE Medical Imaging 4322:238–248, 2001
Müller H, Michoux N, Bandon D, Geissbuhler A: A review of content-based image retrieval systems in medical applications—clinical benefits and future directions. Med Inform 73:1–23, 2004
Doi K: Current status and future potential of computer-aided diagnosis in medical imaging. Br J Radiol 78:3–19, 2005
Yin T-K, Chiu N-T: A computer-aided diagnosis for locating abnormalities in bone scintigraphy by a fuzzy system with a three-step minimization approach. IEEE Trans Med Imag 23(5):639–654, 2004
Doi K: Diagnostic Imaging over the last 50 years: research and development in medical imaging science and technology. Phys Med Biol 51(13):5–27, 2006
Giger ML, Karssemeijer N, Armato SG: Computer-aided diagnosis in medical imaging. IEEE Trans Med Imag 20(12):1205–1208, 2001
Kinoshita SK, Marques PMA, Pereira Jr RR, Rodrigues JAH, Rangayyan RM: Content-based retrieval of mammograms using visual features related to breast density patterns. J Digit Imaging 20(2):172–190, 2007
Antani SK, Natarajan M, Long JL, Long LR, Thoma GR: Developing a comprehensive system for content-based image retrieval of image and text from a national survey. SPIE Med Imaging 5748:152–161, 2005
Inoue M, Ueda N: Retrieving lightly annotated images using image similarities. Proceedings of the ACM Symposium on Applied Computing—SAC, Santa Fé, USA, 2005, pp 1031–1037
Bueno JM, Chino F, Traina AJM, Traina Jr C, Marques PMA: How to add content-based image retrieval capability in a PACS. Proceedings of the IEEE International Conference on Computer Based Medical Systems—CBMS, Maribor, Slovenia, 2002, pp 321–326
Antani SK, Long LR, Thoma GR: Content-based image retrieval for large biomedical image archives. Proceedings of the 11th World Congress on Medical Informatics (MEDINFO), San Francisco, USA, 2004, pp 829–833
Lee CS, Tschai HJ, Kuo YH, Ko WT, Cheng YH, Wang CC: PACS: construction and application to medical image enhancement. Proceedings of the Third International Conference on Knowledge-Based Intelligent Information Engineering Systems, 1999, pp 246–249
Kak A, Pavlopoulou C: Content-based image retrieval from large medical databases. Proceedings of the First International Symposium on 3D Data Processing Visualization and Transmission, Padova, Italy, 2002, pp 138–147
Lehmann TM, Wein BB, Greenspan H: Integration of content-based image retrieval to picture archiving and communication systems. Proceedings of the Med Inf Europe (MIE), St Malo, France, CD-ROM, 2003
Traina Jr C, Traina AJM, Seeger B, Faloutsos C: Slim-trees: high performance metric trees minimizing overlap between nodes. Proceedings of the International Conference on Extending Database Technology, Konstanz, Germany, 2000, pp 51–65
Chávez E, Navarro G, Baeza-Yates R, Marroquin JL: Searching in metric spaces. ACM Comp Surv 33(3):273–321, 2001
Santini S, Jain R: Similarity measures. IEEE Trans Pattern Anal Machine Intell 21(9):871–883, 1999
Rubner Y, Tomasi C: Perceptual metrics for image database navigation. Boston, USA: Kluwer, 2001
Hiransakolwong N, Hua K A, Koompairojn S, Vu K, Lang SD: An adaptive distance computation technique for image retrieval systems. Proceedings of the ACM Symposium on Applied Computing (SAC), Santa Fe, USA, 2005, pp 1195–1199
Vasconcelos N: On the efficient evaluation of probabilistic similarity functions for image retrieval. IEEE Trans Inf Theory 50(7):1482–1496, 2004
Akleman E, Chen J: Generalized distance functions. Proceedings of the International Conference on Shape Modeling and Applications, Aizuwakamatsu, Japan, 1999
Aggarwal CC, Hinneburg A, Keim DA: On the surprising behavior of distance metrics in high dimensional spaces. Proceedings of the 8th International Conference on Database Theory (ICDT), London, England, 2001, pp 420–434
Theodoridis S, Koutroumbas K: Pattern Recognition. New York: Academic, 1999
Gibbs AL, Su FE: On choosing and bounding probability metrics. Int Stat Rev 70(3):419–435, 2002
Zhang DS, Lu G: Evaluation of similarity measurement for image retrieval. Proceedings of the IEEE International Conference on Neural Networks & Signal Processing, Nanjing, China, 2003, pp 928–931
Wilson DR, Martinez TR: Improved heterogeneous distance functions. J Artificial Intelligence Res 6:1–34, 1997
Tversky A: Features of similarity. Psychol Rev 84(4):327–352, 1977
Tversky A, Gati I: Similarity, separability and the triangle inequality. Psychol Rev 89(1):123–154, 1982
Chang EY, Li B, Li C: Toward preception-based image retrieval. Proceedings of the IEEE Workshop on Content-Based Access of Image and Video Libraries, Hilton Head, USA, 2000, pp 101–105
Vasconcelos N, Lippman A: A unifying view of image similarity. Proceedings of the International Conference on Pattern Recognition (ICPR), 2000
Felipe JC: Development of methods for extraction, comparison and analysis of intrinsic features of medical images, aiming at content-based perceptual retrieval. Ph.D. Thesis, Department of Computer Sciences—ICMC, University of São Paulo at São Carlos, Brazil, 163 p (in Portuguese), 2005
Haralick RM, Shanmugan K, Dinstein I: Textural features for image classification. IEEE Trans Syst Man Cybernet 3(6):610–621, 1973
Baeza-Yates R, Ribeiro-Neto B: Modern Information Retrieval. New York: ACM Press, 1999
Balan AGR, Traina AJM, Traina Jr C: Fractal analysis of image textures for indexing and retrieval by content. Proceedings of the 18th IEEE Symposium on Computer-Based Medical Systems (CBMS), Dublin, Ireland, 2005, pp 581–586
Felipe JC, Traina AJM, Traina Jr C: Retrieval by content of medical images using texture for tissue identification. Proceedings of the 16th IEEE Symposium on Computer-Based Medical Systems (CBMS), New York, 2003, pp 175–180
Acknowledgments
The authors are grateful to the radiologists from HC-FMRP, Ribeirão Preto, Brazil who participated in the experimental studies and the researchers from the CCIFM-FMRP who provided the images for the experiments. This research has been supported, in part, by the Brazilian National Research Council (CNPq) under grants 52.1685/98-6, 860.068/00-7 and 35.0852/94-4 and by the Sao Paulo State Research Foundation (FAPESP) under grant 04/02215-5.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Felipe, J.C., Traina, C. & Traina, A.J.M. A New Family of Distance Functions for Perceptual Similarity Retrieval of Medical Images. J Digit Imaging 22, 183–201 (2009). https://doi.org/10.1007/s10278-007-9084-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10278-007-9084-x