Abstract
Performance evaluation is an often neglected topic in content based image retrieval research. Commonly used evaluation measures for effectiveness assessment are reviewed and their shortcomings are discussed. A new evaluation measure is proposed which overcomes some of the shortcomings of existing evaluation measures. The presented performance measure is especially suited for rank based retrieval methods. The measure is obtained fully automatic and can be exploit to investigate different criteria of effectiveness in detail. For better comparison of performance differences, the measure provides a confidence and credibility measure, too. Experiments were carried out to study the properties of the evaluation method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
G. Healey and D. Slater. Global color constancy: recognition of objects by use of illumination invariant properties of color distributions. Journal Optical Society of America A, 11(11):3003–3010, Nov 1994.
M.E. Lesk and G. Salton. Relevance assessments and retrieval system evaluation. In G. Salton, editor, The SMART Retrieval System-Experiments, chapter 26. Englewood Cliffs, Prentice-Hall, NJ, 1971.
B.S. Manjunath and W.Y. Ma. Texture features for browsing and retrieval of image data. IEEE Trans. on Pattern Analysis and Machine Intelligence, 18(8):842–848, 1996.
W. H. Press, B. P. Flannery, S. A. Teukolsky, and W. T. Vetterling. Numerical Recipes in C. Cambridge University Press, 1991.
A. M. Rees. The relevance of relevance to the testing and evaluation of document retrieval systems. In Aslib Proceedings, volume 18, pages 316–324, 1966.
G. Salton and M. McGill. Introduction to Modern Information Retrieval. McGraw-Hill, New York, 1983.
L. Schamber, M.B. Eisenberg, and M.S. Nilan. A re-examination of relevance: toward a dynamic, situational definition. Information, Processing & Management, 26(6):775–776, 1990.
M. Stricker and A. Dimai. Spectral covariance and fuzzy regions for image indexing. Machine Vision and Applications, 10:66–73, 1997.
M. J. Swain and D. H. Ballard. Color indexing. Intern. Journal of Computer Vision, 7(1):11–32, 1991.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Dimai, A. (1999). Assessment of Effectiveness of Content Based Image Retrieval Systems. In: Huijsmans, D.P., Smeulders, A.W.M. (eds) Visual Information and Information Systems. VISUAL 1999. Lecture Notes in Computer Science, vol 1614. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-48762-X_65
Download citation
DOI: https://doi.org/10.1007/3-540-48762-X_65
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-66079-8
Online ISBN: 978-3-540-48762-3
eBook Packages: Springer Book Archive