Chen Zhang
ABSTRACT
To alleviate the vocabulary problem, this paper investigates the role of user term feedback in interactive text-based image retrieval. Term feedback refers to the feedback from a user on specific terms regarding their relevance to a target image. Previous studies have indicated the effectiveness of term feedback in interactive text retrieval [14]. However, the term feedback has not shown to be effective in our experiments on text-based image retrieval. Our results indicate that, although term feedback has a positive effect by allowing users to identify more relevant terms, it also has a strong negative effect by providing more opportunities for users to specify irrelevant terms. To understand these different effects and their implications on the potential of term feedback, this paper further presents analysis of important factors that contribute to the utility of term feedback and discusses the outlook of term feedback in interactive text-based image retrieval.
- Anick, P. and Tipirneni, S. The Paraphrase Search Assistant: Terminological Feedback for Iterative Information Seeking. In Proceedings of SIGIR'99. Berkeley, CA, 1999. Google Scholar
Digital Library
- Belkin, N.J. and Marchetti, P.G. Determining the functionality and features of an intelligent interface to an information retrieval system, In Proceedings of SIGIR'90, Brussels, Belgium, 1990. Google ScholarDigital Library
- Belkin, N.J., Cool, C., Koenemann, J., Ng, K.B., and Park, S. Using Relevance Feedback and Ranking in Interactive Searching. In Proceedings of TREC4. 1996.Google Scholar
- Blei, D. and Jordan, M. Modeling annotated data. In Proceedings of 26th International Conference on Research and Development in Information Retrieval (SIGIR). 2003. Google ScholarDigital Library
- Choi, Y. and Rasmussen, E. Search for Images: the Analysis of User's Queries for Image Retrieval in American History. In Journal of the American Society for Information Science and Technology, 54(6), April 2003. Google ScholarDigital Library
- Clough, P., Sanderson, M., and Reid, Norman. The Eurovision St Andrews Photographic Collection. http://ir.shef.ac.uk/imageclef2004/guide.pdf.Google Scholar
- Harman, D. Towards Interactive Query Expansion. In Proceeding of SIGIR'88. 1988. Google ScholarDigital Library
- He, X., King, O., Ma, W.-Y., Li, M., and Zhang, H. J. Learning a semantic space from user's relevance feedback for image retrieval. IEEE Transaction on Curcuits and Systems for Video Technology, 13(1):39--48, Jan. 2003. Google ScholarDigital Library
- Hearst, M. Using Categories to Provide Context for Full-Text Retrieval Results. In Proceedings of RIAO'94. 1994.Google Scholar
- Henniger, Scott and Nicholas, Belkin, Interface Issues and Interaction Strategies for Information Retrieval Systems. In Proceedings of the Human Factors in computing Systems Conference (CHI'96), ACM Press, New York, 1996. Google ScholarDigital Library
- Hoi, C.-H and Lyu, M. R. A Novel Log-based Relevance Feedback Technique in Content-based Image Retrieval, Proc. of the 12th ACM International Conference on Multimedia. Google ScholarDigital Library
- Jeon, J., Lavrenko, V., and Manmatha, R. Automatic Image Annotation and Retrieval using Cross-Media Relevance Models. In Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval. 2003. Google ScholarDigital Library
- Keister, L. H. User types and queries: impact on image access systems. In Challenges in indexing electronic text and images (Fidel, R et al., eds). ASIS, 1994, 7--22.Google Scholar
- Koenemann, J. and Belkin, N. J. A Case for Interaction: a Study of Interactive Information Retrieval Behavior and Effectiveness. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Common Ground, p.205--212, April 13-18, 1996, Vancouver, Critish Columbia, Canada. Google ScholarDigital Library
- Lafferty, J. and Zhai, C. X. Document language models, query models, and risk minimization for information retrieval. In The 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 2001. Google ScholarDigital Library
- Lavrenko, V. and Croft, B. Relevance-based langauge models. In Proceeding of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 2001. Google ScholarDigital Library
- Lavrenko, V., Manmatha, R., and Jeon, J. A Model for Learning the Semantics of Pictures. In Proceedings of Advance in Neutral Information Processing. 2003.Google Scholar
- Li, J. and Wang, J.Z. Automatic linguistic indexing of pictures by a statistical modeling approach. IEEE Trans. on Pattern Analysis and Machine Intelligence, 2003. 25(19): p. 1075--1088. Google ScholarDigital Library
- McDonald, S. and Tait, J. Search Strategies in Content-based Imaged Retrieval. In Proceedings of SIGIR 2003. Toronto, Canada, 2003. Google ScholarDigital Library
- Monay, F. and Gatica-Perez, D. On Image Auto-Annotation with Latent Space Models. In Proc. ACM International Conference on Multimedia. 2003. Google ScholarDigital Library
- Ponte, J. A Language Modeling Approach to Information Retrieval, in Department of Computer Science, Univ. of Massachusetts at Amherst. 1998. Google ScholarDigital Library
- Rui, Y., Huang, T. S., Ortega, M., and Mehrotra, S. Relevance Feedback: A Power Tool in Interactive Content-Based Image Retrieval, IEEE Trans. on Circuits and Systems for Video Technology, Special Issue on Segmentation, Description, and Retrieval of Video Content, pp644--655, Vol 8, No. 5, Sept, 1998. Google ScholarDigital Library
- Santini, S. Exploring image databases context-based retrieval. Academic Press, San Diego USA, 2001. Google ScholarDigital Library
- Vendrig, J., Worring, M., and Smeulders, A. Filter Image Browsing: Interactive Image Retrieval by Using Database Overviews. Multimedial Tools and Applications, 15, 83--103. 2001. Google ScholarDigital Library
Index Terms
- User term feedback in interactive text-based image retrieval
Recommendations
An empirical investigation of user term feedback in text-based targeted image search
Text queries are natural and intuitive for users to describe their information needs. However, text-based image retrieval faces many challenges. Traditional text retrieval techniques on image descriptions have not been very successful. This is mainly ...
Using MeSH to expand queries in medical image retrieval
MCBR-CDS'11: Proceedings of the Second MICCAI international conference on Medical Content-Based Retrieval for Clinical Decision SupportThe presence of huge collections of medical images in scientific repositories and hospital databases has given rise to increasing interest in access to this information. This paper addresses the issue, focusing on image retrieval based on textual ...
Interactive content-based image retrieval using relevance feedback
Database search engines are generally used in a one-shot fashion in which a user provides query information to the system and, in return, the system provides a number of database instances to the user. A relevance feedback system allows the user to ...
Comments