ABSTRACT
Despite the major advances on feature development for low and mid-level representations, a single visual feature is often insufficient to achieve effective retrieval results in different scenarios. Since diverse visual properties provide distinct and often complementary information for a same query, the combination of different features, including handcrafted and learned features, has been establishing as a relevant trend in image retrieval. An intrinsic difficulty task consists in selecting and combining features that provide a high-effective result, which is often supported by supervised learning methods. However, in the absence of labeled data, selecting and fusing features in a completely unsupervised fashion becomes an essential, although very challenging task. The proposed genetic algorithm employs effectiveness estimation measures as fitness functions, making the evolutionary process fully unsupervised. Our approach was evaluated considering 3 public datasets and 35 different descriptors achieving relative gains up to +53.96% in scenarios with more than 8 billion possible combinations of rankers. The framework was also compared to different baselines, including state-of-the-art methods.
- Pradeep K. Atrey, M. Anwar Hossain, Abdulmotaleb El Saddik, and Mohan S. Kankanhalli. 2010. Multimodal fusion for multimedia analysis: a survey. Multimedia Systems, Vol. 16, 6 (01 Nov 2010), 345--379. Google ScholarDigital Library
- S. Bai and X. Bai. 2016. Sparse Contextual Activation for Efficient Visual Re-Ranking. IEEE Trans. on Image Processing (TIP), Vol. 25, 3 (2016), 1056--1069.Google ScholarDigital Library
- Song Bai, Xiang Bai, Qi Tian, and Longin Jan Latecki. 2017. Regularized Diffusion Process for Visual Retrieval. In Conf. on Artificial Intelligence (AAAI). 3967--3973. Google ScholarDigital Library
- Waad Bouaguel, Afef Ben Brahim, and Mohamed Limam. 2013. Feature Selection By Rank Aggregation and Genetic Algorithms. In KDIR/KMIS 2013 - Proceedings of the International Conference on Knowledge Discovery and Information Retrieval and the International .Google Scholar
- Deng Cai, Chiyuan Zhang, and Xiaofei He. 2010. Unsupervised Feature Selection for Multi-cluster Data. In Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '10). 333--342. Google ScholarDigital Library
- Savvas A. Chatzichristofis and Yiannis S. Boutalis. 2008a. CEDD: color and edge directivity descriptor: a compact descriptor for image indexing and retrieval. In Proceedings of the 6th international conference on Computer vision systems (ICVS'08). 312--322. Google ScholarDigital Library
- Savvas A. Chatzichristofis and Yiannis S. Boutalis. 2008b. FCTH: Fuzzy Color and Texture Histogram A Low Level Feature for Accurate Image Retrieval. In Int. Workshop on Image Analysis for Multimedia Interactive Services. 191--196. Google ScholarDigital Library
- Leszek Cieplinski. 2001. MPEG-7 Color Descriptors and Their Applications. In Computer Analysis of Images and Patterns, Władysław Skarbek (Ed.). Springer Berlin Heidelberg, Berlin, Heidelberg, 11--20. Google ScholarDigital Library
- Ricardo da S. Torres, Alexandre X. Falcão, Marcos A. Gonçalves, João P. Papa, Baoping Zhang, Weiguo Fan, and Edward A. Fox. 2009. A genetic programming framework for content-based image retrieval. Pattern Recognition, Vol. 42, 2, 283 -- 292. Learning Semantics from Multimedia Content. Google ScholarDigital Library
- N. Dalal and B. Triggs. 2005. Histograms of oriented gradients for human detection. In 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), Vol. 1. 886--893 vol. 1. Google ScholarDigital Library
- Ritendra Datta, Dhiraj Joshi, Jia Li, and James Z. Wang. 2008. Image retrieval: Ideas, influences, and trends of the new age. Comput. Surveys, Vol. 40, 2 (2008), 5:1--5:60. Google ScholarDigital Library
- J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. 2009. ImageNet: A Large-Scale Hierarchical Image Database. In CVPR09 .Google Scholar
- Cristiano D. Ferreira, Jefersson Alex dos Santos, Ricardo da S. Torres, Marcos André Gonccalves, R. C. Rezende, and Weiguo Fan. 2011. Relevance feedback based on genetic programming for image retrieval. Pattern Recogninion Letters, Vol. 32, 1 (2011), 27--37. Google ScholarDigital Library
- R. Gali, M. L. Dewal, and R. S. Anand. 2012. Genetic Algorithm for Content Based Image Retrieval. In 2012 Fourth International Conference on Computational Intelligence, Communication Systems and Networks. 243--247. Google ScholarDigital Library
- Xiaofei He, Deng Cai, and Partha Niyogi. 2005. Laplacian Score for Feature Selection. In Proceedings of the 18th International Conference on Neural Information Processing Systems (NIPS'05). 507--514. Google ScholarDigital Library
- John H. Holland. 1975. Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control and Artificial Intelligence .University of Michigan Press, Ann Arbor, MI.Google ScholarDigital Library
- Jing Huang, S. Ravi Kumar, Mandar Mitra, Wei-Jing Zhu, and Ramin Zabih. 1997. Image Indexing Using Color Correlograms. In CVPR'97. 762--768. Google ScholarDigital Library
- N. Jardine and C.J. van Rijsbergen. 1971. The use of hierarchic clustering in information retrieval. Information Storage and Retrieval, Vol. 7, 5 (1971), 217 -- 240.Google ScholarCross Ref
- M. L. Kherfi and D. Ziou. 2006. Relevance feedback for CBIR: a new approach based on probabilistic feature weighting with positive and negative examples. IEEE Transactions on Image Processing, Vol. 15, 4 (2006), 1017--1030. Google ScholarDigital Library
- Preeti Kushwaha and Rashmi R. Welekar. 2016. Feature Selection for Image Retrieval based on Genetic Algorithm. International Journal of Interactive Multimedia and Artificial Intelligence, Vol. 4, 2, 16--21.Google ScholarCross Ref
- Zechao Li, Yi Yang, Jing Liu, Xiaofang Zhou, and Hanqing Lu. 2012. Unsupervised Feature Selection Using Nonnegative Spectral Analysis. In Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence . Google ScholarDigital Library
- Guang-Hai Liu and Jing-Yu Yang. 2013. Content-based image retrieval using color difference histogram. Pattern Recognition, Vol. 46, 1 (2013), 188 -- 198. Google ScholarDigital Library
- Z. Liu, S. Wang, L. Zheng, and Q. Tian. 2017. Robust ImageGraph: Rank-Level Feature Fusion for Image Search. IEEE Transactions on Image Processing, Vol. 26, 7 (2017), 3128--3141. Google ScholarDigital Library
- D.G. Lowe. 1999. Object recognition from local scale-invariant features. In IEEE International Conference on Computer Vision (ICCV). 1150--1157. Google ScholarDigital Library
- Mathias Lux. 2011. Content Based Image Retrieval with LIRe. In Proceedings of the 19th ACM International Conference on Multimedia (MM '11). Google ScholarDigital Library
- B. S. Manjunath, J. R. Ohm, V. V. Vasudevan, and A. Yamada. 2001. Color and texture descriptors. IEEE Transactions on Circuits and Systems for Video Technology, Vol. 11, 6 (2001), 703--715. Google ScholarDigital Library
- M-E. Nilsback and A. Zisserman. 2006. A Visual Vocabulary for Flower Classification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Vol. 2. 1447--1454. Google ScholarDigital Library
- D. Nistér and H. Stewénius. 2006. Scalable Recognition with a Vocabulary Tree. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR'2006), Vol. 2. 2161--2168. Google ScholarDigital Library
- Timo Ojala, Matti Pietikainen, and Topi Maenpaa. 2002. Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 24, 7 (2002), 971--987. Google ScholarDigital Library
- Aude Oliva and Antonio Torralba. 2001. Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope. IJCV, Vol. 42, 3 (May 2001), 145--175.Google Scholar
- Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer. 2017. Automatic differentiation in PyTorch. In NIPS-W .Google Scholar
- Mattis Paulin, Julien Mairal, Matthijs Douze, Zaid Harchaoui, Florent Perronnin, and Cordelia Schmid. 2017. Convolutional Patch Representations for Image Retrieval: An Unsupervised Approach. Int. Journal of Computer Vision (2017). Google ScholarDigital Library
- D. C. G. Pedronette and R. d. S. Torres. 2015. Unsupervised Effectiveness Estimation for Image Retrieval Using Reciprocal Rank Information. In 2015 28th SIBGRAPI Conference on Graphics, Patterns and Images. 321--328.Google Scholar
- Daniel Carlos Guimarães Pedronette and Ricardo da S. Torres. 2016. A correlation graph approach for unsupervised manifold learning in image retrieval tasks. Neurocomputing, Vol. 208, Sup C (2016), 66 -- 79. Google ScholarDigital Library
- Daniel Carlos Guimarães Pedronette, Filipe Marcel Fernandes Gonçalves, and Ivan Rizzo Guilherme. 2018. Unsupervised manifold learning through reciprocal kNN graph and Connected Components for image retrieval tasks. Pattern Recognition, Vol. 75 (2018), 161 -- 174. Distance Metric Learning for Pattern Recognition. Google ScholarDigital Library
- Daniel Carlos Guimar aes Pedronette, Otávio A.B. Penatti, and Ricardo da S. Torres. 2014. Unsupervised manifold learning using Reciprocal kNN Graphs in image re-ranking and rank aggregation tasks. Image and Vision Computing, Vol. 32, 2 (2014), 120 -- 130. Google ScholarDigital Library
- Luca Piras and Giorgio Giacinto. 2017. Information fusion in content based image retrieval: A comprehensive overview. Information Fusion, Vol. 37, Supplement C (2017), 50 -- 60. Google ScholarDigital Library
- Konda Reddy Mopuri and R. Venkatesh Babu. 2015. Object Level Deep Feature Pooling for Compact Image Representation. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops .Google Scholar
- Cees G. M. Snoek, Marcel Worring, and Arnold W. M. Smeulders. 2005. Early Versus Late Fusion in Semantic Video Analysis. In Proceedings of the 13th Annual ACM International Conference on Multimedia (MULTIMEDIA '05). 399--402. Google ScholarDigital Library
- Renato O. Stehling, Mario A. Nascimento, and Alexandre X. Falc ao. 2002. A compact and efficient image retrieval approach based on border/interior pixel classification. In CIKM'2002. 102--109. Google ScholarDigital Library
- Shaoyan Sun, Ying Li, Wengang Zhou, Qi Tian, and Houqiang Li. 2017. Local residual similarity for image re-ranking. Information Sciences, Vol. 417, Sup. C (2017), 143 -- 153. Google ScholarDigital Library
- Ricardo Da Silva Torres and Alexandre Xavier Falcão. 2006. Content-Based Image Retrieval: Theory and Applications. Revista de Informática Teórica e Aplicada, Vol. 13 (2006), 161--185.Google Scholar
- Lucas Pascotti Valem, Daniel Carlos Guimarães Pedronette, and Jurandy Almeida. 2018. Unsupervised similarity learning through Cartesian product of ranking references. Pattern Recognition Letters, Vol. 114 (2018), 41 -- 52. Data Representation and Representation Learning for Video Analysis.Google ScholarCross Ref
- K. E. A. van de Sande, T. Gevers, and C. G. M. Snoek. 2010. Evaluating Color Descriptors for Object and Scene Recognition. PAMI, Vol. 32, 9 (2010), 1582--1596. Google ScholarDigital Library
- Sotiris A. Vassou, Nektarios Anagnostopoulos, Angelos Amanatiadis, Klitos Christodoulou, and Savvas A. Chatzichristofis. 2017. CoMo: A Compact Composite Moment-Based Descriptor for Image Retrieval. In Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing (CBMI '17). Article 30, bibinfonumpages5 pages. Google ScholarDigital Library
- Bo Wang, Jiayan Jiang, WeiWang, Zhi-Hua Zhou, and Zhuowen Tu. 2012. Unsupervised Metric Fusion by Cross Diffusion. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR'2012). 3013 --3020. Google ScholarDigital Library
- Xiaoyu Wang, Ming Yang, T. Cour, Shenghuo Zhu, Kai Yu, and T.X. Han. 2011. Contextual weighting for vocabulary tree based image retrieval. In IEEE International Conference on Computer Vision (ICCV'2011). 209--216. Google ScholarDigital Library
- J. Xiao, J. Hays, K. A. Ehinger, A. Oliva, and A. Torralba. 2010. SUN database: Large-scale scene recognition from abbey to zoo. In 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 3485--3492.Google Scholar
- Lingxi Xie, Richang Hong, Bo Zhang, and Qi Tian. 2015. Image Classification and Retrieval Are ONE. In ACM Int. Conf. on Multimedia Retrieval (ICMR). 3--10. Google ScholarDigital Library
- Yi Yang, Heng Tao Shen, Zhigang Ma, Zi Huang, and Xiaofang Zhou. 2011. L2,1-norm Regularized Discriminative Feature Selection for Unsupervised Learning. In Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence (IJCAI'11). 1589--1594. Google ScholarDigital Library
- K. Zagoris, S.A. Chatzichristofis, N. Papamarkos, and Y.S. Boutalis. 2010. Automatic Image Annotation and Retrieval Using the Joint Composite Descriptor. In 14th Panhellenic Conference on Informatics (PCI). 143--147.Google Scholar
- Shaoting Zhang, Ming Yang, T. Cour, Kai Yu, and D.N. Metaxas. 2015. Query Specific Rank Fusion for Image Retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 37, 4 (April 2015), 803--815.Google ScholarDigital Library
- Zheng Zhao and Huan Liu. 2007. Spectral Feature Selection for Supervised and Unsupervised Learning. In Proceedings of the 24th International Conference on Machine Learning (ICML '07). 1151--1157. Google ScholarDigital Library
- Liang Zheng, Shengjin Wang, Lu Tian, Fei He, Ziqiong Liu, and Qi Tian. 2015. Query-Adaptive Late Fusion for Image Search and Person Re-identification. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) .Google Scholar
- Liang Zheng, Shengjin Wang, and Qi Tian. 2014. Lp-Norm IDF for Scalable Image Retrieval. IEEE Trans. on Image Processing, Vol. 23, 8 (Aug 2014), 3604--3617.Google Scholar
Index Terms
- An Unsupervised Genetic Algorithm Framework for Rank Selection and Fusion on Image Retrieval
Recommendations
Selection and Combination of Unsupervised Learning Methods for Image Retrieval
CBMI '17: Proceedings of the 15th International Workshop on Content-Based Multimedia IndexingThe evolution of technologies to store and share images has made imperative the need for methods to index and retrieve multimedia information based on visual content. The CBIR (Content-Based Image Retrieval) systems are the main solution in this ...
Unsupervised selective rank fusion for image retrieval tasks
AbstractSeveral visual features have been developed for content-based image retrieval in the last decades, including global, local and deep learning-based approaches. However, despite the huge advances in features development and mid-level ...
An Unsupervised Distance Learning Framework for Multimedia Retrieval
ICMR '17: Proceedings of the 2017 ACM on International Conference on Multimedia RetrievalDue to the increasing availability of image and multimedia collections, unsupervised post-processing methods, which are capable of improving the effectiveness of retrieval results without the need of user intervention, have become indispensable. This ...
Comments