skip to main content
10.1145/3323873.3325022acmconferencesArticle/Chapter ViewAbstractPublication PagesicmrConference Proceedingsconference-collections
short-paper

An Unsupervised Genetic Algorithm Framework for Rank Selection and Fusion on Image Retrieval

Published:05 June 2019Publication History

ABSTRACT

Despite the major advances on feature development for low and mid-level representations, a single visual feature is often insufficient to achieve effective retrieval results in different scenarios. Since diverse visual properties provide distinct and often complementary information for a same query, the combination of different features, including handcrafted and learned features, has been establishing as a relevant trend in image retrieval. An intrinsic difficulty task consists in selecting and combining features that provide a high-effective result, which is often supported by supervised learning methods. However, in the absence of labeled data, selecting and fusing features in a completely unsupervised fashion becomes an essential, although very challenging task. The proposed genetic algorithm employs effectiveness estimation measures as fitness functions, making the evolutionary process fully unsupervised. Our approach was evaluated considering 3 public datasets and 35 different descriptors achieving relative gains up to +53.96% in scenarios with more than 8 billion possible combinations of rankers. The framework was also compared to different baselines, including state-of-the-art methods.

References

  1. Pradeep K. Atrey, M. Anwar Hossain, Abdulmotaleb El Saddik, and Mohan S. Kankanhalli. 2010. Multimodal fusion for multimedia analysis: a survey. Multimedia Systems, Vol. 16, 6 (01 Nov 2010), 345--379. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. S. Bai and X. Bai. 2016. Sparse Contextual Activation for Efficient Visual Re-Ranking. IEEE Trans. on Image Processing (TIP), Vol. 25, 3 (2016), 1056--1069.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Song Bai, Xiang Bai, Qi Tian, and Longin Jan Latecki. 2017. Regularized Diffusion Process for Visual Retrieval. In Conf. on Artificial Intelligence (AAAI). 3967--3973. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Waad Bouaguel, Afef Ben Brahim, and Mohamed Limam. 2013. Feature Selection By Rank Aggregation and Genetic Algorithms. In KDIR/KMIS 2013 - Proceedings of the International Conference on Knowledge Discovery and Information Retrieval and the International .Google ScholarGoogle Scholar
  5. Deng Cai, Chiyuan Zhang, and Xiaofei He. 2010. Unsupervised Feature Selection for Multi-cluster Data. In Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '10). 333--342. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Savvas A. Chatzichristofis and Yiannis S. Boutalis. 2008a. CEDD: color and edge directivity descriptor: a compact descriptor for image indexing and retrieval. In Proceedings of the 6th international conference on Computer vision systems (ICVS'08). 312--322. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Savvas A. Chatzichristofis and Yiannis S. Boutalis. 2008b. FCTH: Fuzzy Color and Texture Histogram A Low Level Feature for Accurate Image Retrieval. In Int. Workshop on Image Analysis for Multimedia Interactive Services. 191--196. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Leszek Cieplinski. 2001. MPEG-7 Color Descriptors and Their Applications. In Computer Analysis of Images and Patterns, Władysław Skarbek (Ed.). Springer Berlin Heidelberg, Berlin, Heidelberg, 11--20. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Ricardo da S. Torres, Alexandre X. Falcão, Marcos A. Gonçalves, João P. Papa, Baoping Zhang, Weiguo Fan, and Edward A. Fox. 2009. A genetic programming framework for content-based image retrieval. Pattern Recognition, Vol. 42, 2, 283 -- 292. Learning Semantics from Multimedia Content. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. N. Dalal and B. Triggs. 2005. Histograms of oriented gradients for human detection. In 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), Vol. 1. 886--893 vol. 1. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Ritendra Datta, Dhiraj Joshi, Jia Li, and James Z. Wang. 2008. Image retrieval: Ideas, influences, and trends of the new age. Comput. Surveys, Vol. 40, 2 (2008), 5:1--5:60. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. 2009. ImageNet: A Large-Scale Hierarchical Image Database. In CVPR09 .Google ScholarGoogle Scholar
  13. Cristiano D. Ferreira, Jefersson Alex dos Santos, Ricardo da S. Torres, Marcos André Gonccalves, R. C. Rezende, and Weiguo Fan. 2011. Relevance feedback based on genetic programming for image retrieval. Pattern Recogninion Letters, Vol. 32, 1 (2011), 27--37. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. R. Gali, M. L. Dewal, and R. S. Anand. 2012. Genetic Algorithm for Content Based Image Retrieval. In 2012 Fourth International Conference on Computational Intelligence, Communication Systems and Networks. 243--247. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Xiaofei He, Deng Cai, and Partha Niyogi. 2005. Laplacian Score for Feature Selection. In Proceedings of the 18th International Conference on Neural Information Processing Systems (NIPS'05). 507--514. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. John H. Holland. 1975. Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control and Artificial Intelligence .University of Michigan Press, Ann Arbor, MI.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Jing Huang, S. Ravi Kumar, Mandar Mitra, Wei-Jing Zhu, and Ramin Zabih. 1997. Image Indexing Using Color Correlograms. In CVPR'97. 762--768. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. N. Jardine and C.J. van Rijsbergen. 1971. The use of hierarchic clustering in information retrieval. Information Storage and Retrieval, Vol. 7, 5 (1971), 217 -- 240.Google ScholarGoogle ScholarCross RefCross Ref
  19. M. L. Kherfi and D. Ziou. 2006. Relevance feedback for CBIR: a new approach based on probabilistic feature weighting with positive and negative examples. IEEE Transactions on Image Processing, Vol. 15, 4 (2006), 1017--1030. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Preeti Kushwaha and Rashmi R. Welekar. 2016. Feature Selection for Image Retrieval based on Genetic Algorithm. International Journal of Interactive Multimedia and Artificial Intelligence, Vol. 4, 2, 16--21.Google ScholarGoogle ScholarCross RefCross Ref
  21. Zechao Li, Yi Yang, Jing Liu, Xiaofang Zhou, and Hanqing Lu. 2012. Unsupervised Feature Selection Using Nonnegative Spectral Analysis. In Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence . Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Guang-Hai Liu and Jing-Yu Yang. 2013. Content-based image retrieval using color difference histogram. Pattern Recognition, Vol. 46, 1 (2013), 188 -- 198. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Z. Liu, S. Wang, L. Zheng, and Q. Tian. 2017. Robust ImageGraph: Rank-Level Feature Fusion for Image Search. IEEE Transactions on Image Processing, Vol. 26, 7 (2017), 3128--3141. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. D.G. Lowe. 1999. Object recognition from local scale-invariant features. In IEEE International Conference on Computer Vision (ICCV). 1150--1157. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Mathias Lux. 2011. Content Based Image Retrieval with LIRe. In Proceedings of the 19th ACM International Conference on Multimedia (MM '11). Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. B. S. Manjunath, J. R. Ohm, V. V. Vasudevan, and A. Yamada. 2001. Color and texture descriptors. IEEE Transactions on Circuits and Systems for Video Technology, Vol. 11, 6 (2001), 703--715. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. M-E. Nilsback and A. Zisserman. 2006. A Visual Vocabulary for Flower Classification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Vol. 2. 1447--1454. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. D. Nistér and H. Stewénius. 2006. Scalable Recognition with a Vocabulary Tree. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR'2006), Vol. 2. 2161--2168. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Timo Ojala, Matti Pietikainen, and Topi Maenpaa. 2002. Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 24, 7 (2002), 971--987. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Aude Oliva and Antonio Torralba. 2001. Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope. IJCV, Vol. 42, 3 (May 2001), 145--175.Google ScholarGoogle Scholar
  31. Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer. 2017. Automatic differentiation in PyTorch. In NIPS-W .Google ScholarGoogle Scholar
  32. Mattis Paulin, Julien Mairal, Matthijs Douze, Zaid Harchaoui, Florent Perronnin, and Cordelia Schmid. 2017. Convolutional Patch Representations for Image Retrieval: An Unsupervised Approach. Int. Journal of Computer Vision (2017). Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. D. C. G. Pedronette and R. d. S. Torres. 2015. Unsupervised Effectiveness Estimation for Image Retrieval Using Reciprocal Rank Information. In 2015 28th SIBGRAPI Conference on Graphics, Patterns and Images. 321--328.Google ScholarGoogle Scholar
  34. Daniel Carlos Guimarães Pedronette and Ricardo da S. Torres. 2016. A correlation graph approach for unsupervised manifold learning in image retrieval tasks. Neurocomputing, Vol. 208, Sup C (2016), 66 -- 79. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Daniel Carlos Guimarães Pedronette, Filipe Marcel Fernandes Gonçalves, and Ivan Rizzo Guilherme. 2018. Unsupervised manifold learning through reciprocal kNN graph and Connected Components for image retrieval tasks. Pattern Recognition, Vol. 75 (2018), 161 -- 174. Distance Metric Learning for Pattern Recognition. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Daniel Carlos Guimar aes Pedronette, Otávio A.B. Penatti, and Ricardo da S. Torres. 2014. Unsupervised manifold learning using Reciprocal kNN Graphs in image re-ranking and rank aggregation tasks. Image and Vision Computing, Vol. 32, 2 (2014), 120 -- 130. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Luca Piras and Giorgio Giacinto. 2017. Information fusion in content based image retrieval: A comprehensive overview. Information Fusion, Vol. 37, Supplement C (2017), 50 -- 60. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Konda Reddy Mopuri and R. Venkatesh Babu. 2015. Object Level Deep Feature Pooling for Compact Image Representation. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops .Google ScholarGoogle Scholar
  39. Cees G. M. Snoek, Marcel Worring, and Arnold W. M. Smeulders. 2005. Early Versus Late Fusion in Semantic Video Analysis. In Proceedings of the 13th Annual ACM International Conference on Multimedia (MULTIMEDIA '05). 399--402. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Renato O. Stehling, Mario A. Nascimento, and Alexandre X. Falc ao. 2002. A compact and efficient image retrieval approach based on border/interior pixel classification. In CIKM'2002. 102--109. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Shaoyan Sun, Ying Li, Wengang Zhou, Qi Tian, and Houqiang Li. 2017. Local residual similarity for image re-ranking. Information Sciences, Vol. 417, Sup. C (2017), 143 -- 153. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Ricardo Da Silva Torres and Alexandre Xavier Falcão. 2006. Content-Based Image Retrieval: Theory and Applications. Revista de Informática Teórica e Aplicada, Vol. 13 (2006), 161--185.Google ScholarGoogle Scholar
  43. Lucas Pascotti Valem, Daniel Carlos Guimarães Pedronette, and Jurandy Almeida. 2018. Unsupervised similarity learning through Cartesian product of ranking references. Pattern Recognition Letters, Vol. 114 (2018), 41 -- 52. Data Representation and Representation Learning for Video Analysis.Google ScholarGoogle ScholarCross RefCross Ref
  44. K. E. A. van de Sande, T. Gevers, and C. G. M. Snoek. 2010. Evaluating Color Descriptors for Object and Scene Recognition. PAMI, Vol. 32, 9 (2010), 1582--1596. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Sotiris A. Vassou, Nektarios Anagnostopoulos, Angelos Amanatiadis, Klitos Christodoulou, and Savvas A. Chatzichristofis. 2017. CoMo: A Compact Composite Moment-Based Descriptor for Image Retrieval. In Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing (CBMI '17). Article 30, bibinfonumpages5 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Bo Wang, Jiayan Jiang, WeiWang, Zhi-Hua Zhou, and Zhuowen Tu. 2012. Unsupervised Metric Fusion by Cross Diffusion. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR'2012). 3013 --3020. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Xiaoyu Wang, Ming Yang, T. Cour, Shenghuo Zhu, Kai Yu, and T.X. Han. 2011. Contextual weighting for vocabulary tree based image retrieval. In IEEE International Conference on Computer Vision (ICCV'2011). 209--216. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. J. Xiao, J. Hays, K. A. Ehinger, A. Oliva, and A. Torralba. 2010. SUN database: Large-scale scene recognition from abbey to zoo. In 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 3485--3492.Google ScholarGoogle Scholar
  49. Lingxi Xie, Richang Hong, Bo Zhang, and Qi Tian. 2015. Image Classification and Retrieval Are ONE. In ACM Int. Conf. on Multimedia Retrieval (ICMR). 3--10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Yi Yang, Heng Tao Shen, Zhigang Ma, Zi Huang, and Xiaofang Zhou. 2011. L2,1-norm Regularized Discriminative Feature Selection for Unsupervised Learning. In Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence (IJCAI'11). 1589--1594. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. K. Zagoris, S.A. Chatzichristofis, N. Papamarkos, and Y.S. Boutalis. 2010. Automatic Image Annotation and Retrieval Using the Joint Composite Descriptor. In 14th Panhellenic Conference on Informatics (PCI). 143--147.Google ScholarGoogle Scholar
  52. Shaoting Zhang, Ming Yang, T. Cour, Kai Yu, and D.N. Metaxas. 2015. Query Specific Rank Fusion for Image Retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 37, 4 (April 2015), 803--815.Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Zheng Zhao and Huan Liu. 2007. Spectral Feature Selection for Supervised and Unsupervised Learning. In Proceedings of the 24th International Conference on Machine Learning (ICML '07). 1151--1157. Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Liang Zheng, Shengjin Wang, Lu Tian, Fei He, Ziqiong Liu, and Qi Tian. 2015. Query-Adaptive Late Fusion for Image Search and Person Re-identification. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) .Google ScholarGoogle Scholar
  55. Liang Zheng, Shengjin Wang, and Qi Tian. 2014. Lp-Norm IDF for Scalable Image Retrieval. IEEE Trans. on Image Processing, Vol. 23, 8 (Aug 2014), 3604--3617.Google ScholarGoogle Scholar

Index Terms

  1. An Unsupervised Genetic Algorithm Framework for Rank Selection and Fusion on Image Retrieval

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      ICMR '19: Proceedings of the 2019 on International Conference on Multimedia Retrieval
      June 2019
      427 pages
      ISBN:9781450367653
      DOI:10.1145/3323873

      Copyright © 2019 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 5 June 2019

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • short-paper

      Acceptance Rates

      Overall Acceptance Rate254of830submissions,31%

      Upcoming Conference

      ICMR '24
      International Conference on Multimedia Retrieval
      June 10 - 14, 2024
      Phuket , Thailand

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader