Fei Yin
ABSTRACT
Hash method with efficient retrieval efficiency and lower storage space, in the most recent has been widely used in image retrieval task. For complex image retrieval task, the manually extracted features often has limitations, and the deep convolution neural network can extract better features. However, traditional convolution neural networks usually focus on local features, while ignoring the ability to learn global features. In addition, traditional hash methods require constructing sample pairs to learn distance metrics, resulting in high computational costs. To address the above problem, in this paper a new self-attention based deep hash (SADH) learning method is proposed, which introduces a labeled hashing center and trains the network using self-attention mechanism. The method aims to fit the image hash codes to the relevant hashing center. The distance between the hashing center and the image hash codes is calculated using a loss function, resulting in generated hash code with strong discriminative power. Experimental evaluations on standard datasets demonstrate that this method outperforms the state-of-the-art retrieval methods in terms of retrieval accuracy.
- Zhangjie Cao, Mingsheng Long, Jianmin Wang, and Philip S Yu. 2017. Hashnet: Deep learning to hash by continuation. In Proceedings of the IEEE international conference on computer vision. 5608–5617.Google Scholar
Cross Ref
- Mayur Datar, Nicole Immorlica, Piotr Indyk, and Vahab S Mirrokni. 2004. Locality-sensitive hashing scheme based on p-stable distributions. In Proceedings of the twentieth annual symposium on Computational geometry. 253–262.Google ScholarDigital Library
- Yunchao Gong, Svetlana Lazebnik, Albert Gordo, and Florent Perronnin. 2012. Iterative quantization: A procrustean approach to learning binary codes for large-scale image retrieval. IEEE transactions on pattern analysis and machine intelligence 35, 12 (2012), 2916–2929.Google Scholar
- Hanjiang Lai, Yan Pan, Ye Liu, and Shuicheng Yan. 2015. Simultaneous feature learning and hash coding with deep neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition. 3270–3278.Google ScholarCross Ref
- Wu-Jun Li, Sheng Wang, and Wang-Cheng Kang. 2015. Feature learning based deep supervised hashing with pairwise labels. arXiv preprint arXiv:1511.03855 (2015).Google ScholarDigital Library
- Xue Li, Jiong Yu, Yongqiang Wang, Jia-Ying Chen, Peng-Xiao Chang, and Ziyang Li. 2021. DAHP: Deep attention-guided hashing with pairwise labels. IEEE Transactions on Circuits and Systems for Video Technology 32, 3 (2021), 933–946.Google ScholarCross Ref
- Haomiao Liu, Ruiping Wang, Shiguang Shan, and Xilin Chen. 2016. Deep supervised hashing for fast image retrieval. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2064–2072.Google ScholarCross Ref
- Haomiao Liu, Ruiping Wang, Shiguang Shan, and Xilin Chen. 2017. Learning multifunctional binary codes for both category and attribute oriented retrieval tasks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3901–3910.Google ScholarCross Ref
- David G Lowe. 2004. Distinctive image features from scale-invariant keypoints. International journal of computer vision 60 (2004), 91–110.Google ScholarDigital Library
- Huimin Lu, Ming Zhang, Xing Xu, Yujie Li, and Heng Tao Shen. 2020. Deep fuzzy hashing network for efficient image retrieval. IEEE transactions on fuzzy systems 29, 1 (2020), 166–176.Google ScholarDigital Library
- Xuchao Lu, Li Song, Rong Xie, Xiaokang Yang, and Wenjun Zhang. 2017. Deep hash learning for efficient image retrieval. In 2017 IEEE International Conference on Multimedia & Expo Workshops (ICMEW). IEEE, 579–584.Google Scholar
- Aude Oliva and Antonio Torralba. 2001. Modeling the shape of the scene: A holistic representation of the spatial envelope. International journal of computer vision 42 (2001), 145–175.Google Scholar
- Shishi Qiao, Ruiping Wang, Shiguang Shan, and Xilin Chen. 2021. Deep video code for efficient face video retrieval. Pattern Recognition 113 (2021), 107754.Google ScholarCross Ref
- Ruikui Wang, Ruiping Wang, Shishi Qiao, Shiguang Shan, and Xilin Chen. 2020. Deep position-aware hashing for semantic continuous image retrieval. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 2493–2502.Google ScholarCross Ref
- Xiaolong Wang, Ross Girshick, Abhinav Gupta, and Kaiming He. 2018. Non-local neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition. 7794–7803.Google ScholarCross Ref
- Yingxin Wang, Xiushan Nie, Yang Shi, Xin Zhou, and Yilong Yin. 2019. Attention-based video hashing for large-scale video retrieval. IEEE Transactions on Cognitive and Developmental Systems 13, 3 (2019), 491–502.Google ScholarCross Ref
- Yair Weiss, Antonio Torralba, and Rob Fergus. 2008. Spectral hashing. Advances in neural information processing systems 21 (2008).Google Scholar
- Kaixing Wu and Li Xu. 2023. Deep Hybrid Neural Network with Attention Mechanism for Video Hash Retrieval Method. IEEE Access (2023).Google ScholarCross Ref
- Rongkai Xia, Yan Pan, Hanjiang Lai, Cong Liu, and Shuicheng Yan. 2014. Supervised hashing for image retrieval via image representation learning. In Proceedings of the AAAI conference on artificial intelligence, Vol. 28.Google ScholarCross Ref
- Li Yuan, Tao Wang, Xiaopeng Zhang, Francis EH Tay, Zequn Jie, Wei Liu, and Jiashi Feng. 2020. Central similarity quantization for efficient image and video retrieval. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 3083–3092.Google ScholarCross Ref
- Ruimao Zhang, Liang Lin, Rui Zhang, Wangmeng Zuo, and Lei Zhang. 2015. Bit-scalable deep hashing with regularized similarity learning for image retrieval and person re-identification. IEEE Transactions on Image Processing 24, 12 (2015), 4766–4779.Google ScholarDigital Library
- Fang Zhao, Yongzhen Huang, Liang Wang, and Tieniu Tan. 2015. Deep semantic ranking based hashing for multi-label image retrieval. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1556–1564.Google Scholar
- Han Zhu, Mingsheng Long, Jianmin Wang, and Yue Cao. 2016. Deep hashing network for efficient similarity retrieval. In Proceedings of the AAAI conference on Artificial Intelligence, Vol. 30.Google ScholarCross Ref
Index Terms
- Self-Attention based Deep Hash Learning Method for Efficient Image Retrieval
Recommendations
A hash centroid construction method with Swin transformer for multi-label image retrieval
AbstractQuantization-based hashing methods have become increasingly popular to adjust the global data distribution and accurately capture the data similarity compared with pairwise/triplet similarity-based methods. However, the existing image quantization ...
Supervised deep hashing for scalable face image retrieval
We propose a novel Deep Hashing based on Classification and Quantization errors for face image retrieval.It jointly learns feature representations of images, hashing functions and classifiers.The quantization errors and the prediction errors jointly ...
Deep Self-taught Hashing for Image Retrieval
MM '15: Proceedings of the 23rd ACM international conference on MultimediaHashing is a promising technique to tackle the problem of scalable retrieval, and it generally consists two major components, namely hash code generation and hash functions learning.The majority of existing hashing fall under the shallow model, which is ...
Comments