Abstract
Due to fast scanning response and strong damage resistance, Quick Response (QR) code has been used widely in product tracking, item identification, time tracking, document management, and general marketing. The standard QR code consisting of black and white modules, has the following defects: the monotonous color pattern and the poor visual effect. To address these issues, we propose a style transfer method of QR code based on convolutional neural network. Next, we modify the convolutional neural network structure to be in line with the requirements of the style transfer of QR code, which can more preserve the content of the original image than the classic style transfer method. Furthermore, to increase the recognizability of the artistic style QR code, we modify the standard positioning point of the style transfer to generate the QR code. Experiments show that the proposed method has strong robustness.
Similar content being viewed by others
References
Ding Z, Shao M, Fu Y (2018) Generative zero-shot learning via low-rank embedded semantic dictionary. IEEE Trans Pattern Anal Mach Intell 41(12):2861–2874
Deng J, Dong W, Socher R, et al (2009) Imagenet: a large-scale hierarchical image database. In: IEEE conference on computer vision and pattern recognition (CVPR), pp 248–255
Dumoulin V, Shlens J, Kudlur M (2017) A learned representation for artistic style. International Conference on Learning Representations, arXiv:1610.07629
Falcon A (2013) 40 gorgeous QR code artworks that rock. http://www.hongkiat.com/blog/qr-code-artworks/
Gatys LA, Ecker AS, Bethge M (2016) Image style transfer using convolutional neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 2414–2423
Gatys LA, Ecker AS, Bethge M (2015) A neural algorithm of artistic style. arXiv:1508.06576
He K, Zhang X, Ren S, et al (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 770–778
Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. arXiv:1502.03167
Johnson J, Alahi A, Fei-Fei L (2016) Perceptual losses for real-time style transfer and super-resolution. In: European conference on computer vision. Springer, Cham, pp 694–711
Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. arXiv:1412.6980
Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, pp 1097–1105
Lin TY, Maire M, Belongie S, et al (2014) Microsoft coco: common objects in context. In: European conference on computer vision. Springer, Cham, pp 740–755
Li C, Wand M (2016) Combining markov random fields and convolutional neural networks for image synthesis. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 2479–2486
Li J, Lu K, Huang Z, et al (2018) Transfer independently together: a generalized framework for domain adaptation. IEEE Trans on Cybern 49(6):2144–2155
Li J, Wu Y, Zhao J, et al (2017) Low-rank discriminant embedding for multiview learning. IEEE Trans on Cybern 47(11):3516–3529
Li J, Lu K, Huang Z, et al (2018) Heterogeneous domain adaptation through progressive alignment. IEEE Trans Neural Netw Learning Syst: 1–11 (Early Access)
Li J, Wu Y, Zhao J, et al (2016) Multi-manifold sparse graph embedding for multi-modal image classification. Neurocomputing 173:501–510
Liu Y, Yang J, Liu M (2008) Recognition of QR code with mobile phones. In: Chinese control and decision conference IEEE, pp 203–206
Rosin P, Collomosse J (2012) Image and video-based artistic stylisation. Springer, Berlin
Russakovsky O, Deng J, Su H, et al (2015) Imagenet large scale visual recognition challenge. Int J Comput Vision 115(3):211–252
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556
Wakahara T, Yamamoto N (2011) Image processing of 2-dimensional barcode. In: 2011 14th international conference on network-based information systems. IEEE, pp 484–490
Wang Z, Bovik AC, Sheikh HR, et al (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612
Wang S, Ding Z, Fu Y (2018) Cross-generation kinship verification with sparse discriminative metric. IEEE Trans Pattern Anal Mach Intell: 1-8(Early Access)
Xu M, Li Q, Niu J, et al (2018) Art-up: a novel method for generating scanning-robust aesthetic qr codes. arXiv:1803.02280
Zhu L, Huang Z, Li Z, et al (2018) Exploring auxiliary context: discrete semantic transfer hashing for scalable image retrieval. IEEE Trans Neural Netw Learning Sys 29(11):5264–5276
Zhu L, Huang Z, Liu X, et al (2017) Discrete multimodal hashing with canonical views for robust mobile landmark search. IEEE Trans Multimed 19(9):2066–2079
Zhu L, Shen J, Xie L, et al (2017) Unsupervised visual hashing with semantic assistant for content-based image retrieval. IEEE Trans Knowl Data Eng 29(2):472–486
Zhang Y, Deng S, Liu Z, et al (2015) Aesthetic QR codes based on two-stage image blending. In: International conference on multimedia modeling. Springer, Cham, pp 183–194
Acknowledgements
This work is supported by the National Natural Science Foundation of China under Grant No.61762012, No.61462026, and No.61762014, the Science and Technology Project of Guangxi Grant No.2018JJA170083, Innovation Project of Guangxi Graduate Education Grant (No.JGY2019023 and No.JGY2017018).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Li, HS., Xue, F. & Xia, Hy. Style transfer for QR code. Multimed Tools Appl 79, 33839–33852 (2020). https://doi.org/10.1007/s11042-019-08555-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-019-08555-4