Abstract
To achieve manufacturing and logistics informatization management for steelworks, it is of crucial importance to automatically recognize the slab management numbers (SMNs) sprayed on the steel slabs. However, due to the poor quality of spraying and various interferences, SMN detection is a major challenge for subsequent recognition in the steel-slab product line. This paper proposes a corner-clustering method, which can extract the SMN from a changeable background precisely and promptly. In our method, the FAST algorithm is modified to extract the image corners by adaptively adjusting the local threshold of corner detecting with the change of image contrast. Then, the DBSCAN algorithm is implemented to group the corners into several clusters, which includes the SMN regions and interference regions. Finally, a classifier based on HOG features and SVM is applied to discriminate SMN and non-SMN regions. For experimental validation, the proposed method was implemented to a substantial amount of acquired images. A good performance has been achieved as the detection accuracy can reach as high as 98.96% for SMN on the steel slabs.
Similar content being viewed by others
References
Wei, L., Cui, W., Hu, Z., Sun, H., Hou, S.: A single-shot multi-level feature reused neural network for object detection. Vis. Comput. 1–10 (2020)
Sharma, R.P., Dey, S.: Fingerprint liveness detection using local quality features. Vis. Comput. 35(10), 1393–1410 (2019)
Ye, Q., Doermann, D.: Text detection and recognition in imagery: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 37(7), 1480–1500 (2014)
Lin, H., Yang, P., Zhang, F.: Review of scene text detection and recognition. Arch. Comput. Methods Eng. 1–22 (2019)
Yi, C., Tian, Y.: Localizing text in scene images by boundary clustering, stroke segmentation, and string fragment classification. IEEE Trans. Image Process. 21(9), 4256–4268 (2012)
Chen, X., Yuille, A.L: Detecting and reading text in natural scenes. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2004., vol. 2, pp. II–II. IEEE (2004)
Kim, K.I., Jung, K., Kim, J.H.: Texture-based approach for text detection in images using support vector machines and continuously adaptive mean shift algorithm. IEEE Trans. Pattern Anal. Mach. Intell. 25(12), 1631–1639 (2003)
Mosleh, A., Bouguila, N., Hamza, A.B.: Image text detection using a bandlet-based edge detector and stroke width transform. In: BMVC, pp. 1–12 (2012)
Koo, H.I., Kim, D.H.: Scene text detection via connected component clustering and nontext filtering. IEEE Trans. Image Process. 22(6), 2296–2305 (2013)
Yi, C., Tian, Y.: Text extraction from scene images by character appearance and structure modeling. Comput. Vis. Image Understanding 117(2), 182–194 (2013)
Liu, X., Li, C., Zhu, H., Wong, T.-T., Xuemiao, X.: Text-aware balloon extraction from manga. Vis. Comput. 32(4), 501–511 (2016)
Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 580–587 (2014)
Zhou, X., Yao, C., Wen, H., Wang, Y., Zhou, S., He, W., Liang, J.: East: an efficient and accurate scene text detector. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5551–5560 (2017)
Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: Unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779–788 (2016)
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., Berg, A.C: Ssd: single shot multibox detector. In: European Conference on Computer Vision, pp. 21–37. Springer (2016)
Jaderberg, M., Simonyan, K., Vedaldi, A., Zisserman, A.: Reading text in the wild with convolutional neural networks. Int. J. Comput. Vis. 116(1), 1–20 (2016)
Liao, M., Shi, B., Bai, X., Wang, X., Liu, W.: Textboxes: a fast text detector with a single deep neural network. In: Thirty-First AAAI Conference on Artificial Intelligence (2017)
Liao, M., Zhu, Z., Shi, B., Xia, G.-s., Bai, X.: Rotation-sensitive regression for oriented scene text detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5909–5918 (2018)
Hui, W., Zou, B., Zhao, Y., Guo, J.: Scene text detection using adaptive color reduction, adjacent character model and hybrid verification strategy. Vis. Comput. 33(1), 113–126 (2017)
Jiang, W.: The application of image recognition based on bp neural networks in automatic steel rolling. Adv. Mater. Res. 764, 161–164 (2013)
Zhao, Q.J., Huang, C.H., Ke, Z.N., Yi, J.G.: Recognition results classification and post-processing methods for painted characters on billet surface. Adv. Manuf. 5(3), 261–270 (2017)
Astafiev, A.V., Orlov, A.A., Provotorov, A.V., Privezentsev, D.G.: Development of the automatic marking identification system based on two-stage visual recognition of metal-rolling billets. In: 2016 Dynamics of Systems, Mechanisms and Machines (Dynamics), pp. 1–4. IEEE (2016)
Lee, S.J., Kim, S.W.: Localization of the slab information in factory scenes using deep convolutional neural networks. Expert Syst. Appl. 77, 34–43 (2017)
Choi, S.H., Yun, J.P., Koo, K., Kim, S.W.: Localizing slab identification numbers in factory scene images. Expert Syst. Appl. 39(9), 7621–7636 (2012)
Hanyu, H., Zhejun, Y., Xiuhua, Z.: Detection of billet character in complex production line scene. In: 2012 Third International Conference on Digital Manufacturing & Automation, pp. 331–334. IEEE (2012)
Choi, S.H., Yun, J.P., Sang, W.K.: Text localization and character segmentation algorithms for automatic recognition of slab identification numbers. Opt. Eng. 48(3), 037206 (2009)
Lee, S.J., Kwon, W., Koo, G., Choi, H., Kim, S.W.: Recognition of slab identification numbers using a fully convolutional network. ISIJ Int. 58(4), 696–703 (2018)
Koo, G., Yun, J.P., Lee, S.J., Choi, H., Kim, S.W.: End-to-end billet identification number recognition system. ISIJ Int. 59(1), 98–103 (2019)
Lee, S.J., Kim, S.W., Kwon, W., Koo, G., Yun, J.P.: Selective distillation of weakly annotated gtd for vision-based slab identification system. IEEE Access 7, 23177–23186 (2019)
Rosten, E., Drummond, T.: Machine learning for high-speed corner detection. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) Computer Vision: ECCV 2006, pp. 430–443. Springer, Berlin (2006)
Ester, M., Kriegel, H.-P., Sander, J., Xiaowei, X., et al.: A density-based algorithm for discovering clusters in large spatial databases with noise. Kdd 96, 226–231 (1996)
Schubert, E., Sander, J., Ester, M., Kriegel, H.P., Xu, X.: Dbscan revisited, revisited: Why and how you should (still) use dbscan. ACM Trans. Database Syst. (TODS) 42(3), 1–21 (2017)
Freeman, W.T, Roth, M.: Orientation histograms for hand gesture recognition. In: International Workshop on Automatic Face and Gesture Recognition, vol. 12, pp. 296–301 (1995)
Farid, H.: Blind inverse gamma correction. IEEE Trans. Image Process. 10(10), 1428–1433 (2001)
Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)
Fang, Y., Yamada, K., Ninomiya, Y., Horn, B.K.P., Masaki, I.: A shape-independent method for pedestrian detection with far-infrared images. IEEE Trans. Veh. Technol. 53(6), 1679–1697 (2004)
Baskan, S., Bulut, M.M., Atalay, V.: Projection based method for segmentation of human face and its evaluation. Pattern Recogn. Lett. 23(14), 1623–1629 (2002)
Rowley, H.A, Baluja, S., Kanade, T.: Human face detection in visual scenes. In: Advances in Neural Information Processing Systems, pp. 875–881 (1996)
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection (2005)
Noh, S., Shim, D., Jeon, M.: Adaptive sliding-window strategy for vehicle detection in highway environments. IEEE Trans. Intell. Transp. Syst. 17(2), 323–335 (2016)
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
Yiping Peng, Junhui Ge, Hui Qin, Xiaojun Ge, and Changyan Xiao declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Peng, Y., Ge, J., Qin, H. et al. A corner-clustering method for detection of slab management numbers sprayed on steel slabs. Vis Comput 38, 357–369 (2022). https://doi.org/10.1007/s00371-020-02019-9
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-020-02019-9