Abstract
Glass has been widely used in the construction sector with various kinds of applications in recent decades. However, the surface scratches generated from manufacturing process and service stage such as windborne debris impacts may lead to a strength degradation of glass material. The microscopic cracks propagation from such scratches may hence trigger glass facture unexpectedly and yield serious safety problems. In order to detect the glass damage due to such scratches, traditional manual inspection techniques have many limitations. The latest development of deep learning technology has rendered the possibility to automate such damage detection process. However, most detection methods use bounding box to roughly locate the damage in grid-cell level. To precisely describe the location of scratches, a pixel-level instance segmentation Mask R-CNN model is proposed. A total number of 1032 images with scratches are collected by a microscopic camera system to build the training and validation dataset, in which the scratches are annotated manually in pixel level. Data augmentation is adopted to improve the diversity of the dataset. During the training process, transfer learning strategy is applied to obtain the feature parameters for reducing the computation cost. Test is then performed in new architectural glass panels to evaluate the performance of the model. Test results demonstrate that the proposed trained network is satisfactory, achieving a mean average precision of 96.5% and the detection missing rate of 1.9%.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Petit, F., Ott, C., Cambier, F.: Multiple scratch tests and surface-related fatigue properties of monolithic ceramics and soda lime glass. J. Eur. Ceram. Soc. 29(8), 1299–1307 (2009)
Schneider, J., Schula, S., Weinhold, W.: Characterisation of the scratch resistance of annealed and tempered architectural glass. Thin Solid Films 520(12), 4190–4198 (2012)
Abdel-Qader, I., Abudayyeh, O., Kelly, M.E.: Analysis of edge-detection techniques for crack identification in bridges. J. Comput. Civil Eng. 17(4), 255–263 (2003)
Yeum, C.M., Dyke, S.J.: Vision-based automated crack detection for bridge inspection. Comput. Aided Civil Infrastruct. Eng. 30(10), 759–770 (2015)
Beck, A., Teboulle, M.: Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems. IEEE Trans. Image Process. 18(11), 2419–2434 (2009)
LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. In: Proceedings of the IEEE, vol. 86, pp. 2278–2324. IEEE (1998)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Proceedings of the Neural Information Processing Systems Conference, Stateline, NV (2012)
LeCun, Y.A., Bengio, Y., Hinton, G.E.: Deep learning. Nature 521, 436–444 (2015)
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39(6), 1137–1149 (2017)
Redmon, J., Farhadi, A.: Yolov3: an incremental improvement, arXiv:1804.02767 (2018)
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., Berg, A.C.: SSD: single shot multibox detector. In: European Conference on Computer Vision, pp. 21–37. Springer (2016)
Cha, Y.J., Choi, W., Büyüköztürk, O.: Deep learning-based crack damage detection using convolutional neural networks. Comput.-Aided Civil Infrast. Eng. 32(5), 361–378 (2017)
Beckman, G.H., Polyzois, D., Cha, Y.-J.: Deep learning-based automatic volumetric damage quantification using depth camera. Autom. Constr. 99, 114–124 (2019)
Cha, Y.J., Choi, W., Suh, G., Mahmoudkhani, S., Büyüköztürk, O.: Autonomous structural visual inspection using region-based deep learning for detecting multiple damage types. Comput.-Aided Civil Infrastr. Eng. 33(9), 731–747 (2018)
Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)
Yang, X., Li, H., Yu, Y., Luo, X., Huang, T., Yang, X.: Automatic pixel-level crack detection and measurement using fully convolutional network. Comput.-Aided Civil Infrastr. Eng. 33(12), 1090–1109 (2018)
Liu, Z., Cao, Y., Wang, Y., Wang, W.: Computer vision-based concrete crack detection using U-net fully convolutional networks. Autom. Constr. 104, 129–139 (2019)
He, K., Gkioxari, G., Dollar, P., Girshick. R.: Mask R‐CNN. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), pp. 2980–2988 (2017)
Wei, F., Yao, G., Yang, Y., Sun, Y.: Instance-level recognition and quantification for concrete surface bughole based on deep learning. Autom. Constr. 107, 102920 (2019)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, 12 December 2016, pp. 770–778 (2016)
Lin, T.Y., Dollár, P., Girshick, R., He, K., Hariharan, B., Belongie, S.: Feature pyramid networks for object detection. In: Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, pp. 936–944 (2017)
Girshick, R.: Fast R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile, pp. 1440–48 (2015)
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al.: Tensorflow: a system for largescale machine learning. OSDI 16, 265–283 (2016)
Acknowledgements
This work was supported by the National Key Research and Development Program of China [Grant No. 2017YFC0806100], the National Natural Science Foundation of China [Grant No. 51908352] and the Science Research Plan of Shanghai Municipal Science and Technology Committee [Grant No. 18DZ1205603].
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Pan, Z., Yang, J., Wang, Xe., Liu, J., Li, J. (2021). Surface Scratch Detection of Monolithic Glass Panel Using Deep Learning Techniques. In: Toledo Santos, E., Scheer, S. (eds) Proceedings of the 18th International Conference on Computing in Civil and Building Engineering. ICCCBE 2020. Lecture Notes in Civil Engineering, vol 98. Springer, Cham. https://doi.org/10.1007/978-3-030-51295-8_12
Download citation
DOI: https://doi.org/10.1007/978-3-030-51295-8_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-51294-1
Online ISBN: 978-3-030-51295-8
eBook Packages: EngineeringEngineering (R0)