Skip to main content
SpringerLink
Log in

Deep Convolution Neural Network-Based Crack Feature Extraction, Detection and Quantification

  • Technical Article---Peer-Reviewed
  • Published:
Journal of Failure Analysis and Prevention Aims and scope Submit manuscript

Abstract

Timely crack detection and evaluation is essential to prevent the further deterioration of the structural damage, and convolutional neural networks (CNNs) have potential applications due to their powerful feature extraction capability. Therefore, this paper employs some well-known CNN models to detect cracks and reveal the extraction features of the CNN. Subsequently, a state-of-the-art pixel-level segmentation CNN (DeepLab_v3+) was employed for crack segmentation, and the physical properties (the length and width, and so on) of the cracks were calculated according to the segmentation results. The results confirm that the CNN can effectively extract the features of different categories of cracks, and the transferred SqueezeNet has the best performance in the classification of the cracks, with competitive computational speed and accuracy, and the CNN trained on concrete cracks can also effectively detect cracks in asphalt pavement and walls. DeepLab_v3+ can also achieve the ideal performance of cracks segmentation (the MIoU, accuracy and F-score were 0.80, 97.5 and 0.78%, respectively). Finally, the proposed quantization method based on MATLAB platform achieves the desired accuracy, and the average relative errors of the length, average width, maximum width, area and cracking ratio were 7, 2, 22, 27 and 27%, respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

References

  1. C. Koch et al., A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure. Adv. Eng. Inform. 29(2), 196–210 (2015)

    Article  Google Scholar 

  2. T. Nishikawa et al., Concrete crack detection by multiple sequential image filtering. Comput. Aided Civ. Infrastruct. Eng. 27(1), 29–47 (2012)

    Article  Google Scholar 

  3. S. Teng et al., Concrete crack detection based on well-known feature extractor model and the YOLO_v2 network. Appl. Sci. Basel. 11(2), 813 (2021)

    Article  CAS  Google Scholar 

  4. N.D. Hoang, An artificial intelligence method for asphalt pavement pothole detection using least squares support vector machine and neural network with steerable filter-based feature extraction. Adv. Civ. Eng. 4(12), 1–12 (2018)

    Google Scholar 

  5. Y. Shi et al., Automatic road crack detection using random structured forests. IEEE Trans. Intell. Transp. Syst. 17(12), 3434–3445 (2016)

    Article  Google Scholar 

  6. Y. Lu et al., Artificial neural network (ANN)-based crack identification in aluminum plates with lamb wave signals. J. Intell. Mater. Syst. Struct. 20(1), 39–49 (2008)

    Article  Google Scholar 

  7. L.Q. Pan et al., Eggshell crack detection based on computer vision and acoustic response by means of back-propagation artificial neural network. Eur. Food Res. Technol. 233(3), 457 (2011)

    Article  CAS  Google Scholar 

  8. A.A. Mohammed et al., Crack detection in a rotating shaft using artificial neural networks and PSD characterisation. Meccanica. 49(2), 255–266 (2014)

    Article  Google Scholar 

  9. R. Ince, Artificial neural network-based analysis of effective crack model in concrete fracture. Fatigue Fract. Eng. Mater. Struct. 33(9), 595–606 (2010)

    Google Scholar 

  10. R.H.A. Al-Sagheer, K.I. Mohammed, A.A.H. Mezher, Impact of crack length into pipe conveying fluid utilizing fast fourier transform computer algorithm. Int. J. Electr. Comput. Eng. 9(4), 2541–2547 (2019)

    Google Scholar 

  11. Y. Cha, W. Choi, O. Büyüköztürk, Deep learning-based crack damage detection using convolutional neural networks. Comput. Aided Civ. Infrastruct. Eng. 32(5), 361–378 (2017)

    Article  Google Scholar 

  12. L. Wang, L. Zhuang, Z. Zhang, Automatic detection of rail surface cracks with a superpixel-based data-driven framework. J. Comput. Civ. Eng. 33(1), 04018053 (2019)

    Article  Google Scholar 

  13. B. Li et al., Automatic classification of pavement crack using deep convolutional neural network. Int. J. Pavement Eng. 21(4), 457–463 (2020)

    Article  Google Scholar 

  14. Y. Liang et al., in Deep concrete inspection using unmanned aerial vehicle towards CSSC database. IEEE/RSJ international conference on intelligent robots and systems. Vancouver: BC (2017)

  15. C.M. Yeum, S.J. Dyke, J. Ramirez, Visual data classification in post-event building reconnaissance. Eng. Struct. 155(15), 16–24 (2018)

    Article  Google Scholar 

  16. Y. Xu et al., Automatic seismic damage identification of reinforced concrete columns from images by a region-based deep convolutional neural network. Struct. Control. Health Monit. 26(3), e2313 (2019)

    Article  Google Scholar 

  17. V.P. Tran et al., One stage detector (RetinaNet)-based crack detection for asphalt pavements considering pavement distresses and surface objects. J. Civ. Struct. Heal. Monit. 11, 205–222 (2021)

    Article  Google Scholar 

  18. C. Zhang, Cc. Chang, M. Jamshidi, Concrete bridge surface damage detection using a single-stage detector. Comput. Aided Civ. Infrastruct. Eng. 35(4), 389–409 (2019)

    Article  Google Scholar 

  19. J. Liu et al., Automated pavement crack detection and segmentation based on two-step convolutional neural network. Comput. Aided Civ. Infrastruct. Eng. 35(11), 1291–1305 (2020)

    Article  Google Scholar 

  20. M. Hiroya et al., Road damage detection and classification using deep neural networks with smartphone images. Comput. Aided Civ. Infrastruct. Eng. 33(12), 1127–1141 (2018)

    Article  Google Scholar 

  21. X. Yang et al., Automatic pixel-level crack detection and measurement using fully convolutional network. Comput. Aided Civ. Infrastruct. Eng. 33(12), 1090–1109 (2018)

    Article  Google Scholar 

  22. C.V. Dung, L.D. Anh, Autonomous concrete crack detection using deep fully convolutional neural network. Autom. Constr. 99, 52–58 (2019)

    Article  Google Scholar 

  23. S. Li, X. Zhao, G. Zhou, Automatic pixel-level multiple damage detection of concrete structure using fully convolutional network. Comput. Aided Civ. Infrastruct. Eng. 34(7), 616–634 (2019)

    Article  Google Scholar 

  24. S. Bang et al., Encoder–decoder network for pixel-level road crack detection in black-box images. Comput. Aided Civ. Infrastruct. Eng. 34, 713–727 (2019)

    Article  Google Scholar 

  25. Z. Liu et al., Computer vision-based concrete crack detection using U-net fully convolutional networks. Autom. Constr. 104, 129–139 (2019)

    Article  Google Scholar 

  26. L.C. Chen et al., in Encoder-decoder with atrous separable convolution for semantic image segmentation. Proceedings of the European conference on computer vision (ECCV) (2018)

  27. M. Goyal, A. Oakley, P. Bansal, D. Dancey, M.H. Yap, Skin lesion segmentation in dermoscopic images with ensemble deep learning methods. IEEE Access. 8, 4171–4181 (2019)

    Article  Google Scholar 

  28. S. Cheng, J. Ma, S. Zhang, Smoke detection and trend prediction method based on Deeplabv3+ and generative adversarial network. J. Electron. Imaging. 28(3), 033006 (2019)

    Article  Google Scholar 

  29. H. Wu, L. Yao, Z. Xu, Y. Li, X. Ao, Q. Chen, B. Meng, Road pothole extraction and safety evaluation by integration of point cloud and images derived from mobile mapping sensors. Adv. Eng. Inf. 42, 100936 (2019)

    Article  Google Scholar 

  30. A. Ji et al., An integrated approach to automatic pixel-level crack detection and quantification of asphalt pavement. Autom. Constr. 114, 103176 (2020)

    Article  Google Scholar 

  31. D. Dais et al., Automatic crack classification and segmentation on masonry surfaces using convolutional neural networks and transfer learning. Autom. Constr. 125, 103606 (2021)

    Article  Google Scholar 

  32. G. Yang et al., Automatic pavement type recognition for image-based pavement condition survey using convolutional neural network. J. Comput. Civ. Eng. 35(1), 04020060 (2021)

    Article  Google Scholar 

  33. S.S. Kumar et al., Automated defect classification in sewer closed circuit television inspections using deep convolutional neural networks. Autom. Constr. 91, 273–283 (2018)

    Article  Google Scholar 

  34. L. Chen et al., Rethinking atrous convolution for semantic image segmentation. preprint arXiv:17605587 (2017)

Download references

Author information

Authors and Affiliations

  1. School of Civil and Transportation Engineering, Guangdong University of Technology, Guangzhou, 510006, China

    Shuai Teng & Gongfa Chen

Authors
  1. Shuai Teng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gongfa Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gongfa Chen.

Ethics declarations

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Teng, S., Chen, G. Deep Convolution Neural Network-Based Crack Feature Extraction, Detection and Quantification. J Fail. Anal. and Preven. 22, 1308–1321 (2022). https://doi.org/10.1007/s11668-022-01430-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11668-022-01430-9

Keywords

Search

Navigation