Skip to main content
Log in

Assessing compressive strengths of mortar and concrete from digital images by machine learning techniques

  • Research Article
  • Published:
Frontiers of Structural and Civil Engineering Aims and scope Submit manuscript

Abstract

Compressive strength is the most important metric of concrete quality. Various nondestructive and semi-destructive tests can be used to evaluate the compressive strength of concrete. In the present study, a new image-based machine learning method is used to predict concrete compressive strength, including evaluation of six different models. These include support-vector machine model and various deep convolutional neural network models, namely AlexNet, GoogleNet, VGG19, ResNet, and Inception-ResNet-V2. In the present investigation, cement mortar samples were prepared using each of the cement:sand ratios of 1:3, 1:4, and 1:5, and using the water:cement ratios of 0.35 and 0.55. Cement concrete was prepared using the cement:sand:coarse aggregate ratios of 1:5:10, 1:3:6, 1:2:4, 1:1.5:3 and 1:1:2, using the water:cement ratio of 0.5 for all samples. The samples were cut, and several images of the cut surfaces were captured at various zoom levels using a digital microscope. All samples were then tested destructively for compressive strength. The images and corresponding compressive strength were then used to train machine learning models to allow them to predict compressive strength based upon the image data. The Inception-ResNet-V2 models exhibited the best predictions of compressive strength among the models tested. Overall, the present findings validated the use of machine learning models as an efficient means of estimating cement mortar and concrete compressive strengths based on digital microscopic images, as an alternative nondestructive/semi-destructive test method that could be applied at relatively less expense.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Breysse D, Romão X, Alwash M, Sbartaï Z M, Luprano V A M. Risk evaluation on concrete strength assessment with NDT technique and conditional coring approach. Journal of Building Engineering, 2020, 32: 101541

    Article  Google Scholar 

  2. Jafari S, Rots J G, Esposito R. Core testing method to assess nonlinear shear-sliding behaviour of brick-mortar interfaces: A comparative experimental study. Construction & Building Materials, 2020, 244: 118236

    Article  Google Scholar 

  3. Guo H, Zhuang X, Rabczuk T. A deep collocation method for the bending analysis of Kirchhoff plate. Computers, Materials & Continua, 2019, 59(2): 433–456

    Article  Google Scholar 

  4. Anitescu C, Atroshchenko E, Alajlan N, Rabczuk T. Artificial neural network methods for the solution of second order boundary value problems. Computers, Materials & Continua, 2019, 59(1): 345–359

    Article  Google Scholar 

  5. Herzog S, Tetzlaff C, Wörgötter F. Evolving artificial neural networks with feedback. Neural Networks, 2020, 123: 153–162

    Article  Google Scholar 

  6. Haftkhani A R, Abdoli F, Sepehr A, Mohebby B. Regression and ANN models for predicting MOR and MOE of heat-treated fir wood. Journal of Building Engineering, 2021, 42: 102788

    Article  Google Scholar 

  7. Martini R, Carvalho J, Arêde A, Varum H. Validation of nondestructive methods for assessing stone masonry using artificial neural networks. Journal of Building Engineering, 2021, 42: 102469

    Article  Google Scholar 

  8. Niu X X, Suen C Y. A novel hybrid CNN-SVM classifier for recognizing handwritten digits. Pattern Recognition, 2012, 45(4): 1318–1325

    Article  Google Scholar 

  9. Derman E, Salah A A. Continuous real-time vehicle driver authentication using convolutional neural network based face recognition. In: 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018). Xi’an: IEEE, 2018: 577–584

    Chapter  Google Scholar 

  10. Ebrahimi M, Khoshtaghaza M, Minaei S, Jamshidi B. Vision-based pest detection based on SVM classification method. Computers and Electronics in Agriculture, 2017, 137: 52–58

    Article  Google Scholar 

  11. Arnal Barbedo J G. Digital image processing techniques for detecting, quantifying and classifying plant diseases. SpringerPlus, 2013, 2(1): 1–12

    Article  Google Scholar 

  12. Xu G, Zhang F, Shah S G, Ye Y, Mao H. Use of leaf color images to identify nitrogen and potassium deficient tomatoes. Pattern Recognition Letters, 2011, 32(11): 1584–1590

    Article  Google Scholar 

  13. Nugraha B T, Su S F. Towards self-driving car using convolutional neural network and road lane detector. In: 2017 2nd International Conference on Automation, Cognitive Science, Optics, Micro Electro-mechanical System, and Information Technology (ICACOMIT). Jakarta: IEEE, 2017: 65–69

    Google Scholar 

  14. Sun W, Tseng T L B, Zhang J, Qian W. Enhancing deep convolutional neural network scheme for breast cancer diagnosis with unlabeled data. Computerized Medical Imaging and Graphics, 2017, 57: 4–9

    Article  Google Scholar 

  15. Dabeer S, Khan M M, Islam S. Cancer diagnosis in histopathological image: CNN based approach. Informatics in Medicine Unlocked, 2019, 16: 100231

    Article  Google Scholar 

  16. Parashar J, Sumiti, Rai M. Breast cancer images classification by clustering of ROI and mapping of features by CNN with XGBOOST learning. Materials Today: Proceedings, 2020: 1–9

  17. Gopalakrishnan K, Khaitan S K, Choudhary A, Agrawal A. Deep Convolutional Neural Networks with transfer learning for computer vision-based data-driven pavement distress detection. Construction & Building Materials, 2017, 157: 322–330

    Article  Google Scholar 

  18. Hoang N D, Nguyen Q L. A novel method for asphalt pavement crack classification based on image processing and machine learning. Engineering with Computers, 2019, 35(2): 487–498

    Article  Google Scholar 

  19. Lin Y Z, Nie Z H, Ma H W. Structural damage detection with automatic feature-extraction through deep learning. Computer-Aided Civil and Infrastructure Engineering, 2017, 32(12): 1025–1046

    Article  Google Scholar 

  20. Cha Y, Choi W, Büyüköztürk O. Deep learning-based crack damage detection using convolutional neural networks. Computer-Aided Civil and Infrastructure Engineering, 2017, 32(5): 361–378

    Article  Google Scholar 

  21. Başyiğit C, Çomak B, Kilinçarslan S, Serkan Üncü I. Assessment of concrete compressive strength by image processing technique. Construction & Building Materials, 2012, 37: 526–532

    Article  Google Scholar 

  22. Dogan G, Arslan M H, Ceylan M. Concrete compressive strength detection using image processing based new test method. Measurement, 2017, 109: 137–148

    Article  Google Scholar 

  23. Jang Y, Ahn Y, Kim H Y. Estimating compressive strength of concrete using deep convolutional neural networks with digital microscope images. Journal of Computing in Civil Engineering, 2019, 33(3): 04019018

    Article  Google Scholar 

  24. Lecun Y, Bottou L, Bengio Y, Haffner P. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 1998, 86(11): 2278–2324

    Article  Google Scholar 

  25. Han D, Liu Q, Fan W. A new image classification method using CNN transfer learning and web data augmentation. Expert Systems with Applications, 2018, 95: 43–56

    Article  Google Scholar 

  26. Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. 2015, arxiv: 1409.1556

  27. Lowe D G. Object recognition from local scale-invariant features. Proceedings of the seventh IEEE International Conference on Computer Vision, 1999, 2: 1150–1157

    Article  Google Scholar 

  28. Krizhevsky A, Sutskever I, Hinton G E. ImageNet classification with deep convolutional neural networks. Communications of the ACM, 2017, 60(6): 84–90

    Article  Google Scholar 

  29. Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M, Berg A C, Fei-Fei L. ImageNet large scale visual recognition challenge. International Journal of Computer Vision, 2015, 115(3): 211–252

    Article  MathSciNet  Google Scholar 

  30. Mathworks. GoogLeNet convolutional neural network—MATLAB googlenet—MathWorks Benelux. 2021 (available at the website of Mathworks)

  31. He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Las Vegas, NV: IEEE, 2016: 770–778

    Google Scholar 

  32. Szegedy C, Ioffe S, Vanhoucke V, Alemi A A. Inception-V4, Inception-ResNet and the impact of residual connections on learning. In: Proceedings of the AAAI Conference on Artificial Intelligence. Palo Alto, CA: AAAI Press, 2017: 4278–4284

    Google Scholar 

  33. Mathworks. Pretrained Inception-ResNet-v2 convolutional neural network—MATLAB inceptionresnetv2—MathWorks América Latina. 2021 (available at the website of Mathworks)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Amit Shiuly.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shiuly, A., Dutta, D. & Mondal, A. Assessing compressive strengths of mortar and concrete from digital images by machine learning techniques. Front. Struct. Civ. Eng. 16, 347–358 (2022). https://doi.org/10.1007/s11709-022-0819-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11709-022-0819-z

Keywords

Navigation