Abstract
Object detection refers to computer vision technology that identifies the class and location of objects in an image. With the development of deep-learning techniques, object detection has been widely studied in the construction industry and has mainly focused on detecting heavy equipment and workers at outdoor sites. Therefore, an object detection model for small tools in indoor sites, where various accidents frequently occur owing to them, is required to enhance safety. In particular, many high-quality image databases are important for developing object detection approaches for small tools. In this study, 12 small tools commonly used in indoor construction were selected, and a database of 34,738 images of the selected tools was created and used to train the object detection models. YOLOv5x and YOLOv5s are selected as object detection models, for which the mean average precision with the 0.5 intersection-over-union value were 69.1% and 64.4%, respectively, and their frame rates were 58.82 and 142.86 frame per second, respectively. The results demonstrate that the established database is appropriate for the development of object detection for small tools and that object detection can be used for real-time safety management of construction indoor sites.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Azar ER, McCabe B (2012) Part based model and spatial-temporal reasoning to recognize hydraulic excavators In construction Images and videos. Automation in Construction 24:194–202, DOI: https://doi.org/10.1016/j.autcon.2012.03.003
Cho JH (2011) A study on the causes analysis and preventive measures by disaster types in construction fields. Proceedings of 2011 Conference of Korea Safety Management & Science 23–34
Fang W, Ding L, Luo H, Love PE (2018a) Falls from heights: A computer vision-based approach for safety harness detection. Automation in Construction 91:53–61, DOI: https://doi.org/10.1016/j.autcon.2018.02.018
Fang Q, Li H, Luo X, Ding L, Luo H, Rose TM, An W (2018b) Detecting non-hardhat-use by a deep learning method from far-field surveillance videos. Automation in Construction 85:1–9, DOI: https://doi.org/10.1016/j.autcon.2017.09.018
Froese TM (2010) The impact of emerging information technology on project management for construction. Automation in Construction 19(5):531–538, DOI: https://doi.org/10.1016/j.autcon.2009.11.004
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 770–778
Jung SH, Lee GH, An KI, Lim SI, Kang KS (2009) A study on the situation of disasters and characters of technical construction firms. Journal of the Korea Safety Management & Science 11(4):93–109
Kim E (2015) Proposal of standards for the structure and construction method of indoor architecture for the prevention of safety accidents. Auri Brief, No. 110, Architecture & Urban Research Institute
Kim H, Kim K, Kim H (2016) Data-driven scene parsing method for recognizing construction site objects in the whole image. Automation in Construction 71:271–282, DOI: https://doi.org/10.1016/j.autcon.2016.08.018
LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553): 436–444, DOI: https://doi.org/10.1038/nature14539
Lee BJ (2014) RGB-DT Face recognition using convolutional-recursive deep learning. 2014 Korean Institute of Information Scientists and Engineers the 41st Annual Meeting and Winter Conference 616–618
Lee SH (2018) A method for determining face recognition suitability of face image. Journal of the Korea Academia-Industrial Cooperation Society 19(11):295–302, DOI: https://doi.org/10.5762/KAIS.2018.19.11.295
Lee K, Byun N, Shin DH (2020) A damage localization approach for rahmen bridge based on convolutional neural network. KSCE Journal of Civil Engineering 24(1):1–9, DOI: https://doi.org/10.1007/s12205-020-0707-9
Lee K, Hwang J, Jeon C, Eizan MM, Bitangjol AJ, Shin D (2022) Image dataset for object detection of small size construction tools. Zenodo repository web site, DOI: https://doi.org/10.5281/zenodo.6530106
Luo X, Li H, Cao D, Dai F, Seo J, Lee S (2018) Recognizing diverse construction activities in site images via relevance networks of construction-related objects detected by convolutional neural networks. Journal of Computing in Civil Engineering 32(3):04018012, DOI: https://doi.org/10.1061/(ASCE)CP.1943-5487.0000756
Memarzadeh M, Golparvar-Fard M, Niebles JC (2013) Automated 2D detection of construction equipment and workers from site video streams using histograms of oriented gradients and colors. Automation in Construction 32:24–37, DOI: https://doi.org/10.1016/j.autcon.2012.12.002
Ministry of Land, Infrastructure and Transport (2018) Construction standard specifications for building works. MOLIT, Sejong-si, Korea
Ministry of Land, Infrastructure and Transport (MOLIT) (2019) Standard of construction estimate. MOLIT, Sejong-si, Korea
Moon HM, Pan SB (2013) Performance analysis of face recognition by distance according to image normalization and face recognition algorithm. Journal of the Korea Institute of Information Security & Cryptology 23(4):737–742, DOI: https://doi.org/10.13089/JKIISC.2013.23.4.737
Paperswithcode (2020) State-of-the-art Object Detection, Retrieved July 13, 2020, https://paperswithcode.com
Park MW, Brilakis I (2012) Construction worker detection in video frames for initializing vision trackers. Automation in Construction 28:15–25, DOI: https://doi.org/10.1016/j.autcon.2012.06.001
Seo J, Han S, Lee S, Kim H (2015) Computer vision techniques for construction safety and health monitoring. Advanced Engineering Informatics 29(2):239–251, DOI: https://doi.org/10.1016/j.aei.2015.02.001
Son H, Choi H, Seong H, Kim C (2019) Detection of construction workers under varying poses and changing background in image sequences via very deep residual networks. Automation in Construction 99:27–38, DOI: https://doi.org/10.1016/j.autcon.2018.11.033
Wang CY, Liao HYM, Wu YH, Chen PY, Hsieh JW, Yeh IH (2020) CSPNet: A new backbone that can enhance learning capability of CNN. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops 390–391
Xie S, Girshick R, Dollár P, Tu Z, He K (2017) Aggregated residual transformations for deep neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 1492–1500
Yang Z, Yuan Y, Zhang M, Zhao X, Zhang Y, Tian B (2019) Safety distance identification for crane drivers based on mask R-CNN. Sensors 19(12):2789, DOI: https://doi.org/10.3390/s19122789
Zhao Y, Chen Q, Cao W, Yang J, Xiong J, Gui G (2019) Deep learning for risk detection and trajectory tracking at construction sites. IEEE Access 7:30905–30912, DOI: https://doi.org/10.1109/ACCESS.2019.2902658
Zhao J, Obonyo E (2020) Convolutional long short-term memory model for recognizing construction workers’ postures from wearable inertial measurement units. Advanced Engineering Informatics 46:101177, DOI: https://doi.org/10.1016/j.aei.2020.101177
Acknowledgments
This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MEST) (No. NRF-2019R1A2C1088824).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Lee, K., Jeon, C. & Shin, D.H. Small Tool Image Database and Object Detection Approach for Indoor Construction Site Safety. KSCE J Civ Eng 27, 930–939 (2023). https://doi.org/10.1007/s12205-023-1011-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12205-023-1011-2