All Issue

2019 Vol.32, Issue 4 Preview Page
Bolt-Loosening Detection using Vision-Based Deep Learning Algorithm and Image Processing Method

영상기반 딥러닝 및 이미지 프로세싱 기법을 이용한 볼트풀림 손상 검출

So-Young Lee1
,
Thanh-Canh Huynh2
,
Jae-Hyung Park3
,
Jeong-Tae Kim1†
이 소 영1
,
현 탄 칸2
,
박 재 형3
,
김 정 태1†
1Department of Ocean Engineering, Pukyong National Univ., Busan, 48513, Korea
2Center for Construction, Mechanics and Materials, Institute of Research and Development, Duy Tan Univ., Danang, 550000, Vietnam
3Coastal and Structural Solution Co. Ltd., Busan, 48508, Korea
1부경대학교 해양공학과
2Duy Tan University
3(주)씨앤에스솔루션
†Corresponding author: Tel: +82-51-629-6585; E-mail: idis@pknu.ac.kr
2019. pp. 265-272
PDF XML Citation
Abstract

In this paper, a vision-based deep learning algorithm and image processing method are proposed to detect bolt-loosening in steel connections. To achieve this objective, the following approaches are implemented. First, a bolt-loosening detection method that includes regional convolutional neural network(RCNN)-based deep learning algorithm and Hough line transform(HLT)-based image processing algorithm are designed. The RCNN-based deep learning algorithm is developed to identify and crop bolts in a connection image. The HLT-based image processing algorithm is designed to estimate the bolt angles from the cropped bolt images. Then, the proposed vision-based method is evaluated for verifying bolt-loosening detection in a lab-scale girder connection. The accuracy of the RCNN-based bolt detector and HLT-based bolt angle estimator are examined with respect to various perspective distortions.

Keywords
bolt-loosening detection
vision
deep learning
RCNN
image processing
hough line transform

본 연구에서는 영상기반 딥러닝 및 이미지 프로세싱 기법을 이용한 볼트풀림 손상검출 기법을 제안하였다. 이를 위해 먼 저, 딥러닝 및 이미지 프로세싱 기반 볼트풀림 검출 기법을 설계하였다. 영상기반 볼트풀림 검출 기법은 볼트 이미지 검출 과정 및 볼트풀림 각도 추정 과정으로 구성된다. 볼트 이미지의 검출을 위하여 RCNN기반 딥러닝 알고리즘을 이용하였다. 영상의 원근왜곡 교정을 위해 호모그래피 개념을 이용하였으며 볼트풀림 각도를 추정을 위하여 Hough 변환을 이용하였다. 다음으로 제안된 기법의 성능을 검증을 위하여 거더의 볼트 연결부 모형을 대상으로 볼트풀림 손상검출 실험을 수행하였다. 다양한 원근 왜곡 조건에 대하여 RCNN 기반 볼트 검출기와 Hough 변환 기반 볼트풀림 각도 추정기의 성능을 검토하였다.

키워드
볼트풀림 검출
영상기반 딥러닝
RCNN
이미지 프로세싱
Hough 변환
호모그래피
References
1
KOSTAT (2019) E-nara index, http://www.index.go.kr/.
2
Abdeljaber, O., Avci, O., Kiranyaz, M.S., Boashash, B., Sodano, H., Inman, D.J. (2018) 1-D CNNs for Structural Damage Detection: Verification on a Structural Health Monitoring Benchmark Data, Neurocomput., 275, pp.1308~1317. 10.1016/j.neucom.2017.09.069
10.1016/j.neucom.2017.09.069
3
Cha, Y.J., Choi, W., Büyüköztürk, O. (2017) Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks, Comput.-Aided Civil &Infrastruct. Eng., 32(5), pp.361~378. 10.1111/mice.12263
10.1111/mice.12263
4
Cha, Y.J., You, K., Choi, W. (2016) Vision-based Detection of Loosened Bolts using the Hough Transform and Support Vector Machines, Autom. Constr., 71, pp.181~188. 10.1016/j.autcon.2016.06.008
10.1016/j.autcon.2016.06.008
5
Girshick, R., Donahue, J., Darrell, T., J. Malik, J. (2014) Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation, 2014 IEEE Conf. Comput. Vision &Pattern Recognit., Jun. 2014, Columbus, USA. 10.1109/CVPR.2014.81
10.1109/CVPR.2014.81
6
Gu, J., Wang, Z., Kuen, J., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X., Wang, L., Wang, G. (2015) Recent Advances in Convolutional Neural Networks, PatternRecognit., 77, pp.354~377. 10.1016/j.patcog.2017.10.013
10.1016/j.patcog.2017.10.013
7
Janssens, O., Slavkovikj, V., Vervisch, B., Stockman, K., Loccufier, M., Verstockt, S., Van de Walle, R., Van Hoecke, S. (2016) Convolutional Neural Network Based Fault Detection for Rotating Machinery, J. Sound &Vib., 377, pp.331~345. 10.1016/j.jsv.2016.05.027
10.1016/j.jsv.2016.05.027
8
Krizhevsky, A., Hinton, G. (2009) Learning Multiple Layers of Features from Tiny Images, Technical Report TR-2009, University of Toronto, Toronto.
9
Nguyen, T.C., Huynh, T.C., Ryu, J.Y., Park, J.H., Kim, J.T. (2016) Bolt-loosening Identification of Bolt Connections by Vision Image-based Technique, SPIE Smart Struct. &Mater. + Nondestruc. Eval. &Health Monit., Mar. 2016, Las Vegas, USA. 10.1117/12.2219055
10.1117/12.2219055
10
Park, J.H., Huynh, T.C., Choi, S.H., Kim, J.T. (2015) Vision-based Technique for Bolt-loosening Detection in Wind Turbine Tower, Wind &Struct., 21(6), pp.709~726. 10.12989/was.2015.21.6.709
10.12989/was.2015.21.6.709
11
Yang, S., Ho, C.C., Chen, J., Chang, C. (2012) Practical Homography-Based Perspective Correction Method for License plate Recognition, 2012 Int. Conf. Inf. Secur. &Intell. Control, Aug. 2012, Yunlin, Taiwan. 10.1109/ISIC.2012.6449740
10.1109/ISIC.2012.6449740
12
Zhao, X., Zhang, Y., Wang, N. (2019) Bolt Loosening Angle Detection Technology using Deep Learning, Struct. Control &Health Monit., 26(1). 10.1002/stc.2292
10.1002/stc.2292
Information
  • Publisher :Computational Structural Engineering Institute of Korea
  • Publisher(Ko) :한국전산구조공학회
  • Journal Title :Journal of the Computational Structural Engineering Institute of Korea
  • Journal Title(Ko) :한국전산구조공학회 논문집
  • Volume : 32
  • No :4
  • Pages :265-272
  • Received Date : 2019-07-08
  • Revised Date : 2019-07-28
  • Accepted Date : 2019-07-29
  • DOI :https://doi.org/10.7734/COSEIK.2019.32.4.265
Journal Informaiton Journal of the Computational Structural Engineering Institute of Korea Journal of the Computational Structural Engineering Institute of Korea
Online Submission
  • NRF
  • KOFST
  • crossref crossmark
  • crossref cited-by
  • crosscheck
  • orcid
  • open access
  • ccl
Journal Informaiton Journal Informaiton - close