Next Article in Journal
Textile Manufacturing Compatible Triboelectric Nanogenerator with Alternating Positive and Negative Woven Structure
Previous Article in Journal
Integrated BIM-Based LCA for Road Asphalt Pavements
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Abstract

Drone-Image Based Fast Crack Analysis Algorithm Using Machine Learning for Highway Pavements †

Civil and Environmental Engineering, University of Iowa, Iowa City, IA 52242, USA
*
Author to whom correspondence should be addressed.
Presented at the 1st International Online Conference on Infrastructures, 7–9 June 2022; Available online: https://ioci2022.sciforum.net/.
Eng. Proc. 2022, 17(1), 15; https://doi.org/10.3390/engproc2022017015
Published: 11 May 2022
(This article belongs to the Proceedings of The 1st International Online Conference on Infrastructures)

1. Introduction

Transportation agencies automatically collect and analyze pavement cracking data using agency-owned equipment and software or contracted services. These pavement cracking data are then used to determine the most appropriate maintenance and rehabilitation strategies to provide safe and reliable roadways [1]. However, this often requires high-cost equipment or services [2].
A digital image processing algorithm was developed to compute a unified crack index and crack type index [3,4]. A robust position invariant neural network was developed for digital pavement crack analysis [5]. The accuracy of automated pavement surface image analysis system has been evaluated against the ground-truth cracking data [6]. An image-based data collection procedure was then evaluated against the AASHTO provisional standard for cracking on asphalt-surfaced pavements [7].
Currently, ten state DOT’s are using drones for bridge inspection and six state DOT’s for pavement inspection [8]. Recently, there have been increased interests on automatically analyze drone images from integrators/service providers and end-users [9]. This paper presents a low-cost pavement distress data collection using a drone and subsequent drone image analysis using pavement crack analysis software.
This paper discusses state-of-the-art drone imaging technologies and advanced image analysis algorithms adopting advanced machine learning software tools. Drones were used to capture pavement surface images which were then analyzed using the crack image analysis software. This paper is timely given the increased new development in drone imaging technologies.

2. Methodology

Drone images were collected and a machine learning algorithm was developed for road segmentation and crack detection.
(1)
Data Set Preparation
Drone images of pavements were collected using a drone, which were then used for training for developing a machine learning algorithm. A second set of drone images were collected for validation of the developed machine learning algorithm.
(2)
Pavement Extraction from Drone Images
Drone images cover wide range of earth surface, and the first task is to extract pixels, which belong to pavements. To extract pavement pixels from drone images, a semantic segmentation method was used to develop a convolutional network architecture designed to accomplish the this first task.
(3)
Crack Detection
For a given crack image, a proposed machine learning algorithm was developed to yield a crack detection scheme, wherein the crack regions have a higher probability and non-crack regions have a lower probability. Figure 1 shows an example drone image acquisition and analysis result.

3. Summary and Conclusions

An increasing number of public agencies and companies are using drones for pavement inspection. Images can be automatically captured by a drone and stored in a point cloud for 3-D modeling. A DJI drone was used to capture pavement surface images in a high resolution at a low cost. Software was developed to analyze drone images and analysis results can be integrated with GIS software. In the future, an LiDAR camera can be mounted on a drone to measure a depth of cracks.

Author Contributions

Conceptualization, H.L.; methodology, B.M.; software, B.M.; validation, H.L.; formal analysis, H.L.; investigation, B.M.; resources, H.L.; data curation, B.M.; writing—original draft preparation, B.M.; writing—review and editing, H.L.; visualization, B.M.; supervision, H.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Wilde, W.J.; Thompson, L.; Wood, T.J. Cost-Effective Pavement Preservation Solutions for the Real World; (No. MN/RC 2014-33); Department of Transportation: Washington, DC, USA., 2014. [Google Scholar]
  2. Albitres CM, C.; Smith, R.E.; Pendleton, O.J. Comparison of automated pavement distress data collection procedures for local agencies in San Francisco Bay Area, California. Transp. Res. Rec. 2007, 1990, 119–126. [Google Scholar] [CrossRef] [Green Version]
  3. Jitprasithsiri, S.; Lee, H.; Sorcic, R.G. Development of Digital Image Processing Algorithm to Compute a Unified Crack Index for Salt Lake City. Transp. Res. Rec. 1996, 1526, 142–148. [Google Scholar] [CrossRef]
  4. Lee, B.J.; Lee, H. A Robust Position Invariant Neural Network for Digital Pavement Crack Analysis. In Computer-Aided Civil and Infrastructure Engineering; Blackwell Publishing: Hoboken, NJ, USA, 2004; Volume 19, pp. 105–118. [Google Scholar]
  5. Lee, H.; Kim, J. Development of crack type index. Transp. Res. Rec. 2005, 1940, 99–109. [Google Scholar] [CrossRef]
  6. Lee, H.; Kim, J. Analysis of Errors in Ground Truth Indicators for Evaluating the Accuracy of Automated Pavement Surface Image Collection and Analysis System for Asset Management. J. ASTM Int. 2006, 3, 1–15. [Google Scholar] [CrossRef]
  7. Raman, M.; Hossain, M.; Miller, R.; Cumberledge, G.; Lee, H.; Kang, K. Assessment of Image-Based data Collection and the AASHTO Provisional Standard for Cracking on Asphalt-Surfaced Pavements. Transp. Res. Rec. 2004, 1889, 116–125. [Google Scholar] [CrossRef]
  8. Fischer, S.; Lu, J.; Van Fossen, K.; Lawless, E. Global Benchmarking Study on Unmanned Aerial Systems for Surface Transportation: Domestic Desk Review; (No. FHWA-HIF-20-091); Federal Highway Administration: Washington, DC, USA, 2020. [Google Scholar]
  9. Mogawer, W.S.; Xie, Y.; Austerman, A.J.; Dill, C.; Jiang, L.; Gittings, J.E. The Application of Unmanned Aerial Systems In Surface Transportation-Volume II-B: Assessment of Roadway Pavement Condition with UAS; (No. 19-010); University of Massachusetts: Lowell, MA, USA, 2019. [Google Scholar]
Figure 1. Importing and Analyzing a Drone image.
Figure 1. Importing and Analyzing a Drone image.
Engproc 17 00015 g001
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Moon, B.; Lee, H. Drone-Image Based Fast Crack Analysis Algorithm Using Machine Learning for Highway Pavements. Eng. Proc. 2022, 17, 15. https://doi.org/10.3390/engproc2022017015

AMA Style

Moon B, Lee H. Drone-Image Based Fast Crack Analysis Algorithm Using Machine Learning for Highway Pavements. Engineering Proceedings. 2022; 17(1):15. https://doi.org/10.3390/engproc2022017015

Chicago/Turabian Style

Moon, Byungkyu, and Hosin (David) Lee. 2022. "Drone-Image Based Fast Crack Analysis Algorithm Using Machine Learning for Highway Pavements" Engineering Proceedings 17, no. 1: 15. https://doi.org/10.3390/engproc2022017015

Article Metrics

Back to TopTop