This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Automatic Segmentation of Aircraft Dents in Point Clouds (SAE Paper 2022-01-0022)
Technical Paper
2022-01-0022
ISSN: 0148-7191, e-ISSN: 2688-3627
Annotation ability available
Sector:
Event:
AeroTech® Digital Summit
AeroTech
Language:
English
Abstract
Dents on the aircraft skin are frequent and may easily go undetected during airworthiness checks, as their inspection process is tedious and extremely subject to human factors and environmental conditions. Nowadays, 3D scanning technologies are being proposed for more reliable, human-independent measurements, yet the process of inspection and reporting remains laborious and time consuming because data acquisition and validation are still carried out by the engineer. For full automation of dent inspection, the acquired point cloud data must be analysed via a reliable segmentation algorithm, releasing humans from the search and evaluation of damage. This paper reports on two developments towards automated dent inspection. The first is a method to generate a synthetic dataset of dented surfaces to train a fully convolutional neural network. The training of machine learning algorithms needs a substantial volume of dent data, which is not readily available. Dents are thus simulated in random positions and shapes, within criteria and definitions of a Boeing 737 structural repair manual. The noise distribution from the scanning apparatus is then added to reflect the complete process of 3D point acquisition on the training. The second proposition is a surface fitting strategy to convert 3D point clouds to 2.5D. This allows higher resolution point clouds to be processed with a small amount of memory compared with state-of-the-art methods involving 3D sampling approaches. Simulations with available ground truth data show that the proposed technique reaches an intersection-over-union of over 80%. Experiments over dent samples prove an effective detection of dents with a speed of over 500 000 points per second.
Authors
Topic
Citation
Lafiosca, P., Fan, I., and Avdelidis, N., "Automatic Segmentation of Aircraft Dents in Point Clouds (SAE Paper 2022-01-0022)," SAE Technical Paper 2022-01-0022, 2022, https://doi.org/10.4271/2022-01-0022.Also In
References
- Authority , C.A. CAP 716 - Aviation Maintenance Human Factors 2003
- Authority , C.A. Paper 2013/03 - Reliability of Damage Detection in Advanced Composite Aircraft Structures 2013
- Coffey , V.C. Machine Vision: The Eyes of Industry 4.0 Optics and Photonics News 29 7 2018 42 49
- Ronneberger O. , Fischer P. , and Brox T. U-net: Convolutional Networks for Biomedical Image Segmentation International Conference on Medical Image Computing and Computer-Assisted Intervention 2015
- Xie , Y. , Tian , J. , and Zhu , X.X. Linking Points with Labels in 3d: A Review of Point Cloud Semantic Segmentation IEEE Geoscience and Remote Sensing Magazine 2020
- Jovančević , I. , Pham , H.-H. , Orteu , J.-J. , Gilblas , R. et al. 3d Point Cloud Analysis for Detection and Characterization of Defects on Airplane Exterior Surface Journal of Nondestructive Evaluation 2017
- Bouarfa , S. , Dogru , A. , Arizar , R. , Aydogan , R. , and Serafico , J. Towards Automated Aircraft Maintenance Inspection. A Use Case of Detecting Aircraft Dents Using Mask r-cnn AIAA Scitech 2020 Forum 2020
- He , K. , Gkioxari , G. , Dollár , P. , and Girshick , R. Mask r-cnn Proceedings of the IEEE International Conference on Computer Vision 2017
- Park , S.H. , Tjolleng , A. , Chang , J. , Cha , M. et al. Detecting and Localizing Dents on Vehicle Bodies Using Region-Based Convolutional Neural Network Applied Sciences .
- Riegler , G. , Osman Ulusoy , A. , and Geiger , A. Octnet: Learning deep 3d Representations at High Resolutions Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2017
- Rethage , D. , Wald , J. , Sturm , J. , Navab , N. , and Tombari , F. Fully-Convolutional Point Networks for Large-Scale Point Clouds Proceedings of the European Conference on Computer Vision (ECCV) 2018
- Qi C.R. , Su H. , Mo K. , and Guibas L.J. Pointnet: Deep Learning on Point Sets for 3d Classification and Segmentation Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2017
- Qi , C.R. , Yi , L. , Su , H. , and Guibas , L.J. arXiv preprint arXiv:1706.02413 2017
- Liu , Z. , Tang , H. , Lin , Y. , and Han , S. arXiv preprint arXiv:1907.03739 2019
- Guo , Y. , Wang , H. , Hu , Q. , Liu , H. et al. Deep Learning for 3d Point Clouds: A Survey IEEE Transactions on Pattern Analysis and Machine Intelligence 2020
- The Boeing Company Structural Repair Manual B737-400 2015
- Kang , S. On Effectiveness of Transfer Learning Approach for Neural Network-Based Virtual Metrology Modeling IEEE Transactions on Semiconductor Manufacturing 2018
- Tian , Y. , Li , X. , Wang , K. , and Wang , F.-Y. Training and Testing Object Detectors with Virtual Images IEEE/CAA Journal of Automatica Sinica 2018
- Feng , S. , Zuo , C. , Zhang , L. , Tao , T. et al. Calibration of Fringe Projection Profilometry: A Comparative Review Optics and Lasers in Engineering 2021
- Lafiosca , P. , Fan , I.-S. , and Avdelidis , N.P. Automated Aircraft Dent Inspection Via a Modified Fourier Transform Profilometry Algorithm Sensors 2022
- Santurkar S. , Tsipras D. , Ilyas A. , and Mądry A. How Does Batch Normalization Help Optimization? Proceedings of the 32nd International Conference on Neural Information Processing Systems 2018