20 June 2022 Learning deep domain-agnostic features from synthetic renders for industrial visual inspection
Author Affiliations +
Abstract

Deep learning has resulted in a huge advancement in computer vision. However, deep models require an enormous amount of manually annotated data, which is a laborious and time-consuming task. Large amounts of images demand the availability of target objects for acquisition. This is a kind of luxury we usually do not have in the context of automatic inspection of complex mechanical assemblies, such as in the aircraft industry. We focus on using deep convolutional neural networks (CNN) for automatic industrial inspection of mechanical assemblies, where training images are limited and hard to collect. Computer-aided design model (CAD) is a standard way to describe mechanical assemblies; for each assembly part we have a three-dimensional CAD model with the real dimensions and geometrical properties. Therefore, rendering of CAD models to generate synthetic training data is an attractive approach that comes with perfect annotations. Our ultimate goal is to obtain a deep CNN model trained on synthetic renders and deployed to recognize the presence of target objects in never-before-seen real images collected by commercial RGB cameras. Different approaches are adopted to close the domain gap between synthetic and real images. First, the domain randomization technique is applied to generate synthetic data for training. Second, domain invariant features are utilized while training, allowing to use the trained model directly in the target domain. Finally, we propose a way to learn better representative features using augmented autoencoders, getting performance close to our baseline models trained with real images.

© 2022 SPIE and IS&T 1017-9909/2022/$28.00© 2022 SPIE and IS&T
Abdelrahman G. Abubakr, Igor Jovančević, Nour Islam Mokhtari, Hamdi Ben Abdallah, and Jean-José Orteu "Learning deep domain-agnostic features from synthetic renders for industrial visual inspection," Journal of Electronic Imaging 31(5), 051604 (20 June 2022). https://doi.org/10.1117/1.JEI.31.5.051604
Received: 31 January 2022; Accepted: 25 May 2022; Published: 20 June 2022
Lens.org Logo
CITATIONS
Cited by 2 scholarly publications.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Data modeling

RGB color model

Solid modeling

3D modeling

Computer aided design

Optical inspection

Cameras

RELATED CONTENT

CAIP system for vision-based on-machine measurement
Proceedings of SPIE (November 15 2011)
Object identification employing surface markings
Proceedings of SPIE (October 13 1994)
High-speed optical inspection of rapid prototyping parts
Proceedings of SPIE (August 26 1996)
A CAD-Model-Based System For Object Localization
Proceedings of SPIE (August 22 1988)

Back to Top