Abstract
Speeding up the process of fringe projection profilometry to make it more suitable for dynamic three-dimensional measurement is one of the targets of structured light research. In this work, based on the fact that the frame rate of the projector can be much higher than that of the camera, we propose a three-channel binary defocused projection method to break through the speed bottleneck of the camera. Three sequential phase-shifting binary patterns are projected in a defocused way by the three color channels of the projector respectively during one camera’s exposure time. To tackle the issue of color crosstalk, a deep-learning based end-to-end fringe rectification method is first introduced. As a result, only three camera shots are required for single scene reconstruction. Through experiments in three static scenes and one dynamic scene, we demonstrate that our method substantially speeds up the reconstruction rate with an acceptable range of accuracy loss. In addition, given the limited available datasets in the fringe projection profilometry field, a new dataset is also released.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Gorthi, S.S., Rastogi, P.: Fringe projection techniques: whither we are? Opt. Lasers Eng. 48, 133–140 (2010). ARTICLE
Chao, Z., et al.: Phase shifting algorithms for fringe projection profilometry: a review. Opt. Lasers Eng. 109, 23–59 (2018)
Takeda, M., Mutoh, K.: Fourier transform profilometry for the automatic measurement of 3-D object shapes. Appl. Opt. 22(24), 3977–3982 (1983)
Su, X.Y., Chen, W.J., Zhang, Q.C., Cao, Y.P.: Dynamic 3-D shape measurement method based on FTP. Opt. Lasers Eng. 36, 49–64 (2001)
Sansoni, G., Carocci, M., Rodella, R.: Three-dimensional vision based on a combination of gray-code and phase-shift light projection: analysis and compensation of the systematic errors. Appl. Opt. 38(31), 6565–6573 (1999)
Li, E.B., Peng, X., Xi, J., Chicharo, J.F., Yao, J.Q., Zhang, D.W.: Multi-frequency and multiple phase-shift sinusoidal fringe projection for 3D profilometry. Opt. Exp. 13(5), 1561–1569 (2005)
Zhang, S.: High-speed 3D shape measurement with structured light methods: a review. Opt. Lasers Eng. 106, 119–131 (2018)
Lei, S., Zhang, S.: Flexible 3-D shape measurement using projector defocusing. Opt. Lett. 34(20), 3080–3082 (2009)
Zhang, S.: Flexible 3D shape measurement using projector defocusing: extended measurement range. Opt. Lett. 35(7), 934–936 (2010)
Zhang, S.: Rapid and automatic optimal exposure control for digital fringe projection technique. Opt. Lasers Eng. 128, 106029 (2020)
Yapin, W., et al.: Single-shot phase measuring profilometry based on color binary grating with intervals. Opt. Commun. 451, 268–275 (2019)
Zhang, Z.H.: Review of single-shot 3D shape measurement by phase calculation-based fringe projection techniques. Opt. Lasers Eng. 50(8), 1097–1106 (2012)
Zuo, C., et al.: Deep learning in optical metrology: a review. Light Sci. Appl. 11(1), 1–54 (2022)
Feng, S., et al.: Fringe pattern analysis using deep learning. Adv. Photonics 1(2), 025001 (2019)
Qian, J., et al.: Single-shot absolute 3D shape measurement with deep-learning-based color fringe projection profilometry. Opt. Lett. 45(7), 1842–1845 (2020)
Hieu, N., et al.: hNet: single-shot 3D shape reconstruction using structured light and h-shaped global guidance network. Results Opt. 4, 100104 (2021)
Yan, K., et al.: Fringe pattern denoising based on deep learning. Opt. Commun. 437, 148–152 (2019)
Pan, J., Huang, P.S., Chiang, F.P.: Color phase-shifting technique for three-dimensional shape measurement. Opt. Eng. 45(1), 013602 (2006)
Zhang, X., Gai, S., Da, F.: Fast three-dimensional measurement based on three channel binary fringe defocused projection. Laser Optoeletronics Prog. 57(23), 231201 (2020)
Cho, W., et al.: A dithering algorithm for local composition control with three-dimensional printing. Comput.-Aided Des. 35(9), 851–867 (2003)
Dai, J., Li, B., Zhang, S.: High-quality fringe pattern generation using binary pattern optimization through symmetry and periodicity. Opt. Lasers Eng. 52, 195–200 (2014)
Chaurasia, A., Culurciello, E.: LinkNet: exploiting encoder representations for efficient semantic segmentation. In: 2017 IEEE Visual Communications and Image Processing (VCIP). IEEE (2017)
He, K., et al.: Deep residual learning. Image Recognition 7 (2015)
He, K., et al.: Deep residual learning. Image Recognition 7 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Liu, T. (2023). Deep-Learning Based Three Channel Defocused Projection Profilometry. In: Iliadis, L., Papaleonidas, A., Angelov, P., Jayne, C. (eds) Artificial Neural Networks and Machine Learning – ICANN 2023. ICANN 2023. Lecture Notes in Computer Science, vol 14263. Springer, Cham. https://doi.org/10.1007/978-3-031-44204-9_11
Download citation
DOI: https://doi.org/10.1007/978-3-031-44204-9_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-44203-2
Online ISBN: 978-3-031-44204-9
eBook Packages: Computer ScienceComputer Science (R0)