Abstract
Most of the work on adding accessories onto faces has been done in 2D. These methods use deep learning models and directly process the 2D images. In this paper, we perform this process in 3D space. This is done by converting 2D images into 3D face models and then placing the 3D model of the accessory on this face model. The automation has been done by using feature points and Procrustes analysis. We have also performed similar automation in Blender using the python API. The accessories include hats, glasses and Indian jewellery in various colours containing various diamonds and gemstones.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Luethi, M., Gerig, T., Jud, C., Vetter, T.: Gaussian process morphable models. IEEE Trans. Pattern Anal. Mach. Intell. 40(8), 1860–1873 (2018)
Goldluecke, B., Magnor, M.: Joint 3D reconstruction and background separation in multiple views using graph cuts. Madison, Wisconsin, USA, vol. 1, pp. 683–694. IEEE Computer Society, June 2003
Goldluecke, B., Magnor, M.: Space-time isosurface evolution for temporally coherent 3D reconstruction. Washington, D.C., USA, vol. 1, pp. 350–355, IEEE Computer Society, July 2004
Goldluecke, B., Cremers, D.: A Superresolution Framework for High-Accuracy Multiview Reconstruction, Jena, Germany (2009)
Haefner, B., Peng, S., Verma, A., Quéau, Y., Cremers, D.: Photometric depth super-resolution. IEEE Trans. Pattern Anal. Mach. Intell. 42(10), 2453–2464 (2020). https://doi.org/10.1109/TPAMI.2019.2923621
Zou, C., Liu, J., Liu, J.: Precise 3D reconstruction from a single image. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012. LNCS, vol. 7727, pp. 271–282. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-37447-0_21
Jackson, A.S., Bulat, A., Argyriou, V., Tzimiropoulos, G.: Large pose 3D face reconstruction from a single image via direct volumetric CNN regression. In: International Conference on Computer Vision (2017)
Rother, D., Sapiro, G.: 3D reconstruction from a single image. IEEE Trans. Pattern Anal. Mach. Learn. (2009, submitted). IMA Prepr International
Tran, A.T., Hassner, T., Masi, I., Medioni, G.G.: Regressing Robust and Discriminative 3D Morphable Models with a very Deep Neural Network (2016)
Gower, J.C.: Generalized procrustes analysis. Psychometrika 40(1), 33–51 (1975)
Parihar, R., Dashpute, A., Kalra, P.: Scene adaptive cosmetic makeup transfer. In: ICVGIP (2018)
Schönborn, S., Egger, B., Morel-Forster, A., Vetter, T.: Markov chain Monte Carlo for automated face image analysis. Int. J. Comput. Vision 123(2), 160–183 (2016). https://doi.org/10.1007/s11263-016-0967-5
Brandão, S., Costeira, J., Veloso, M.: Effortless scanning of 3D object models by boundary aligning and stitching. In: VISAPP (2014)
Turk, G., Levoy, M.: Zippered polygon meshes from range images. In: SIGGRAPH 1994, New York, NY, USA. ACM (1994)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Naik, R., Singh, P., Kalra, P. (2020). Putting Jewellery and Accessories on a 3D Face Model Generated from 2D Image. In: Babu, R.V., Prasanna, M., Namboodiri, V.P. (eds) Computer Vision, Pattern Recognition, Image Processing, and Graphics. NCVPRIPG 2019. Communications in Computer and Information Science, vol 1249. Springer, Singapore. https://doi.org/10.1007/978-981-15-8697-2_21
Download citation
DOI: https://doi.org/10.1007/978-981-15-8697-2_21
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-8696-5
Online ISBN: 978-981-15-8697-2
eBook Packages: Computer ScienceComputer Science (R0)