Image-to-image translation based face de-occlusion

Rahul S. Maharjan; Nizam Ud Din; Juneho Yi

doi:10.1117/12.2573031

12 June 2020 Image-to-image translation based face de-occlusion

Rahul S. Maharjan, Nizam Ud Din, Juneho Yi

Proceedings Volume 11519, Twelfth International Conference on Digital Image Processing (ICDIP 2020); 115191A (2020) https://doi.org/10.1117/12.2573031
Event: Twelfth International Conference on Digital Image Processing, 2020, Osaka, Japan

Abstract

Existing deep learning-based object removal methods produce plausible results. However, they generate unsatisfactory results when the object is large, especially in facial images due to the lack of information about the affected region. Most of these methods rely on the object information in terms of a binary segmentation map which is insufficient to provide information about the face boundary and semantics symmetric relation. To address the problem, we propose a two-stage GAN-based image-to-image translation method that exploits the face semantic segmentation instead of the binary segmentation map of the object. Specifically, our model learns a complete facial segmentation map from an input image (face image with unwanted object) in the first stage and translates that generated semantic segmentation map combined with input image into a plausible face image without the object. We also exploit the joint loss function that consists of low-level loss, adversarial loss, and perceptual loss to produce semantically realistic facial images. Experimental results show that our method outperforms previous state-of-the-art methods both quantitatively and qualitatively.

Citation Download Citation

Rahul S. Maharjan, Nizam Ud Din, and Juneho Yi "Image-to-image translation based face de-occlusion", Proc. SPIE 11519, Twelfth International Conference on Digital Image Processing (ICDIP 2020), 115191A (12 June 2020); https://doi.org/10.1117/12.2573031

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image segmentation

Binary data

Network architectures

Convolution

Gallium nitride

Computer programming

Data modeling

Show All Keywords

Keywords/Phrases

Search In:

Publication Years