Prioritized image and video colorization based on Gaussian pyramid of gradient images

Dae-Young Hyun; Jun-Hee Heu; Chang-Su Kim; Sang-Uk Lee

doi:10.1117/1.JEI.21.2.023027

27 June 2012 Prioritized image and video colorization based on Gaussian pyramid of gradient images

Dae-Young Hyun, Jun-Hee Heu, Chang-Su Kim, Sang-Uk Lee

Author Affiliations +

Journal of Electronic Imaging, Vol. 21, Issue 2, 023027 (June 2012). https://doi.org/10.1117/1.JEI.21.2.023027

Abstract

We propose a colorization algorithm for grayscale images and videos that demands simple user scribbles on a selected set of source pixels. The proposed algorithm colorizes non source pixels by propagating the colors of source pixels. To achieve reliable colorization results, we adopt a prioritization approach, which colorizes large smooth regions first and small detailed regions later using a Gaussian pyramid of gradient images. At each level of the pyramid, we determine the priority of each non source pixel using the luminance similarities to neighboring pixels and the geometric proximities to source pixels. Then we repeatedly colorize the pixel with the highest priority by interpolating the colors of neighboring source pixels. Also, for video colorization, the proposed algorithm transfers the colors of the first frame to subsequent frames based on optical flow estimation. To correct incorrectly transferred colors, the accuracies of transferred colors are calculated, and inaccurate colors are refined using neighboring colors. Simulation results show that the proposed algorithm provides accurate and reliable colorization results. We also demonstrate that the proposed algorithm can be used for color restoration and recolorization.

Citation Download Citation

Dae-Young Hyun, Jun-Hee Heu, Chang-Su Kim, and Sang-Uk Lee "Prioritized image and video colorization based on Gaussian pyramid of gradient images," Journal of Electronic Imaging 21(2), 023027 (27 June 2012). https://doi.org/10.1117/1.JEI.21.2.023027

Published: 27 June 2012

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available