Abstract
With the rapid growth in video technology and marketability of all forms of visual media, we encounter the need to exploit archive material more effectively and guarantee picture quality. Old films and video often get corrupted by many artifacts due to extensive usage or improper storage. These defects not only lead to reduction in perceptual quality, but also require large transmission bandwidth. In this paper, we present a novel method to restore color image sequences corrupted by partial color artifact. This degradation visible in old color film/video appear as random color patches in the frames. It reduces the perceptual quality of the video. The proposed approach minimizes a convex function, formulated as rank minimization problem, seeking the temporal correlation among the frames in a video sequence. The main feature of the proposed algorithm is its accurate detection and fast restoration of the artifacts present in a video shot.
Similar content being viewed by others
References
Kokaram, A.C.: On missing data treatment for degraded video and film archives: a survey and a new bayesian approach. IEEE Trans. Image Process. 13(3), 397–415 (2004)
Rares, A., Reinders, M.J.T., Biemond, J.: Restoration of films affected by partial color artefacts. Proc. EUSIPCO 1, 609–612 (2002)
Narendra, V., Gupta, S.: Restoration of partial color artifact and blotches using histogram matching and sparse technique. In: 2013 Fourth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG), pp. 1–4. IEEE (2013)
Newson, A., Almansa, A., Fradet, M., Gousseau, Y., Perez, P.: Video inpainting of complex scenes. arXiv preprint arXiv:1503.05528 (2015)
Hwang, H., Haddad, R.A.: Adaptive median filters: new algorithms and results. IEEE Trans. Image Process. 4(4), 499–502 (1995)
Tofighi, M., Kose, K., Cetin, A.E.: Denoising images corrupted by impulsive noise using projections onto the epigraph set of total variation function (PES-TV). Signal Image Video Process. 9(1), 41–48 (2015)
Cetin, A.E., Tofighi, M.: Projection-based wavelet denoising. IEEE Signal Process. Mag. 32(5), 120–124 (2015)
Chandrasekaran, V., et al.: Rank-sparsity incoherence for matrix decomposition. SIAM J. Optim. 21(2), 572–596 (2011)
Candes, E.J., Li, X., Ma, Y., Wright, J.: Robust principal component analysis? J. ACM 58(3), 11 (2011)
Yuan X., Yang, J.: Sparse and low rank matrix decomposition via alternating direction method. http://www.optimization-online.org/DB_FILE/2009/11/2447.pdf (2009)
Cai, J., Candes, E., Shen, Z.: A singular value thresholding algorithm for matrix completion. SIAM J. Optim. 20(4), 1956–1982 (2010)
Lin, Z., et al.: Fast convex optimization algorithms for exact recovery of a corrupted low-rank matrix. In: Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP), vol. 61, (2009)
Lin, Z., Chen, M., Ma, Y.: The augmented lagrange multiplier method for exact recovery of corrupted low-rank matrices. arXiv preprint. arXiv:1009.5055 (2010)
Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Phys. D Nonlinear Phenom. 60(1), 259–268 (1992)
Chambolle, A.: An algorithm for total variation minimization and applications. J. Math. Imaging Vis. 20(1–2), 89–97 (2004)
Wang, Z., et al.: Robust temporal-spatial decomposition and its applications in video processing. IEEE Trans. Circuits Syst Video Technol. 23(3), 387–400 (2013)
Ji, H., Huang, S., Shen, Z., Xu, Y.: Robust video restoration by joint sparse and low rank matrix approximation. SIAM J. Imaging Sci. 4(4), 1122–1142 (2011)
Li, H., Lu, Z., Wang, Z., Ling, Q., Li, W.: Detection of blotch and scratch in video based on video decomposition. IEEE Trans. Circuits Syst. Video Technol. 23(11), 1887–1900 (2013)
Bouguet, J.-Y.: Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm. Intel Corp. 5, 4 (2001)
Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)
Acknowledgments
We would like to thank broadcasting company Zee networks (Noida), India for their supports during this work.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yadav, R., Bhattacharya, S., Venkatsh, K.S. et al. A spatiotemporal restoration of partial color artifacts in archival films. SIViP 10, 1319–1326 (2016). https://doi.org/10.1007/s11760-016-0945-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-016-0945-y