Skip to main content

Automatic Restoration of Old Motion Picture Films Using Spatiotemporal Exemplar-Based Inpainting

  • Conference paper
Advanced Concepts for Intelligent Vision Systems (ACIVS 2006)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 4179))

Abstract

This paper presents a method for automatic removal of local defects such as blotches and impulse noise in old motion picture films. The method is fully automatic and includes the following steps: fuzzy prefiltering, motion-compensated blotch detection, and spatiotemporal inpainting. The fuzzy prefilter removes small defective areas such as impulse noise. Modified bidirectional motion estimation with a predictive diamond search is utilized to estimate the motion vectors. The blotches are detected by the rank-ordered-difference method. Detected missing regions are interpolated by a new exemplar-based inpainting approach that operates on three successive frames. The performance of the proposed method is demonstrated on an artificially corrupted image sequence and on a real motion picture film. The results of the experiments show that the proposed method efficiently removes flashing and still blotches and impulse noise from image sequences.

This work was supported in part by the Research Foundation of Karadeniz Technical University under Grant 2004.112.004.01.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Thoma, R., Bierling, M.: Motion compensating interpolation considering covered and uncovered background. Signal Processing: Image Commun. 1(2), 191–212 (1989)

    Article  Google Scholar 

  2. Kim, M.K., Kim, J.K.: Efficient motion estimation algorithm for bidirectional prediction scheme. IEE Electron. Lett. 30(8), 632–633 (1994)

    Article  Google Scholar 

  3. Goh, W.B., Chong, M.N., Kalra, S., Krishnan, D.: Bi-directional 3D auto-regressive model approach to motion picture restoration. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Atlanta, USA, pp. 2275–2278 (1996)

    Google Scholar 

  4. Kokaram, A.C., Morris, R.D., Fitzgerald, W.J., Rayner, J.W.: Detection of missing data in image sequences. IEEE Trans. Image Processing 4(11), 1496–1508 (1995)

    Article  Google Scholar 

  5. Nadenau, M.J., Mitra, S.K.: Blotch and scratch detection in image sequences based on rank ordered differences. In: Proceedings of the 5th International Workshop on Time-Varying Image Processing and Moving Object Recognition, Florence, Italy, pp. 1–7 (1996)

    Google Scholar 

  6. Armstrong, S., Kokaram, A.C., Rayner, P.J.W.: Restoring video images taken from scratched 2-inch tape. In: Marshall, S., Harvey, N., Shah, D. (eds.) Workshop on Non-Linear Model Based Image Analysis (NMBIA 1998), pp. 83–88. Springer, Heidelberg (1998)

    Google Scholar 

  7. Gangal, A., Kayıkcioglu, T., Dizdaroglu, B.: An improved motion-compensated restoration method for damaged color motion picture films. Signal Processing: Image Commun. 19, 353–368 (2004)

    Article  Google Scholar 

  8. Criminisi, A., Perez, P., Toyama, K.: Region filling and object removal by exemplar-based inpainting. IEEE Trans. Image Processing 13(9), 1200–1212 (2004)

    Article  Google Scholar 

  9. Bertalmio, M., Vese, L., Sapiro, G.: Simultaneous structure and texture image inpainting. IEEE Trans. Image Processing 12(8), 882–889 (2003)

    Article  Google Scholar 

  10. Kwan, H.K.: Fuzzy filters for noisy image filtering. In: Proceedings of the 2003 International Symposium on Circuits and Systems (ISCAS 2003), vol. 4, pp. 161–164 (2003)

    Google Scholar 

  11. Tourapis, A.M., Shen, G., Liou, M.L., Au, O.C., Ahmad, I.: A new predictive diamond search algorithm for block based motion estimation. In: Ngan, K.N., Sikora, T., Sun, M.T. (eds.) Proceedings of Visual Communication and Image Processing, Perth, Australia, pp. 1365–1373 (2000)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Gangal, A., Dizdaroglu, B. (2006). Automatic Restoration of Old Motion Picture Films Using Spatiotemporal Exemplar-Based Inpainting. In: Blanc-Talon, J., Philips, W., Popescu, D., Scheunders, P. (eds) Advanced Concepts for Intelligent Vision Systems. ACIVS 2006. Lecture Notes in Computer Science, vol 4179. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11864349_6

Download citation

  • DOI: https://doi.org/10.1007/11864349_6

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-44630-9

  • Online ISBN: 978-3-540-44632-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics