Skip to main content

Frequency Analysis of Gradient Descent Method and Accuracy of Iterative Image Restoration

  • Conference paper
  • First Online:
Analysis of Images, Social Networks and Texts (AIST 2015)

Abstract

For images with sharp changes of intensity, the appropriate regularization is based on variational functionals. In order to minimize such a functional, the gradient descent approach can be used. In this paper, we analyze the performance of the gradient descent method in the frequency domain and show that the method converges to the sum of the original undistorted function and the kernel function of a linear distortion operator.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Jain, A.K.: Fundamentals of Digital Image Processing. Prentice Hall, NY (1989)

    MATH  Google Scholar 

  2. Biemond, J., Lagendijk, R.L., Mersereau, R.M.: Iterative methods for image deblurring. Proc. IEEE 78(5), 856–883 (1990)

    Article  Google Scholar 

  3. Banham, M., Katsaggelos, A.: Digital image restoration. IEEE Sig. Process. Mag. 14(2), 24–41 (1997)

    Article  Google Scholar 

  4. Kundur, D., Hatzinakos, D.: Blind image deconvolution. IEEE Sig. Process. Mag. 13(3), 43–64 (1996)

    Article  Google Scholar 

  5. Sroubek, F., Flusser, J.: Multichannel blind iterative image restoration. IEEE Trans. Image Process. 12(9), 1094–1106 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  6. Chan, T., Wong, C.: Total variation blind deconvolution. IEEE Trans. Image Process. 7(3), 370–375 (1998)

    Article  Google Scholar 

  7. You, Y.L., Kaveh, M.: Blind image restoration by anisotropic regularization. IEEE Trans. Image Process. 8(3), 396–407 (1999)

    Article  Google Scholar 

  8. Zhuk, P.P.: Asymptotic behavior of the s-step method of steepest descent for eigenvalue problems in Hilbert space. Russ. Acad. Sci. Sb. Math. 80(2), 467–495 (1995)

    Google Scholar 

  9. Cominetti, R.: Asymptotic convergence of the steepest descent method for the exponential penalty in linear programming. J. Convex Anal. 2(1–2), 145–152 (1995)

    MathSciNet  MATH  Google Scholar 

  10. Álvarez, C., Cabot, A.: On the asymptotic behavior of a system of steepest descent equations coupled by a vanishing mutual repulsion. In: Seeger, A. (ed.) Recent Advances in Optimization. LNEMS, vol. 563, pp. 3–17. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  11. Bovik, A.C.: Handbook of Image and Video Processing. Academic Press, Orlando (2005)

    MATH  Google Scholar 

  12. Gonzalez, R.C., Woods, R.E., Eddins, S.L.: Digital Image Processing using Matlab, p. 209. Gatesmark Publishing, Knoxville (2009)

    Google Scholar 

  13. Kober, V., Ovseevich, I.A.: Image restoration with sliding sinusoidal transforms. Pattern Recogn. Image Anal. 18(4), 650–654 (2008)

    Article  Google Scholar 

  14. Rudin, L.I., Osher, S.: Nonlinear total variation based noise removal algorithms. Phys. D 60, 259–268 (1992)

    Article  MathSciNet  MATH  Google Scholar 

  15. Chambolle, A., Lions, P.L.: Image recovery via total variational minimization and related problems. Numer. Math. 76, 167–188 (1997)

    Article  MathSciNet  MATH  Google Scholar 

  16. Osher, S., Burger, M., Goldfarb, D., Xu, J., Yin, W.: An iterative regularization method for total variation based image restoration. Multiscale Model. Simul. 4, 460–489 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  17. Chambolle, A.: An algorithm for total variation minimization and applications. J. Math. Imaging Vis. 20, 89–97 (2004)

    Article  MathSciNet  Google Scholar 

  18. Strong, D.M., Chan, T.F.: Exact solutions to total variation regularization problems. UCLA CAM Report (1996)

    Google Scholar 

  19. Snyman, J.A.: Practical Mathematical Optimization: An Introduction to Basic Optimization Theory and Classical and New Gradient-Based Algorithms. Springer, New York (2005)

    MATH  Google Scholar 

  20. Kronrod, A.: On functions of two variables. Uspehi Mat. Nauk. 1(35), 24–134 (1950)

    MathSciNet  Google Scholar 

  21. Makovetskii, A., Kober, V.: Modified gradient descent method for image restoration. In: Proceedings of SPIE Applications of Digital Image Processing XXXVI, vol. 8856, p. 885608-1 (2013)

    Google Scholar 

  22. Makovetskii, A., Kober, V.: Image restoration based on topological properties of functions of two variables. In: Proceedings of SPIE Applications of Digital Image Processing XXXV, vol. 8499, p. 84990A (2012)

    Google Scholar 

Download references

Acknowledgments

The work was supported by the Ministry of Education and Science of Russian Federation, grant 2.1766.2014К and RFBR grant 13.01.00735.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alexander Vokhmintsev .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Makovetskii, A., Vokhmintsev, A., Kober, V., Kuznetsov, V. (2015). Frequency Analysis of Gradient Descent Method and Accuracy of Iterative Image Restoration. In: Khachay, M., Konstantinova, N., Panchenko, A., Ignatov, D., Labunets, V. (eds) Analysis of Images, Social Networks and Texts. AIST 2015. Communications in Computer and Information Science, vol 542. Springer, Cham. https://doi.org/10.1007/978-3-319-26123-2_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-26123-2_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-26122-5

  • Online ISBN: 978-3-319-26123-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics