Skip to main content
SpringerLink
Log in

Single image super resolution based on integration of Bandelet geometric-flow-oriented interpolation and total variation in wavelet domain

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In view of the limitation in term of direction that the existing interpolation reconstruction algorithm of single image and super resolution (SR) image cannot fully utilize the specific geometric features of the image itself, this paper proposed a novel SR algorithm of single image based on the integration of Bandelet geometric-flow-oriented interpolation and total variation in wavelet domain (IBITV). This method seamlessly took advantages of both wavelet and super-wavelet transformations. Firstly, the framework of image SR reconstruction and optimization was presented based on Bandelet and wavelet transformation. The framework made full use of the acquisition ability of the accurately geometric flow characteristics of the image based on Bandelet transformation. Furthermore, it introduced the idea that Bandelet transformed two-dimensional image and one-dimensional signal were projection mapping interactively, and the structures of image are similar at the same high frequency components of different scales after wavelet transformation to apply the Bandelet precise direction discrimination ability rather than sparse representation ability. Finally, in order to avoid the possibility of block effect, the influence of difference between low frequency component of the high resolution image and low resolution image on the final reconstructed image was considered based on the initially estimated image with high resolution. The total variation method of wavelet domain was utilized to carry out iterative solution of SR so as to obtain the final high resolution image. Experimental results show that the proposed method achieved favorable results in both iterative convergence characteristic of the algorithm and the image SR.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

References

  1. Fathi E. Abd EI-Samie, Mohiy M. Hadoud and Said E. EI-Khamy. (2013) Image super resolution and application. CRC Press, part of Taylor &Fraqncis Grounp LLC: 139–147

  2. Binh NT (2015) Enhancing the quality of medical image database based on kernels in Bandelet domain. FDSE, LNCS 9446:226–241. doi:10.1007/978-3-319-26135-5_17

    Google Scholar 

  3. Binh NT, Tuyet VT, Vinh PC (2014) Ultrasound images denoising based context awareness in Bandelet domain. LNICST 128:115–124. doi:10.1007/978-3-319-05939-6_12

    Google Scholar 

  4. Cha Y. and Kim S. (2006) Error-amended sharp edge (EASE) schemes for image interpolation. Proc. IEEE Int. Conf. on Image Processing, 701–704

  5. Chang H, Yeung DY, Xiong YM (2004) Super-resolution through neighbor embedding. Proc Computer Society Conf Computer Vision & Pattern Recognition (CVPR) 1:275–282

    Google Scholar 

  6. Dong W, Zhang L, Shi G et al (2013) Nonlocally centralized sparse representation for image restoration. IEEE Trans Image Process 22(4):1620–1630

    Article  MathSciNet  MATH  Google Scholar 

  7. Farsiu S, Robinson MD, Elad M et al (2004) Fast and robust multi-frame super resolution. IEEE Trans Image Processing 13(10):1327–1344

    Article  Google Scholar 

  8. Freeman WT, Pazstor EC (2000) Learning low – level vision. Spring International Journal Computer Vision 40(1):25–47

    Article  MATH  Google Scholar 

  9. Juliet S, Rajsingh EB, Ezra K (2015) A novel image compression method for medical images using geometrical regularity of image structure. SIViP 9:1691–1703. doi:10.1007/s11760-014-0625-8

    Article  Google Scholar 

  10. Kim WH, Lee JS (2016) Blind single image super resolution with low computational complexity. Multimed Tools Appl. doi:10.1007/s11042-016-3396-0

    Google Scholar 

  11. Kim KI, Franz MO, Scholkopf B (2005) Iterative kernel principal component analysis for image modeling. IEEE Trans Pattern Analysis & Machine Intelligence 27(9):1351–1366

    Article  Google Scholar 

  12. Kwon YH, Kim K, James T et al (2015) Efficient learning of image super-resolution and compression artifact removal with semi-local Gaussian processes. IEEE Trans Pattern Analysis & Machine Intelligence. doi:10.1109/TPAMI.2015.2389797

    Google Scholar 

  13. Le Pennec E, Mallat S (2005) Sparse geometrical image approximation with bandelets. IEEE Trans Image Processing 14(4):423–438

    Article  MathSciNet  Google Scholar 

  14. Li X, Orchard MT (2001) New edge directed interpolation. IEEE Trans. Image Processing 10(10):1521–1527

    Article  Google Scholar 

  15. Liu XD, Tu GF (2003) Wavelet Bi-linear interpolation in remote sensing image. Journal of the Graduate School of the Chinese Academy of Sciences 20(1):39–43

    Google Scholar 

  16. Liu B et al (2006) Maximal PSNR wavelet bi-linear interpolation iterative algorithm in remote sensing image. GuangziXuebao/Acta Photonica Sinica 35(3):468–472

    Google Scholar 

  17. Martin D., Fowlkes C., Tal D., et al. (2001) A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In Proceedings of ICCV, 2: 416–423

  18. Pang Z, Dai H, Tan H et al (2012) An improved low-cost adaptive bilinear image interpolation algorithm. Pro International Conf on Green Communications and Networks 1:691–699

    Google Scholar 

  19. Peyré G, Mallat S (2005a) Surface compression with geometric bandelets. ACM trans. Graphics (TOG) 24(3):601–608

    Article  Google Scholar 

  20. Peyré G. and Mallat S. (2005b) Discrete bandelets with geometric orthogonal filters. Proc IEEE Int. Conf. on the Image Processing, I-65–I-68

  21. Pratt WK (1978) Digital image processing. Wiley, New York

    MATH  Google Scholar 

  22. Quevedo E, de la Cruz J, Callicó GM et al (2014) Video enhancement using spatial and temporal super-resolution from a multi-camera system. IEEE Trans Consum Electron 60(3):420–428

    Article  Google Scholar 

  23. Rahim A, Yaakob S, Ngadiran R et al (2015) An analysis of interpolation methods for super resolution images. Proc IEEE Student Conference on Research and Development:72–77

  24. Tang Y, Yuan Y (2014) Learning from errors in super-resolution. IEEE Trans Cybernetics 44(11):2143–2154

    Article  Google Scholar 

  25. Tao HJ, Xinjian T, Jian L et al (2003) Super-resolution remote sensing image processing algorithm based on wavelet transform and interpolation. Proc SPIE 2003(4896):259–263

    Article  Google Scholar 

  26. Wang Z, Bovik A, Sheikh H et al (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Processing 13(4):600–612

    Article  Google Scholar 

  27. Wang LF, Xiang SM, Gaofeng Meng GF et al (2013) Edge-directed single-image super-resolution via adaptive gradient magnitude self-interpolation. IEEE Trans Cir and Syst for Video Technology 23(8):1289–1299

    Article  Google Scholar 

  28. Xu HT, Zhai GT, Yang XK (2013) Single image super-resolution with detail enhancement based on local fractal analysis of gradient. IEEE Trans Circuits & Systems for Video Technology 23(10):1740–1754

    Article  Google Scholar 

  29. Yang J, Wright J, Huang T et al (2010) Image super-resolution via sparse representation. IEEE Trans Image Process 19(11):2861–2873

    Article  MathSciNet  MATH  Google Scholar 

  30. Yang S, Wang S, Liu Z et al (2014) Improved Bandelet with heuristic evolutionary optimization for image compression. Eng Appl Artif Intell 31:27–34

    Article  Google Scholar 

  31. Yao P, Xue JX, Dai GZ (2009) An overview on super-resolution images processing. Semiconductor Optoelectionics 30(4):492–497

    Google Scholar 

  32. Yu J, Gao X, Tao D et al (2014) A unified learning framework for single image super-resolution. IEEE Trans Neural Networks and Learning systems 25(4):780–792

    Article  Google Scholar 

  33. Zhou F, Xia ST, Liao QM (2014) Nonlocal pixel selection for multisurface fitting-based super-resolution. IEEE Trans Cir and Syst for Video Technology 24(12):2013–2017

    Article  Google Scholar 

  34. Zhu Y, Zhang YN, Alan LY (2014) Single image super-resolution using deformable patches. Proc IEEE Conf. on Computer Vision and Pattern Recognition, 2917–2924

Download references

Acknowledgements

This work was jointly supported by the National Natural Science Foundation of China (No. 61201347), the Natural Science Foundation Project of CQ CSTC (No. cstc2012jjA40011), the Fundamental Research Funds for the Central Universities (No. CDJZR13185502), and the 2013 Innovative Team Construction Project of Chongqing Universities (KJTD201331). The supports are gratefully acknowledged.

Author information

Authors and Affiliations

  1. College of Communication Engineering, Chongqing University, Chongqing, China

    Zhiyong Shi, Fengchun Tian, Jian Ran & Minjun Deng

Authors
  1. Zhiyong Shi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fengchun Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jian Ran
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Minjun Deng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fengchun Tian.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shi, Z., Tian, F., Ran, J. et al. Single image super resolution based on integration of Bandelet geometric-flow-oriented interpolation and total variation in wavelet domain. Multimed Tools Appl 77, 6343–6366 (2018). https://doi.org/10.1007/s11042-017-4544-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-4544-x

Keywords

Search

Navigation