Skip to main content
SpringerLink
Log in

Single image super-resolution using coupled dictionary learning and cross domain mapping

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this paper, a new algorithm for single image super resolution using coupled wavelet and spatial domain dictionary pairs is proposed. The standard deviation parameter, which is approximately scale invariant for low and high resolution patch pairs is employed for clustering. A pair of online coupled dictionaries is learned for each cluster using a low resolution image. The standard deviation measure of a low resolution patch is used to select the appropriate cluster dictionary pair for reconstructing the high resolution counterpart. Experimental results show that the performance of the proposed algorithm is superior to the existing methods in terms of objective and subjective quality measures. The objective image quality is measured in terms of PSNR and SSIM. This paper also proposed an extended algorithm, based on selective sparse representation over a set of coupled dictionary pair. The extended algorithm applies the coupled dictionary based sparse framework for patches having high standard deviation. Whereas, low complexity patch collaging method is used to super resolve low standard deviation valued patches. It is found empirically that a large percentage of patches have low standard deviation values. Moreover, the selective approach significantly reduces the computational complexity without losing the overall reconstruction quality.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Aharon M, Elad M, Bruckstein A (2006) K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation. IEEE Transactions on Signal Processing 54:4311–4322

    Article  MATH  Google Scholar 

  2. Dai D, Timofte R, Van Gool L (2015) Jointly optimized regressors for image super-resolution. Journal Computer Graphics Forum 34(2):95–104

    Article  Google Scholar 

  3. Dong W, Zhang L, Shi G, Wu X (2011) Image deblurring and super-resolution by adaptive sparse domain selection and adaptive regularization. In: IEEE Trans Ind Appl, vol 20, pp 1838–1857

    Google Scholar 

  4. Dong W, Zhang L, Lukac R, Shi G (2013) Sparse representation based image interpolation with nonlocal autoregressive modeling. IEEE Trans Image Process 22(4):1382–1394

    Article  MathSciNet  MATH  Google Scholar 

  5. Dong C, Loy CC, He K, Tang X (2016) Image super-resolution using deep convolutional networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 38(2):295–307

    Article  Google Scholar 

  6. Engan K, Aase SO, Hakon Husoy J (1999) Method of optimal directions for frame design. In: Proceedings 1999 IEEE international conference on acoustics, speech, and signal processing, vol 5, Phoenix, pp 2443–2446

  7. Freeman WT, Pasztor EC, Carmichael OT (2000) Learning low-level vision. Int J Comput Vis 40(1):25–47

    Article  MATH  Google Scholar 

  8. Huang DA, Wang YCF (2013) Coupled dictionary and feature space learning with applications to cross-domain image synthesis and recognition. In: 2013 IEEE international conference on computer vision. NSW, Sydney, pp 2496–2503

    Chapter  Google Scholar 

  9. Keys R (1981) Cubic convolution interpolation for digital image processing. IEEE Transactions on Acoustics, Speech and Signal Processing 29:1153–1160

    Article  MathSciNet  MATH  Google Scholar 

  10. Lee H, Battle A, Raina R, Ng AY (2006) Efficient sparse coding algorithms. In: Advances in neural information processing systems, pp 801–808

    Google Scholar 

  11. Leung BO, Chou KC (2011) Review of Super-Resolution fluorescence microscopy for biology. Appl Spectrosc 65:967–980

    Article  Google Scholar 

  12. Li H, Qi H, Zaretzki R (2013) Beta process joint dictionary learning for coupled feature spaces with application to single image super-resolution. In: Proceedings of the IEEE conference on computer vision and pattern recognition

  13. Li Y, Li F, Bai B, Shen Q (2016) Image fusion via nonlocal sparse k-SVD dictionary learning. Appl Opt 55:1814–1823

    Article  Google Scholar 

  14. Li Q, Zhou X, Gu A, Li Z, Liang RZ (2016) Nuclear norm regularized convolutional Max Pos@ Top machine. In: Neural computing and applications. Springer, London, pp 1–10

    Google Scholar 

  15. Liang Ru-Ze, Xie Wei, Li W, Wang H, Wang JJ-Y, Taylor L (2016) A novel transfer learning method based on common space mapping and weighted domain matching. In: IEEE 28th international conference on tools with artificial intelligence (ICTAI), pp 299–303

    Google Scholar 

  16. Liang R-Z, Shi L, Wang H, Meng J, Wang JJ-Y, Sun Q, Gu Y (2016) Optimizing top precision performance measure of content-based image retrieval by learning similarity function. In: 23st International Conference on Pattern Recognition (ICPR), pp 2954–2958

    Chapter  Google Scholar 

  17. Mairal J, Bach F, Ponce J, Sapiro G (2009) Online dictionary learning for sparse coding. In: Proceedings of the 26th annual international conference on machine learning, ICML ’09, vol 689–696. ACM, New York

    Google Scholar 

  18. Martin D, Fowlkes C, Tal D, Malik J (2001) A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics, in Computer Vision, 2001. ICCV 2001. Eighth IEEE international conference on proceedings 2:416–423

    Google Scholar 

  19. Mallat S (1999) A wavelet tour of signal processing. Academic press

  20. Marcellin M, Gormish M, Bilgin A, Boliek M (2000) An overview of jpeg-2000. In: Proceedings DCC 2000, Data compression conference, pp 523–541

    Chapter  Google Scholar 

  21. Nazzal Mahmoud, Ozkaramanli Huseyin (2013) Improved single image super-resolution using sparsity and structured dictionary learning in wavelet domain. 21st. IEEE Signal Processing and Communications Applications Conference (SIU)

  22. Nazzal M, Ozkaramanli H (2015) Wavelet domain dictionary learning-based single image superresolution. SIViP 9(7):1491–1501

    Article  Google Scholar 

  23. Olshausen BA, Field DJ (1996) Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381:607–609

    Article  Google Scholar 

  24. Soman KP, Ramachandran KI (2006) Insight into Wavelets,from theory to practice. Prentice-Hall of India Private Limited

  25. Sun J, Zheng N-N, Tao H, Shum H-Y (2003) Image hallucination with primal sketch priors. In: IEEE Proceedings of Computer Society Conference on Computer Vision and Pattern Recognition, vol 2

  26. Sun J, Sun J, Xu Z, Shum HY (2011) Gradient profile prior and its applications in image super-resolution and enhancement. IEEE Trans Image Process 20:1529–1542

    Article  MathSciNet  MATH  Google Scholar 

  27. Sun D, Gao Q, Lu Y (2016) Image interpolation via collaging its non-local patches. Digital Signal Processing 49:33–43

    Article  Google Scholar 

  28. Suryanarayana G, Dhuli R (2016) Simultaneous edge preserving and Noise Mitigating Image Super-resolution algorithm. In: AEU-international journal of electronics and communications

  29. Tao D, Guo Y, Song M, Li Y, Yu Z, Tang YY (2016) Person re-identification by dual-regularized KISS metric learning. IEEE Trans Image Process 25(6):2726–2738

    Article  MathSciNet  Google Scholar 

  30. Tao D, Lin X, Jin L, Li X (2016) Principal component 2-D long short-term memory for font recognition on single chinese characters. IEEE Transactions on Cybernetics 46(3):756–765. https://doi.org/10.1109/TCYB.2015.2414920

    Article  Google Scholar 

  31. Tao D, Cheng J, Gao X, Li X, Deng C (2017) Robust sparse coding for mobile image labeling on the cloud. IEEE Transactions on Circuits and Systems for Video Technology 27(1):62–72

    Article  Google Scholar 

  32. Taubman DS, Marcellin M (2001) JPEG 2000: image compression fundamentals, standards and practice, vol 2000. Kluwer Academic Publishers, Norwell

    Google Scholar 

  33. Timofte R, Smet Vt, Gool L (2013) Anchored neighborhood regression for fast example-based super-resolution. In: Proceedings of the IEEE International Conference on Computer Vision, pp 1920–1927

    Google Scholar 

  34. Timofte R, De Smet V, Van Gool L (2014) A+: adjusted anchored neighborhood regression for fast super-resolution. In: Computer vision–ACCV 2014. Springer International Publishing, pp 111–126

  35. Timofte R, Rothe R, Van Gool L (2015) Seven ways to improve example-based single image super resolution”, arXiv preprint arXiv:1511.02228

  36. Viola P, Jones M (2001) Robust real-time object detection. Int J Comput Vis 4

  37. Walha R, et al (2013) Multiple learned dictionaries based clustered sparse coding for the super-resolution of single text image. In: 12th international conference on document analysis and recognition (ICDAR), pp 484–488

    Google Scholar 

  38. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: From error visibility to structural similarity. Transaction on Image Processing (TIP) 13(4):600–612. IEEE press

    Article  Google Scholar 

  39. Wang S, Zhang L, LY, Pan Q (2012) Semi-coupled dictionary learning with applications in image super-resolution and photo-sketch synthesis. In: International conference on computer vision and pattern recognition (CVPR). IEEE

  40. Wang F, Lai HSS, Liu L, Li P, Yu H, Liu Z, Wang Y, Li WJ (2015) Super-resolution endoscopy for real-time wide-field imaging. Opt Express 23:16803–16811

    Article  Google Scholar 

  41. Weber AG (1997) The USC-SIPI Image Database, tech. rep., University of Southern California, Signal and Image Processing Institute, Department of Electrical Engineering, Los Angeles, CA 90089-2564 USA, 3740 McClintock Ave

  42. Yang J, Wright J, Huang T, Ma Y (2008) Image super-resolution as sparse representation of raw image patches. In: IEEE conference on computer vision and Pattern recognition (CVPR), pp 1–8

    Google Scholar 

  43. Yang J, Wright J, Huang T, Ma Y (2010) Image super-resolution via sparse representation. IEEE Trans Image Process 19:2861–2873

    Article  MathSciNet  MATH  Google Scholar 

  44. Yang J, Wang Z, Lin Z, Cohen S, Huang T (2012) Coupled dictionary training for image super-resolution. IEEE Transactions on Image Processing 21(8):3467–3478

    Article  MathSciNet  MATH  Google Scholar 

  45. Yang S, et al (2012) Single-image super-resolution reconstruction via learned geometric dictionaries and clustered sparse coding. IEEE Trans Image Process 21 (9):4016–4028

    Article  MathSciNet  MATH  Google Scholar 

  46. Zeyde R, Elad M, Protter M (2010) On single image scale-up using sparse-representations. In: Curves and surfaces. Springer, Berlin, pp 711–730

    Google Scholar 

Download references

Acknowledgments

It gives us immense pleasure to thank the anonymous reviewers for their careful reading of our manuscript and their insightful comments and valuable suggestions that helped us to improve the quality of manuscript. We thank Dr. Jigisha N. Patel, Dr. Mukesh A. Zaveri and Dr. Jigar H. Shah for their cooperation and guidance throughout the work. We also thank Pinal. J. Engineer, for his support.

Author information

Authors and Affiliations

  1. Department of Electronics Engineering, Sardar Vallabhbhai National Institute of Technology (SVNIT), Ichchhanath, Surat, 395007, India

    Hemant S. Goklani, Shravya S. & Jignesh N. Sarvaiya

Authors
  1. Hemant S. Goklani
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shravya S.
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jignesh N. Sarvaiya
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hemant S. Goklani.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Goklani, H.S., S., S. & Sarvaiya, J.N. Single image super-resolution using coupled dictionary learning and cross domain mapping. Multimed Tools Appl 77, 14979–15002 (2018). https://doi.org/10.1007/s11042-017-5084-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-5084-0

Keywords

Search

Navigation