Skip to main content
SpringerLink
Log in

Multilevel progressive recursive dilated networks with correlation filter (MPRDNCF) for image super-resolution

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

Nowadays, deep convolutional neural networks (CNNs) are mostly applied for image Super-Resolution (SR). But still, there are some disadvantages of using CNN as it causes enormous computational complexity as if it is directly applied to SR applications. In this paper, dilated convolution is adopted that expands receptive field without any pixel information losses. The dilated convolution is designed as recursive residual network; therefore, internal parameters are preserved. Therefore, the model is termed as Multilevel Progressive Recursive Dilated Networks with Correlation Filter (MPRDNCF) and adopted progressive approach with different levels of recursive dilated residual network that is interleaved with correlation filter for upscaling of image. This module upscales with different scaling factors and magnifies it using deconvolution layer. MPRDNCF model used progressive recursive dilated residual learning approach which shares the information between the convolution layers for the identity prior during the network training. The architecture of MPRDNCF is 33 layers of CNN. We have presented an ablation study on Set5, Set14, Urban100, and BSD100 datasets, and also presented its superior result with comparison to the existing technique of state-of-art.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Data availability

Dataset is available on https://www.kaggle.com/datasets.

References

  1. Choi, J.S., Kim, M.: Single image super-resolution using global regression based on multiple local linear mappings. IEEE Trans. Image Process. 26(3), 1300–1314 (2017)

    Article  MathSciNet  MATH  Google Scholar 

  2. Yang, J., Wang, Z., Lin, Z., Cohen, S., Huang, T.: Coupled dictionary training for image super-resolution. IEEE Trans. Image Process. 21(8), 3467–3478 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  3. Zhu, X., Wang, X., Wang, J., Jin, P., Liu, L., Mei, D.: Image super-resolution based on sparse representation via direction and edge dictionaries. Math. Probl. Eng. 20, 17 (2017)

    Google Scholar 

  4. Zhang, F.L., Wang, J., Shechtman, E., Zhou, Z.Y., Shi, J.X., Hu, S.M.: PlenoPatch: patch-based plenoptic image manipulation. IEEE Trans. Vis. Comput. Graph. 23(5), 1561–1573 (2017)

    Article  Google Scholar 

  5. Dong, C., Loy, C.C., He, K., Tang, X.: Image super-resolution using deep convolutional networks. IEEE Trans. Pattern Anal. Mach. Intell. 38(2), 295–307 (2014)

    Article  Google Scholar 

  6. Dong, C., Loy, C.C., Tang, X.: Accelerating the super-resolution convolutional neural network. Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), 9906 LNCS, pp. 391–407 (2016)

  7. Lim, B., Son, S., Kim, H., Nah, S., Lee, K.M.: Enhanced deep residual networks for single image super-resolution. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Work., pp. 1132–1140 (2017)

  8. Song, T.-A., Chowdhury, S.R., Yang, F., Dutta, J.: Super-resolution PET imaging using convolutional neural networks. IEEE Trans. Comput. Imaging 6, 518–528 (2020)

    Article  Google Scholar 

  9. Sun, Y., Zhang, W., Gu, H., et al.: Convolutional neural network based models for improving super-resolution imaging. IEEE Access, pp. 43042–43051 (2019)

  10. Ma, J., Yu, J., Liu, S., et al.: PathSRGAN: multi-supervised super-resolution for cytopathological images using generative adversarial network. IEEE Trans Med. Imaging 39(9), 2920–2930 (2020)

    Article  Google Scholar 

  11. Yun, J.U., Jo, B., Park, I.K.: Joint face super-resolution and deblurring using generative adversarial network. IEEE Access, pp. 159661–159671 (2020)

  12. Yang, Y., Li, Q., Yang, C., et al.: Deep networks with detail enhancement for infrared image super-resolution. IEEE Access, pp. 158690–158701 (2020)

  13. Mei, S., Jiang, R., Li, X., Du, Q.: Spatial and spectral joint super-resolution using convolutional neural network. IEEE Trans. Geosci. Remote Sens. 58(7), 4590–4603 (2020)

    Article  Google Scholar 

  14. Cao, L., Liu, J., Du, K., Guo, Y., Wang, T.: Guided cascaded super-resolution network for face image. IEEE Access, pp. 173387–173400 (2020)

  15. Hung, K.W., Zhang, Z., Jiang, J.: Real-time image super-resolution using recursive depthwise separable convolution network. IEEE Access, 7, pp. 99804–99816 (2019)

  16. Zhang, Z., Wang, X., Jung, C.: DCSR: dilated convolutions for single image super-resolution. IEEE Trans. Image Process. 28(4), 1625–1635 (2019)

    Article  MathSciNet  Google Scholar 

  17. Shi, W., Caballero, J., Huszar, F., et al.: Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2016-December, pp. 1874–1883 (2016)

  18. Dumoulin, V., Visin, F.: A guide to convolution arithmetic for deep learning. undefined (2016)

  19. Timofte, R., De Smet, V., Van Gool, L.: A+: adjusted anchored neighborhood regression for fast super-resolution. Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), 9006, pp. 111–126 (2014)

  20. Bevilacqua, M.,Roumy, A., Guillemot, C., Morel, M.L.A.: Low-complexity single-image super-resolution based on nonnegative neighbor embedding. BMVC 2012 - Electron. Proc. Br. Mach. Vis. Conf. 2012, (2012)

  21. Zeyde, R., Elad, M., Protter, M.: On single image scale-up using sparse-representations. Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), 6920 LNCS, pp. 711–730 (2010)

  22. Huang, J. Bin, Singh, A., Ahuja, N.: Single image super-resolution from transformed self-exemplars. Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., pp. 5197–5206 (2015)

  23. Kim, J., Lee, J.K., Lee, K.M.: Accurate image super-resolution using very deep convolutional networks. Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., pp. 1646–1654 (2016)

  24. Kim, J., Lee, J.K., Lee, K.M.: Deeply-Recursive Convolutional Network for Image Super-Resolution. Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., pp. 1637–1645 (2015)

  25. Tai, Y., Yang, J., Liu, X.: Image super-resolution via deep recursive residual network. Proc. - 30th IEEE Conf. Comput. Vis. Pattern Recognition, CVPR 2017, pp. 2790–2798 (2017)

  26. Zhang, Y., Tian, Y., Kong, Y., Zhong, B., Fu, Y.: Residual dense network for image super-resolution. (2018)

Download references

Author information

Authors and Affiliations

  1. Department of Electronics and Communication Engineering, MANIT, Bhopal, MP, India

    Ajay Sharma & Bhavana Prakash Shrivastava

  2. Department of Computer Science and Engineering, REC, Bhopal, MP, India

    Aayushi Priya

  3. School of Computing Science and Engineering, Vellore Institute of Technology, Bhopal, India

    Ajay Sharma

Authors
  1. Ajay Sharma
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bhavana Prakash Shrivastava
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Aayushi Priya
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Author - Ajay Sharma Conception or design of the work. Data collection. Data analysis and interpretation. Simulation and Modeling Author - Bhavana P. Shrivastava Drafting the article. Critical revision of the article. Final approval of the version to be published. Author - Aayushi Priya Revision of the Article.

Corresponding author

Correspondence to Ajay Sharma.

Ethics declarations

Conflict of interest

The authors declare no competing interests.

Additional information

Communicated by C. Yan.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sharma, A., Shrivastava, B.P. & Priya, A. Multilevel progressive recursive dilated networks with correlation filter (MPRDNCF) for image super-resolution. Multimedia Systems 29, 2455–2467 (2023). https://doi.org/10.1007/s00530-023-01126-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-023-01126-6

Keywords

Search

Navigation