Skip to main content
SpringerLink
Log in

SCCADC-SR: a real image super-resolution based on self-calibration convolution and adaptive dense connection

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Because the real degradation model is more complex, and the different computing performance of devices leads to different degradation results. The super-resolution based on the real image degradation model has great challenges in practical applications. To solve these problems, we propose a novel SR network based on self-calibration convolution and adaptive dense connection (SCCADC-SR). Firstly, we introduce self-calibration convolution as the basic convolution module and use it as a supplement to the attention mechanism. Secondly, we use efficient channel attention (ECA) to construct an adaptive dense connection structure to deal with the features at the different levels. Then, we use the CutBlur method to enhance the data to improve the generalization ability of the model and use the long skip connection to improve the convergence of the depth model structure. Finally, SCCADC-SR combines self-ensemble and model ensemble to improve the model’s robustness and reduce the noise. Experimental results show that for both real image data and Bicubic data, our SCCADC-SR improves SR reconstruction performance by 5% compared with the state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Data availability

All data generated or analyzed during this study are included in this published article.

References

  1. AIM2020 Workshop and Challenges @ECCV (2020) https://competitions.codalab.org

  2. Ahn N, Kang B, Sohn KA (2018) Fast, accurate, and lightweight super-resolution with cascading residual network[C]. Proceedings of the European conference on computer vision (ECCV), pp 252–268

  3. Anwar S, Barnes N (2019) Densely residual laplacian super-resolution[J]. arXiv preprint arXiv:1906.12021

  4. Bevilacqua M, Roumy A, Guillemot C et al (2012) Low-complexity single-image super-resolution based on nonnegative neighbor embedding[C], 23rd British Machine Vision Conference (BMVC), BMVA Press, pp 135.1–135.10.

  5. Bhatti UA, Huang M, Wang H et al (2018) Recommendation system for immunization coverage and monitoring[J]. Hum Vaccin Immunother 14(1):165–171

    Article  Google Scholar 

  6. Bhatti UA, Huang M, Wu D et al (2019) Recommendation system using feature extraction and pattern recognition in clinical care systems[J]. Enterp Inf Syst 13(3):329–351

    Article  Google Scholar 

  7. Bhatti UA, Yu Z, Chanussot J et al (2021) Local similarity-based spatial-spectral fusion hyperspectral image classification with deep CNN and Gabor filtering[J]. IEEE Trans Geosci Remote Sens 60:1–15

    Article  Google Scholar 

  8. Bhatti UA, Yu Z, Hasnain A et al (2022) Evaluating the impact of roads on the diversity pattern and density of trees to improve the conservation of species[J]. Environ Sci Pollut Res 29(10):14780–14790

    Article  Google Scholar 

  9. Bhatti UA, Zeeshan Z, Nizamani MM et al (2022) Assessing the change of ambient air quality patterns in Jiangsu Province of China pre-to post-COVID-19[J]. Chemosphere 288:132569

    Article  Google Scholar 

  10. Dong C, Loy CC, He K et al (2014) Learning a deep convolutional network for image super-resolution[C]. European conference on computer vision. Springer, Cham, pp 184–199

  11. Freeman WT, Jones TR, Pasztor EC (2002) Example-based super-resolution[J]. IEEE Comput Graphics Appl 22(2):56–65

    Article  Google Scholar 

  12. Glasner D, Bagon S, Irani M (2009) Super-resolution from a single image[C]. 2009 IEEE 12th international conference on computer vision. IEEE, pp 349–356

  13. Guo Y, Chen J, Wang J et al (2020) Closed-loop Matters: dual regression networks for single image super-resolution[C]. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 5407–5416

  14. Haris M, Shakhnarovich G, Ukita N (2018) Deep back-projection networks for super-resolution[C]. Proceedings of the IEEE conference on computer vision and pattern recognition, pp1664–1673

  15. Huang H, Shen L, He C et al (2021) Lightweight image super-resolution with hierarchical and differentiable neural architecture search[J]. arXiv preprint arXiv:2105.03939

  16. Huang J B, Singh A, Ahuja N (2015) Single image super-resolution from transformed self-exemplars[C]. Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5197–5206

  17. Hui Z, Gao X, Yang Y et al (2019) Lightweight image super-resolution with information multi-distillation network[C]. Proceedings of the 27th ACM international conference on multimedia, pp 2024–2032

  18. Jang DW, Park RH (2019) DenseNet with deep residual channel-attention blocks for single image super resolution[C]. Proceedings of the IEEE conference on computer vision and pattern recognition workshops

  19. Keys R (1981) Cubic convolution interpolation for digital image processing[J]. IEEE Trans Acoust Speech Signal Process 29(6):1153–1160

    Article  MathSciNet  MATH  Google Scholar 

  20. Kim J, Kwon Lee J, Mu Lee K (2016) Accurate image super-resolution using very deep convolutional networks[C]. Proceedings of the IEEE conference on computer vision and pattern recognition, pp1646–1654

  21. Ledig C, Theis L, Huszár F et al (2017) Photo-realistic single image super-resolution using a generative adversarial network[C]. Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4681–4690

  22. Li K, Wu Z, Peng KC et al (2018) Tell me where to look: guided attention inference network[C]. Proceedings of the IEEE conference on computer vision and pattern recognition, pp 9215–9223

  23. Lim B, Son S, Kim H et al (2017) Enhanced deep residual networks for single image super-resolution[C]. Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 136–144

  24. Liu J J, Hou Q, Cheng MM et al (2020) Improving convolutional networks with self-calibrated convolutions[C]. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 10096–10105

  25. Liu J, Tang J, Wu G (2020) Residual feature distillation network for lightweight image super-resolution[J]. arXiv preprint arXiv:2009.11551

  26. Martin D, Fowlkes C, Tal D, et al (2001) A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics[C]. Proceedings eighth IEEE international conference on computer vision. ICCV 2001, vol 2. IEEE, pp 416–423

  27. Muqeet A, Hwang J, Yang S et al (2020) Ultra lightweight image super-resolution with multi-attention layers[J]. arXiv preprint arXiv:2008.12912

  28. Niu B, Wen W, Ren W et al (2020) Single image super-resolution via a holistic attention network[C]. European conference on computer vision. Springer, Cham, pp 191–207

  29. Shang T, Dai Q, Zhu S et al (2020) Perceptual extreme super-resolution network with receptive field block[C]. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, pp 440–441

  30. Shi W, Caballero J, Huszár F et al (2016) Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network[C]. Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1874–1883

  31. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition[J]. arXiv preprint arXiv:1409.1556

  32. Wang X, Yu K, Wu S et al (2018) Esrgan: enhanced super-resolution generative adversarial networks[C]. Proceedings of the European Conference on Computer Vision (ECCV)

  33. Wang L, Dong X, Wang Y et al (2021) Exploring sparsity in image super-resolution for efficient inference[C]. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 4917–4926

  34. Wei P, Xie Z, Lu H et al (2020) Component divide-and-conquer for real-world image super-resolution[C]. European conference on computer vision. Springer, Cham, pp 101–117

  35. Wu H, Zou Z, Gui J et al (2020) Multi-grained Attention Networks for Single Image Super-Resolution[J]. IEEE Trans Circuits Syst Video Technol

  36. Yan Q, Xu Y, Yang X et al (2015) Single image superresolution based on gradient profile sharpness[J]. IEEE Trans Image Process 24(10):3187–3202

    Article  MathSciNet  MATH  Google Scholar 

  37. Yang X, Zhang Y, Guo Y et al (2021) An image super-resolution deep learning network based on multi-level feature extraction module[J]. Multimed Tools Appl 80(5):7063–7075

    Article  Google Scholar 

  38. Yang X, Li H, Li X (2022) Lightweight image super-resolution with feature cheap convolution and attention mechanism[J]. Cluster Comput:1–16

  39. Yoo J, Ahn N, Sohn KA (2020) Rethinking data augmentation for image super-resolution: a comprehensive analysis and a new strategy[C]. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 8375–8384

  40. Yun S, Han D, Oh SJ et al (2019) Cutmix: regularization strategy to train strong classifiers with localizable features[C]. Proceedings of the IEEE international conference on computer vision, pp 6023–6032

  41. Zeyde R, Elad M, Protter M (2010) On single image scale-up using sparse-representations[C]. International conference on curves and surfaces. Springer, Berlin, pp 711–730

  42. Zhang Y, Li K, Li K et al (2018) Image super-resolution using very deep residual channel attention networks[C]. Proceedings of the European Conference on Computer Vision (ECCV), pp 286–301

  43. Zhang K, Zuo W, Zhang L (2018) Learning a single convolutional super-resolution network for multiple degradations[C]. Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3262–3271

  44. Zhang Y, Li K, Li K et al (2019) Residual non-local attention networks for image restoration[J]. arXiv preprint arXiv:1903.10082

Download references

Funding

This research was supported by the National Natural Science Foundation of China (61573182, 62073164), and by the Fundamental Research Funds for the Central Universities (NS2022041).

Author information

Authors and Affiliations

  1. College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, China

    Xin Yang, Hengrui Li, Chenhuan Wu & Tao Li

Authors
  1. Xin Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hengrui Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chenhuan Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Tao Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xin Yang.

Ethics declarations

Conflict of interest

Xin Yang declares that he has no conflict of interest, Hengrui Li declares that he has no conflict of interest. Chenhuan Wu declares that he has no conflict of interest, Tao Li declares that he has no conflict of interest.

Additional information

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, X., Li, H., Wu, C. et al. SCCADC-SR: a real image super-resolution based on self-calibration convolution and adaptive dense connection. Multimed Tools Appl 82, 45699–45716 (2023). https://doi.org/10.1007/s11042-023-15481-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-15481-z

Keywords

Search

Navigation