Skip to main content
SpringerLink
Log in

Single image deraining using modified bilateral recurrent network (modified_BRN)

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The process of reinstating a clean background to an image that has been destroyed by multiple rain streaks and rain built up is called Image Deraining. We propose a single recurrent network first that begins by iteratively unfolding one shallow-residual network and then uses a recurrent layer to transfer the in-depth properties across stages. The traditional SRN (Single Recurrent Network) was used to learn both residual mapping and direct mapping for the removal of unwanted rain-streaks and anticipating a clean backdrop. With the combining of the SRNs into modified Bilateral Recurrent Network (BRN), the rain-streak layer and the backdrop can be exploited. Hence, we put forward a model using bilateral LSTMs (Long Short-Term Memory) that can transmit deep-features of rain-streak layer and backdrop layer between stages, as well as introduce the inter-play between SRNs, resulting in a BRN. The proposed modified_BRN performs better over the sophisticated methods on real-world and synthetic datasets, such as the popular datasets: Rain100H, Rain 100 L and Rain 12. The comparative analysis of the experimental results has been analysed on the two standard parameters: PSNR (Peak Signal-to-Noise Ratio) and SSIM (Structural Similarity Index Measure).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

Data availability

The data that support the findings of this study are available on request from the corresponding author. The data are not publicly available due to privacy or ethical restrictions.

References

  1. Deng L-J, Huang T-Z, Zhao X-L, Jiang T-X (2018) A directional global sparse model for single image rain removal. Appl Math Model 59:662–679

    Article  MathSciNet  Google Scholar 

  2. Eigen D, Krishnan D, Fergus R (2018) Restoring an image taken through a window covered with dirt or rain

  3. Fan Z, Wu H, Fu X, Huang Y (2018) Residual-guide network for single image deraining

  4. Fan Z, Wu H, Fu X, Huang Y, Ding X (2018) Residual guide network for single image deraining. In ACM Trans. Multimedia, pp. 1751–1759

  5. Fu X, Huang J, Ding X, Liao Y, Paisley J (2017) Removing rain from single images via a deep detail network. In: Proc. IEEE Int’l Conf. Computer Vision and Pattern Recognition, Honolulu, Hawaii, USA

  6. Fu X, Huang J, Zeng D, Huang Y, Ding X, Paisley J (2017) Removing rain from single images via a deep detail network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1715–1723

  7. Fu X, Liang B, Huang Y, Ding X, Paisley J (2021) Lightweight pyramid networks for image deraining

  8. Hu X, Fu C-W, Zhu L, Heng PA (2020) Depth-attentional features for single-image rain removal

  9. Jairam Naik K, Soni A (2020) Video classification using 3D convolutional neural network. In: Book Title: Advancements in security and privacy initiatives for multimedia images. IGI Global Publishers, pp 1–18. https://doi.org/10.4018/978-1-7998-2795-5.ch001

    Chapter  Google Scholar 

  10. Jairam Naik K, Pedagandham M, Mishra A (2021) Workflow scheduling optimization for distributed environment using artificial neural networks and reinforcement learning (WfSo_ANRL). Int J Comput Sci Eng (IJCSE) 24(6):653–670

    Google Scholar 

  11. Jairam Naik K, Chandra S, Agarwal P (2021) Dynamic workflow scheduling in the cloud using a neural network-based multi-objective evolutionary algorithm. Int J Commun Netw Distrib Syst 27(4):424–451

    Google Scholar 

  12. Kang LW, Lin CW, Fu YH (2012) Automatic single image-based rain streaks removal via image decomposition. IEEE Trans Image Process 21(4):1742–1755

    Article  MathSciNet  Google Scholar 

  13. Li Y, Tan RT, Guo X, Lu J, Brown MS (2016) Rain streak removal using layer priors. In: Proc. IEEE Int’l Conf. Computer Vision and Pattern Recognition, pp. 2736–2744

  14. Li X, Wu J, Lin Z, Liu H, Zha H (2018) Recurrent squeeze-and-excitation context aggregation net for single image deraining. In: Proc. IEEE European Conf. Computer Vision, pp. 262–277

  15. Li R, Cheong L-F, Tan RT (2019) Single image deraining using scale-aware multi-stage recurrent network

  16. Liao Y, Lin W, Paisley (2017) Overview on single recurrent network in image deraining

  17. Luo Y, Xu Y, Ji H (2015) Removing rain from a single image via discriminative sparse coding. In: Proc. IEEE Int’l Conf. Computer Vision, pp. 3397–3405

  18. Naik KJ, Mishra A (2020) Filter selection for speaker diarization using homomorphism: Speaker Diarization. In: Book Title: Artificial neural network applications in business and engineering (300919–093756), Chapter. IGI Global Publishers. https://doi.org/10.4018/978-1-7998-3238-6.ch005

    Chapter  Google Scholar 

  19. Pan J, Liu S, Sun D, Zhang J, Liu Y (2020) Learning dual convolutional neural networks for low-level vision

  20. PSNR (n.d.) https://en.wikipedia.org/wiki/Peak_signal-to-noise_ratio

  21. PyTorch tutorial, (n.d.) https://pytorch.org/resources

  22. Qian R, Tan RT, Yang W, Su J, Liu J (2018) Attentive generative adversarial network for raindrop removal from a single image

  23. Removal R, Wang H, Xie Q, Zhao Q, Meng D (n.d.) A model-driven deep neural network for single image

  24. Ren D, Zuo W, Hu Q, Zhu P, Meng D (2019) Progressive image deraining networks: A better and simpler baseline. In: Proc. IEEE Int’l Conf. Computer Vision and Pattern Recognition

  25. Ren D, Shang W, Zhu P, Hu Q, Meng D, Zuo W (2020) Single image deraining using bilateral recurrent network. IEEE Trans Image Process 29:6852–6863

    Article  Google Scholar 

  26. SivaSai JG, Srinivasu PN, Sindhuri MN, Rohitha K, Deepika S (2021) An automated segmentation of brain mr image through fuzzy recurrent neural network. In: Bhoi A, Mallick P, Liu CM, Balas V (eds) Bio-inspired Neurocomputing. Studies in Computational Intelligence, vol 903. Springer, Singapore. https://doi.org/10.1007/978-981-15-5495-7_9

    Chapter  Google Scholar 

  27. SSIM, (n.d.) https://en.wikipedia.org/wiki/Structural_similarity

  28. Sun L, Jia K, Shen Y, Savarese S, Yeung DY, Shi BE (2017) Coupled Recurrent Network (CRN)

  29. Sun L, Jia K, Shen Y, Savarese S, Yeung DY, Shi BE (2017) Re-Coupled Recurrent Network (CRN-XR)

  30. Syed F, Di Sipio R, Sinervo P (2019) Bidirectional Long Short-Term Memory (BLSTM) neural networks for reconstruction

  31. Vulli A, Srinivasu PN, Sashank MSK, Shafi J, Choi J, Ijaz MF (2022) Fine-Tuned DenseNet-169 for Breast Cancer Metastasis Prediction Using FastAI and 1-Cycle Policy. Sensors 22(8):2988

    Article  Google Scholar 

  32. Wang T, Yang X, Xu K, Chen S, Zhang Q, Lau RW (2020) Spatial attentive single-image deraining with a high quality real rain dataset

  33. Wang H, Wu Y, Li M, Zhao Q, Meng D (n.d.) A survey on rain removal from video and single image, Member, IEEE

  34. Wang C, Chen J, Zhu H (n.d.) Single image rain removal using recurrent scale-guide networks

  35. Wang T, Yang X, Xu K, Chen S, Zhang Q, Lau R (n.d.) Spatial Attentive Single-Image Deraining with a High Quality Real Rain Dataset

  36. Wei W, Meng D, Zhao Q, Xu Z, Wu Y (2019) Semi-supervised transfer learning for image rain removal. In: Proc. IEEE Int’l Conf. Computer Vision and Pattern Recognition

  37. Yang W, Tan RT, Feng J, Liu J, Yan S, Guo Z (2019) Joint rain detection and removal from a single image with contextualized deep networks. IEEE Trans Pattern Anal Mach Intell 42:1377–1393

    Article  Google Scholar 

  38. Yang W, Liu J, Yang S, Guo Z (2021) Scale-free single image deraining via visibility-enhanced recurrent wavelet learning

  39. Yasarla R, Patel VM (2021) Uncertainty guided multi-scale residual learning-using a cycle spinning cnn for single image de-raining. In: Proc. IEEE Int’l Conf. Computer Vision and Pattern Recognition

  40. Zhang H, Sindagi V, Patel VM (2017) Image de-raining using a conditional generative adversarial network. arXiv e-prints, p. arXiv:1701.05957

  41. Zhu L, Fu C, Lischinski D, Heng P (2017) Joint bilayer optimization for single-image rain streak removal. In: Proc. IEEE Int’l Conf. pp. 2545–2553. Computer Vision

Download references

Funding

It’s not funded by any agency/organization either technically or financially.

Author information

Authors and Affiliations

  1. Department of Computer Science & Engineering, National Institute of Technology Raipur, Raipur, Chhattisgarh, India

    Mamidipaka Tejaswini, T. Hari Sumanth & K. Jairam Naik

Authors
  1. Mamidipaka Tejaswini
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. T. Hari Sumanth
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. K. Jairam Naik
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to K. Jairam Naik.

Ethics declarations

Competing Interests

All authors have participated in (a) conception and design, analysis and interpretation of the data; (b) drafting the article or revising it critically for important intellectual content; and (c) approval of the final version. This manuscript has not been submitted to, nor is under review at, another journal or other publishing venue. The authors have no affiliation with any organization with a direct or indirect financial interest in the subject matter discussed in the manuscript.

Conflict of interests

The authors declare no potential conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tejaswini, M., Sumanth, T.H. & Naik, K.J. Single image deraining using modified bilateral recurrent network (modified_BRN). Multimed Tools Appl 83, 3373–3396 (2024). https://doi.org/10.1007/s11042-023-15276-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-15276-2

Keywords

Search

Navigation