Skip to main content
SpringerLink
Log in

Deep belief network for solving the image quality assessment in full reference and no reference model

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Image Quality Assessment (IQA) is one of the essential problems in image processing. The growth of natural image quality assessment methods has collected a large range of research achievements that are separated into three categories, such as Full Reference Image Quality Assessment (FR-IQA), and Reduced Reference Image Quality Assessment (RR-IQA), and No Reference Image Quality Assessment (NR-IQA). With the rapid growth of digital vision technology, the image quality estimation process quantifies the quality of an image that is used to transmit and acquire images. In this paper, we present a novel Lee Sigma Filterized Mathieu Feature Transformation-based Radial Kernel Deep Belief Network (LSFMFT-RKDBN) model that has been developed for estimating the image quality with and without a reference image. First, the proposed technique performs the quality estimation with full reference called LSFMFT-RKDBN-FR model work that is based on the layer-by-layer method. The visible layer of the Deep Belief Network (DBN) receives the test and reference images. Next, the input test and reference images are de-noised by applying the weighted Lee sigma filter. The de-noised images are partitioned into several patches for accurate feature extraction. Then, the Mathieu transformation is applied to obtain the test feature vector and reference feature vector. At the output layer, the radial basis kernel activation function is applied to analyze the feature vectors and display the estimated results. On the other hand, the proposed model is applied with no reference (LSFMFT-RKDBN-NR) to estimate the test image quality. The LSFMFT-RKDBN-NR model with image de-noising, patch extraction, and feature extraction is carried out to create a test feature vector. Finally, the estimated results are obtained at the output layer. We evaluate the proposed LSFMFT-RKDBN model on the CSIQ Image Quality dataset with qualitative and quantitative results analysis. The proposed LSFMFT-RKDBN model is used to estimate the image quality with higher accuracy and less time and memory consumption when compared to other related methods. The observed result shows the superior performance of the proposed LSFMFT-RKDBN model compared with the two state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. Bosse S, Maniry D, Muller K, Wiegand T, Samek W (2018) Deep neural networks for no-reference and full-reference image quality assessment. IEEE Trans Image Process 27(1):206–219

    Article  MathSciNet  MATH  Google Scholar 

  2. Yuan Y, Hai S, Juhuac L, Guoqiang Z (2020) Locally and multiply distorted image quality assessment via multi-stage CNNs. Inf Process Manag 57(4):1–14

    Article  Google Scholar 

  3. Jiang X, Shen L, Yu L, Jiang M, Feng G (2020) No-reference screen content image quality assessment based on multi-region features. Neurocomputing 386:30–41

    Article  Google Scholar 

  4. Dharmalingam M, Amalraj R (2014) Back-propagation neural network architecture for solving the double dummy bridge problem in contract bridge. In: IEEE international conference on intelligent computing applications conducted at Bharathiar University, Coimbatore, pp 454–461, March 6–7, 2014. ISBN: 978-1-4799-3966-4/14. https://doi.org/10.1109/ICICA.2014.99

  5. Zhang C, Yang X, Huang X, Yu G, Chen S (2018) No-reference image quality assessment based on quality patches in real time. J Image Video Process. https://doi.org/10.1186/s13640-018-0361-z

    Article  Google Scholar 

  6. Zhang C, Cheng W, Hirakawa K (2019) Corrupted reference image quality assessment of de-noised images. IEEE Trans Image Process 28(4):1732–1747

    Article  MathSciNet  Google Scholar 

  7. Bian T (2020) An ensemble image quality assessment algorithm based on deep feature clustering. Signal Process Image Commun 81:1–7. https://doi.org/10.1016/j.image.2019.115703

    Article  Google Scholar 

  8. Shi Z, Zhang J, Cao Q, Pang K, Luo T (2018) Full-reference image quality assessment based on image segmentation with edge feature. Signal Process 145:99–105

    Article  Google Scholar 

  9. Rakkimuthu D (2019) Delta ruled fully recurrent deep learning for finger-vein verification. Int J Innov Technol Explor Eng 09(02):1580–1588

    Article  Google Scholar 

  10. Sadiq A, Nizami IF, Anwar SM, Majid M (2020) Blind image quality assessment using natural scene statistics of stationary wavelet transform. Optik 205:1–38

    Article  Google Scholar 

  11. Zhou Z, Lu W, Yang J, He W (2020) No-reference image quality assessment based on neighborhood co-occurrence matrix. Signal Process Image Commun 81:1–9. https://doi.org/10.1016/j.image.2019.115680

    Article  Google Scholar 

  12. Dassa R, Yadav N (2020) Image quality assessment parameters for despeckling filters. Procedia Comput Sci 167:2382–2392

    Article  Google Scholar 

  13. Yan B, Bare B, Tan W (2019) Naturalness-aware deep no-reference image quality assessment. IEEE Trans Multimed 21(10):2603–2615

    Article  Google Scholar 

  14. Freitas PG, Akamine WYL, Farias MCQ (2018) Referenceless image quality assessment by saliency, color-texture energy, and gradient boosting machines. J Braz Comput Soc 24:1–16. https://doi.org/10.1186/s13173-018-0073-3

    Article  Google Scholar 

  15. Shi Y, Guo W, Niu Y, Zhan J (2020) No-reference stereoscopic image quality assessment using a multi-task CNN and registered distortion representation. Pattern Recognit 100:1–35

    Article  Google Scholar 

  16. Fang Y, Yan J, Li L, Wu J, Lin W (2018) No reference quality assessment for screen content images with both local and global feature representation. IEEE Trans Image Process 27(4):1600–1610

    Article  MathSciNet  MATH  Google Scholar 

  17. Abbas N, Saba T, Khan S, Mehmood Z, Rehman A, Tabasum R (2020) Reduced reference image quality assessment technique based on DWT and path integral local binary patterns. Arab J Sci Eng 4:3387–3401

    Article  Google Scholar 

  18. Kim HG, Lim HT, Ro YM (2020) Deep virtual reality image quality assessment with human perception guider for omni directional image. IEEE Trans Circuits Syst Video Technol 30(4):917–928

    Article  Google Scholar 

  19. Dharmalingam M, Amalraj R (2014) A solution to the double dummy bridge problem in contract bridge influenced by supervised learning module adapted by artificial neural network. ICTACT J Soft Comput 5:836–843

    Article  Google Scholar 

  20. Dharmalingam M (2018) Double dummy bridge problem in contract bridge: an overview. Int J Artif Intell Syst Mach Learn 10(1):01–07

    Google Scholar 

  21. Cao J, Wang S, Wang R, Zhang X, Kwong S (2019) Content-oriented image quality assessment with multi-label SVM classifier. Signal Process Image Commun 78:388–397. https://doi.org/10.1016/j.image.2019.07.018

    Article  Google Scholar 

  22. Claudio EDD, Jacovitti G (2018) A detail-based method for linear full reference image quality prediction. IEEE Trans Image Process 27(1):179–193

    Article  MathSciNet  MATH  Google Scholar 

  23. Sun W, Liao Q, Xue JH, Zhou F (2018) SPSIM: a superpixel-based similarity index for full-reference image quality assessment. IEEE Trans Image Process 27(9):4232–4244

    Article  MathSciNet  MATH  Google Scholar 

  24. Amalraj R, Dharmalingam M (2015) A work point system coupled with back-propagation for solving double dummy bridge problem. Neurocomputing 168:160–178

    Article  Google Scholar 

  25. Sathyamoorthy S, Dharmalingam M (2019) Convolutional neural network for no reference and full reference using image quality assessment. Int J Emerg Technol 10(2):351–356

    Google Scholar 

  26. Dharmalingam M, Sathyamoorthy S (2021) Adaptive frost filtered quantile regressive artificial deep structure learning framework for image quality assessment. Lect Notes Data Eng Commun Technol 58:317–336. https://doi.org/10.1007/978-981-15-9647-6_25

    Article  Google Scholar 

  27. Zhao M, Zhang Y, Zhang Z, Liu J, Kong W (2019) ALG: adaptive low-rank graph regularization for scalable semi-supervised and unsupervised learning. Neurocomputing 370:16–27

    Article  Google Scholar 

  28. Zhu Y, Wu X, Li P, Zhang Y, Hu X (2019) Transfer learning with deep manifold regularized auto-encoders. Neurocomputing 369:145–154

    Article  Google Scholar 

  29. Jia X, Feng X, Wang W, Zhang L (2018) An extended variational image decomposition model for color image enhancement. Neurocomputing 322:216–228

    Article  Google Scholar 

  30. Du J, Xie X, Wang C, Shi G, Xu X, Wang Y (2019) Fully convolutional measurement network for compressive sensing image reconstruction. Neurocomputing 328:105–112

    Article  Google Scholar 

  31. Jin X, Xiong Q, Xiong C, Li Z, Gao Z (2019) Single image super-resolution with multi-level feature fusion recursive network. Neurocomputing 370:166–173

    Article  Google Scholar 

  32. Liu B, Boudaoud DA (2020) Effective image super resolution via hierarchical convolutional neural network. Neurocomputing 374:109–116

    Article  Google Scholar 

  33. Zhang W, Ma K, Yan J, Deng D, Wang Z (2020) Blind image quality assessment using a deep bilinear convolutional neural network. IEEE Trans Circuits Syst Video Technol 30(1):36–47

    Article  Google Scholar 

  34. Gu K, Jakhetiya V, Qiao J, Li X, Lin W, Thalmann D (2018) Model-based referenceless quality metric of 3D synthesized images using local image description. IEEE Trans Image Process 27(1):394–405

    Article  MathSciNet  MATH  Google Scholar 

  35. Gu K, Zhou J, Qiao J, Zhai G, Lin W, Bovik A (2017) No-reference quality assessment of screen content pictures. IEEE Trans Image Process 26(8):4005–4018

    Article  MathSciNet  MATH  Google Scholar 

  36. Gu K, Li L, Lu H, Min X, Lin W (2017) A fast reliable image quality predictor by fusing micro- and macro-structures. IEEE Trans Ind Electron 64(5):3903–3912

    Article  Google Scholar 

  37. Gu K, Wang S, Yang H, Lin W, Zhai G, Yang X, Zhang W (2016) Saliency-guided quality assessment of screen content images. IEEE Trans Multimed 18(6):1098–1110

    Article  Google Scholar 

  38. Wang Z (2011) Applications of objective image quality assessment methods. IEEE Signal Process Mag 28(6):137–142

    Article  Google Scholar 

  39. Gu K, Tao D, Qiao J, Lin W (2018) Learning a no-reference quality assessment model of enhanced images with big data. IEEE Trans Neural Netw Learn Syst 29(4):1301–1313

    Article  Google Scholar 

  40. Gu K, Zhai G, Lin W, Liu M (2016) The analysis of image contrast: from quality assessment to automatic enhancement. IEEE Trans Cybern 46(1):284–297

    Article  Google Scholar 

  41. Gu K, Zhai G, Yang X, Zhang W, Chen C (2015) Automatic contrast enhancement technology with saliency preservation. IEEE Trans Circuits Syst Video Technol 25(9):1480–1494

    Article  Google Scholar 

  42. Gu K, Wang S, Zhai G, Ma S, Yang X, Lin W, Zhang W, Gao W (2016) Blind quality assessment of tone-mapped images via analysis of information naturalness, and structure. IEEE Trans Multimed 18(3):432–443

    Article  Google Scholar 

  43. Hong C, Yu J, Zhang J, Jin X, Lee K (2019) Multimodal face-pose estimation with multitask manifold deep learning. IEEE Trans Ind Inform 15(7):3952–3961

    Article  Google Scholar 

  44. Yu J, Tao D, Wang M, Rui Y (2015) Learning to rank using user clicks and visual features for image retrieval. IEEE Trans Cybern 45(4):767–779

    Article  Google Scholar 

  45. Yu J, Tan M, Zhang H, Tao D, Rui Y (2022) Hierarchical deep click feature prediction for fine-grained image recognition. IEEE Trans Pattern Anal Mach Intell 44(02):563–578. https://doi.org/10.1109/TPAMI.2019.2932058

    Article  Google Scholar 

  46. Hong C, Yu J, Wan J, Tao D, Wang M (2015) Multimodal deep autoencoder for human pose recovery. IEEE Trans Image Process 24(12):5659–5670

    Article  MathSciNet  MATH  Google Scholar 

  47. Hong C, Yu J, Tao D, Wang M (2015) Image-based three-dimensional human pose recovery by multiview locality-sensitive sparse retrieval. IEEE Trans Ind Electron 62(6):3742–3751. https://doi.org/10.1109/TIE.2014.2378735

    Article  Google Scholar 

  48. Chen W, Gu K, Zhao T, Jiang G, Callet PL (2020) Semi-reference sonar image quality assessment based on task and visual perception. IEEE Trans Multimed 23:1008–1020. https://doi.org/10.1109/TMM.2020.2991546

    Article  Google Scholar 

  49. Wang G, Qiao J (2021) An efficient self-organizing deep fuzzy neural network for nonlinear system modeling. IEEE Trans Fuzzy Syst Early Access. https://doi.org/10.1109/TFUZZ.2021.3077396

    Article  Google Scholar 

  50. Muthusamy D, Ponnusamy R (2022) Trilateral filterative Hermitian feature transformed deep perceptive fuzzy neural network for finger vein verification. Expert Syst Appl 196(15):116678. https://doi.org/10.1016/j.eswa.2022.116678

    Article  Google Scholar 

  51. Wang G, Shanjia Q, Qiao J, Bi J (2020) A sparse deep belief network with efficient fuzzy learning framework. Neural Netw 121:430–440

    Article  Google Scholar 

  52. Wang G, Qiao J, Bi J, Li W, Zhou M (2019) TL-GDBN: growing deep belief network with transfer learning. IEEE Trans Autom Sci Eng 16(2):874–885

    Article  Google Scholar 

  53. Rajevenceltha J, Gaidhane VH (2021) An efficient approach for no-reference image quality assessment based on statistical texture and structural features. Eng Sci Technol Int J. https://doi.org/10.1016/j.jestch.2021.07.002

    Article  Google Scholar 

  54. Liang D, Gao X, Wen Lu, Li J (2021) Deep blind image quality assessment based on multiple instance regression. Neurocomputing 431:78–89

    Article  Google Scholar 

  55. Dharmalingam M, Rakkimuthu P (2021) Steepest deep bipolar cascade correlation for finger-vein verification. Appl Intell 52(4):3825–3845

    Google Scholar 

  56. Varga D (2020) Composition-preserving deep approach to full-reference image quality assessment. SIViP 14:1265–1272. https://doi.org/10.1007/s11760-020-01664-w

    Article  Google Scholar 

  57. Ding K, Ma K, Wang S et al (2021) Comparison of full-reference image quality models for optimization of image processing systems. Int J Comput Vis 129:1258–1281. https://doi.org/10.1007/s11263-020-01419-7

    Article  Google Scholar 

  58. Huang Z, Liu S (2021) Perceptual hashing with visual content understanding for reduced-reference screen content image quality assessment. IEEE Trans Circuits Syst Video Technol 31(7):2808–2823. https://doi.org/10.1109/TCSVT.2020.3027001

    Article  Google Scholar 

  59. Jiang X, Shen L, Feng G, Yu L, Ping A (2021) An optimized CNN-based quality assessment model for screen content image. Signal Process Image Commun 94:116181. https://doi.org/10.1016/j.image.2021.116181

    Article  Google Scholar 

  60. Li B, Tian M, Zhang W, Yao H, Wang X (2021) Learning to predict the quality of distorted-then-compressed images via a deep neural network. J Visual Commun Image Represent 76:10300. https://doi.org/10.1016/j.jvcir.2020.103004

    Article  Google Scholar 

  61. Kong Y, Cui L, Hou R (2020) Full-reference IPTV image quality assessment by deeply learning structural cues. Signal Process Image Commun 83:115779. https://doi.org/10.1016/j.image.2020.115779

    Article  Google Scholar 

  62. Toprak I, Toygar O (2021) Detection of spoofing attacks for ear biometrics through image quality assessment and deep learning. Expert Syst Appl 172:11460. https://doi.org/10.1016/j.eswa.2021.114600

    Article  Google Scholar 

  63. Larson EC, Chandler DM (2010) Most apparent distortion: full-reference image quality assessment and the role of strategy. J Electron Imaging 19(1):011006–011021

    Article  Google Scholar 

  64. Sheikh HR, Wang Z, Cormack L, Bovik AC. LIVE Image Quality Assessment Database Release 2. http://live.ece.utexas.edu/research/quality

  65. Sheikh HR, Sabir MF, Bovik AC (2006) A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Trans Image Process 15(11):3440–3451

    Article  Google Scholar 

  66. A new color image database TID2013: innovations and results. In: Ponomarenko N, Ieremeiev O, Lukin V, Egiazarian K, Jin L, Astola J, Vozel B, Chehdi K, Carli M, Battisti F, Jay Kuo C-C (eds) Proceedings of ACIVS, Poznan, Poland, Oct 2013, pp 402–413

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Government Arts and Science College, Modakkurichi, Erode (Dt), Tamil Nadu, 638104, India

    Dharmalingam Muthusamy

  2. Department of Computer Science, Government Arts and Science College, Gudalur, Ooty (Dt), Tamil Nadu, 643212, India

    S. Sathyamoorthy

Authors
  1. Dharmalingam Muthusamy
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. S. Sathyamoorthy
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dharmalingam Muthusamy.

Ethics declarations

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Muthusamy, D., Sathyamoorthy, S. Deep belief network for solving the image quality assessment in full reference and no reference model. Neural Comput & Applic 34, 21809–21833 (2022). https://doi.org/10.1007/s00521-022-07649-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-022-07649-9

Keywords

Search

Navigation