Skip to main content

Advertisement

SpringerLink
Log in

A novel deep transfer learning based computerized diagnostic Systems for Multi-class imbalanced diabetic retinopathy severity classification

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Diabetic Retinopathy (DR) is a retinal condition that leads to gradual degeneration of the retina and eventual blindness, so early detection and evaluation of disease development are essential for effective treatment. Retinography is the most prevalent method for diagnosing DR; nevertheless, manual diagnosis is time-consuming and unpleasant. Deep Learning (DL) based algorithms have shown potential as a diagnostic tool for DR, achieving performance comparable to human image evaluation. The goal of this study is to develop Deep Transfer Learning-based Computerized Diagnostic Systems (DTL-CDS) for Multiclass DR Severity Classification (MCDR) by modifying and comparing deep inductive transfer learning (DITL) models (Inception V3, ResNet34, EfficientNet B0, VGG16, Xception). The four main objectives are i) pre-processing and balancing the imbalanced data labels, ii) proposing modified DITL model to extract features using global average pooling layer to avoid overfitting and reduce losses using leaky ReLU. The final classification uses a softmax layer to automatically classify Diabetic Retinopathy severity stages using IDRiD dataset, (iii) comparing different base and modified DITL models to existing work, and (iv) evaluating the robustness of proposed model using various performance metrics. Comprehensive analysis of MCDR between the proposed and the existing work shows that the proposed approach outperforms the state-of-the-art, with 99.36% accuracy, 0.986 precision, 0.986 recall, 0.986 F1-score, 0.997 AUC-ROC, 0.9902 AUC. The experimental results show the enhancement in diagnosis performance and modified DITL results in robust and reliable computer-aided diagnosis systems to aid specialists in proper detection of DR severity stages by reducing human errors and reducing costs.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

Data availability

The dataset utilized in the paper is freely accessible at: https://ieee-dataport.org/open-access/indian-diabetic-retinopathy-image-dataset-idrid#files

Code availability

The code will be provided on request.

References

  1. AbdelMaksoud E, Barakat S, Elmogy M (2022) A computer-aided diagnosis system for detecting various diabetic retinopathy grades based on a hybrid deep learning technique. Med Biol Eng Comput 60:2015–2038

    Article  Google Scholar 

  2. Aggarwal K, Mijwil MM, Al-Mistarehi AH, Alomari S, Gök M, Alaabdin AM, Abdulrhman SH (2022) Has the future started? The current growth of artificial intelligence, machine learning, and deep learning. Iraqi J Comput Sci Math 3(1):115–123

    Google Scholar 

  3. Alyoubi WL, Abulkhair MF, Shalash WM (2021) Diabetic retinopathy fundus image classification and lesions localization system using deep learning. Sensors 21(11):3704

    Article  Google Scholar 

  4. Alzubaidi L, Zhang J, Humaidi AJ, Al-Dujaili A, Duan Y, Al-Shamma O, Santamaría J, Fadhel MA, Al-Amidie M, Farhan L (2021) Review of deep learning: concepts, CNN architectures, challenges, applications, future directions. Journal of big Data 8(1):1–74

    Article  Google Scholar 

  5. Barkana BD, Saricicek I, Yildirim B (2017) Performance analysis of descriptive statistical features in retinal vessel segmentation via fuzzy logic, ANN, SVM, and classifier fusion. Knowl-Based Syst 118:165–176

    Article  Google Scholar 

  6. Bhardwaj C, Jain S, Sood M (2021) Deep learning–based diabetic retinopathy severity grading system employing quadrant ensemble model. J Digit Imaging 34(2):440–457

    Article  Google Scholar 

  7. Bhardwaj C, Jain S, Sood M (2021) Transfer learning based robust automatic detection system for diabetic retinopathy grading. Neural Comput Applic 33(20):13999–14019

    Article  Google Scholar 

  8. Bhawarkar Y, Bhure K, Chaudhary V, Alte B (2022) Diabetic retinopathy detection from fundus images using multi-tasking model with EfficientNet B5. In: ITM web of conferences 2022 EDP sciences Vol. 44 p. 03027.

  9. Bilal A, Sun G, Mazhar S (2021) Survey on recent developments in automatic detection of diabetic retinopathy. J Fr Ophtalmol 44(3):420–440

    Article  Google Scholar 

  10. Bodapati JD (2022) Stacked convolutional auto-encoder representations with spatial attention for efficient diabetic retinopathy diagnosis. Multimed Tools Appl 81:32033–32056

    Article  Google Scholar 

  11. Chaudhary PK, Pachori RB (2022) Automatic diagnosis of different grades of diabetic retinopathy and diabetic macular edema using 2D-FBSE-FAWT. IEEE Trans Instrum Meas 71:1–9

    Article  Google Scholar 

  12. Chollet F (2017) Xception: deep learning with depthwise separable convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition pp. 1251-1258

  13. Choudhary P, Hazra A (2021) Chest disease radiography in twofold: using convolutional neural networks and transfer learning. Evol Syst 12(2):567–579

    Article  Google Scholar 

  14. Das S, Kharbanda K, Suchetha M, Raman R, Dhas E (2021) Deep learning architecture based on segmented fundus image features for classification of diabetic retinopathy. Biomed Signal Process Control 68:102600

    Article  Google Scholar 

  15. Deepa V, Sathish Kumar C, Cherian T (2022) Automated grading of diabetic retinopathy using CNN with hierarchical clustering of image patches by siamese network. Phys Eng Sci Med 45:623–635

    Article  Google Scholar 

  16. Elsawah D, Elnakib A, Moustafa HE (2020) Deep learning grading system for diabetic retinopathy using fundus images (Dept. E). MEJ-Mansoura Eng J 45(4):1–8

    Article  Google Scholar 

  17. Friedman M (1937) The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J Am Stat Assoc 32(200):675–701

    Article  MATH  Google Scholar 

  18. Ganesh M, Dulam S, Venkatasubbu P (2022) Diabetic retinopathy diagnosis with InceptionResNetV2, Xception, and EfficientNetB3. In Artificial Intelligence and Technologies Springer pp 405–413

  19. Gangwar AK, Ravi V (2021) Diabetic retinopathy detection using transfer learning and deep learning. In: Evolution in Computational Intelligence: Frontiers in Intelligent Computing: Theory and Applications (FICTA 2020). Springer Singapore, vol 1, pp 679–689

  20. Gangwar AK, Ravi V (2021) Diabetic retinopathy detection using transfer learning and deep learning. In: Evolution in computational intelligence. Springer, Singapore, pp 679–689

    Chapter  Google Scholar 

  21. Garcia S, Herrera F (2008) An extension on" statistical comparisons of classifiers over multiple data sets" for all pairwise comparisons. J Mach Learn Res 9(12)

  22. Gherghout Y, Tlili Y, Souici L (2021) Classification of breast mass in mammography using anisotropic diffusion filter by selecting and aggregating morphological and textural features. Evol Syst 12(2):273–302

    Article  Google Scholar 

  23. He K, Zhang X, Ren S, Sun J (2016) Identity mappings in deep residual networks. In: Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part IV 14. Springer International Publishing, pp 630–645

  24. Hemanth DJ, Deperlioglu O, Kose U (2020) An enhanced diabetic retinopathy detection and classification approach using deep convolutional neural network. Neural Comput Applic 32(3):707–721

    Article  Google Scholar 

  25. Heydon P, Egan C, Bolter L, Chambers R, Anderson J, Aldington S, Stratton IM, Scanlon PH, Webster L, Mann S, du Chemin A (2021) Prospective evaluation of an artificial intelligence-enabled algorithm for automated diabetic retinopathy screening of 30 000 patients. Br J Ophthalmol 105(5):723–728

    Article  Google Scholar 

  26. Huang S, Lee F, Miao R, Si Q, Lu C, Chen Q (2020) A deep convolutional neural network architecture for interstitial lung disease pattern classification. Med Biol Eng Comput 58(4):725–737

    Article  Google Scholar 

  27. Islam MR, Abdulrazak LF, Nahiduzzaman M, Goni MO, Anower MS, Ahsan M, Haider J, Kowalski M (2022) Applying supervised contrastive learning for the detection of diabetic retinopathy and its severity levels from fundus images. Comput Biol Med 146:105602

    Article  Google Scholar 

  28. Jabbar MK, Yan J, Xu H, Ur Rehman Z, Jabbar A (2022) Transfer learning-based model for diabetic retinopathy diagnosis using retinal images. Brain Sci 12(5):535

    Article  Google Scholar 

  29. Kadry S, Rajinikanth V, Damaševičius R, Taniar D (2021) Retinal vessel segmentation with slime-Mould-optimization based multi-scale-matched-filter. In 2021 seventh international conference on bio signals, images, and instrumentation (ICBSII). IEEE. pp. 1-5

  30. Kandel I, Castelli M (2021) Transfer learning with convolutional neural networks for diabetic retinopathy image classification. A review. Applied Sciences 10(6):2021

    Article  Google Scholar 

  31. Kaushik H, Singh D, Kaur M, Alshazly H, Zaguia A, Hamam H (2021) Diabetic retinopathy diagnosis from fundus images using stacked generalization of deep models. IEEE Access 9:108276–108292

    Article  Google Scholar 

  32. Kumar G, Singh UP, Jain S (2021) Hybrid evolutionary intelligent system and hybrid time series econometric model for stock price forecasting. Int J Intell Syst 36(9):4902–4935

    Article  Google Scholar 

  33. Kumar G, Singh UP, Jain S (2021) Swarm intelligence based hybrid neural network approach for stock Price forecasting. Comput Econ 29:1–49

    Google Scholar 

  34. LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521:436–444

    Article  Google Scholar 

  35. Luo L, Xue D, Feng X (2020) Automatic diabetic retinopathy grading via self-knowledge distillation. Electronics 9(9):1337

    Article  Google Scholar 

  36. Maqsood S, Damaševičius R, Maskeliūnas R (2021) Hemorrhage detection based on 3D CNN deep learning framework and feature fusion for evaluating retinal abnormality in diabetic patients. Sensors 21(11):3865

    Article  Google Scholar 

  37. Maqsood S, Damaševičius R, Shah FM, Maskeliunas R (2021) Detection of macula and recognition of aged-related macular degeneration in retinal fundus images. Comput Inform 40(5):957–987

    Article  Google Scholar 

  38. Math L, Fatima R (2021) Adaptive machine learning classification for diabetic retinopathy. Multimed Tools Appl 80(4):5173–5186

    Article  Google Scholar 

  39. Mijwil MM (2021) Skin cancer disease images classification using deep learning solutions. Multimed Tools Appl 80(17):26255–26271

    Article  Google Scholar 

  40. Minaee S, Kafieh R, Sonka M, Yazdani S, Soufi GJ (2020) Deep-COVID: predicting COVID-19 from chest X-ray images using deep transfer learning. Med Image Anal 65:101794

    Article  Google Scholar 

  41. Mishkin D, Sergievskiy N, Matas J (2017) Systematic evaluation of convolution neural network advances on the Imagenet. Comput Vis Image Understand 161:11–19

    Article  Google Scholar 

  42. Oh K, Kang HM, Leem D, Lee H, Seo KY, Yoon S (2021) Early detection of diabetic retinopathy based on deep learning and ultra-wide-field fundus images. Sci Rep 11(1):1–9.

  43. Pires R, Avila S, Wainer J, Valle E, Abramoff MD, Rocha A (2019) A data-driven approach to referable diabetic retinopathy detection. Artif Intell Med 96:93–106

    Article  Google Scholar 

  44. Porwal P, Pachade S, Kamble R, Kokare M, Deshmukh G, Sahasrabuddhe V, Meriaudeau F (2018) Indian diabetic retinopathy image dataset (IDRiD): a database for diabetic retinopathy screening research. Data 3(3):25

    Article  Google Scholar 

  45. Pratt H, Coenen F, Broadbent DM, Harding SP, Zheng Y (2016) Convolutional neural networks for diabetic retinopathy. Procedia Comput Sci 90:200–205

    Article  Google Scholar 

  46. Shaik NS, Cherukuri TK (2022) Hinge attention network: a joint model for diabetic retinopathy severity grading. Appl Intell 52:15105–15121

    Article  Google Scholar 

  47. Shanthi T, Sabeenian RS (2019) Modified Alexnet architecture for classification of diabetic retinopathy images. Comput Electr Eng 76:56–64

    Article  Google Scholar 

  48. Sharma S, Maheshwari S, Shukla A (2018) An intelligible deep convolution neural network based approach for classification of diabetic retinopathy. Bio-Algorithms Med-Syst 14(2). https://doi.org/10.1515/bams-2018-0011

  49. Shin HC, Roth HR, Gao M, Lu L, Xu Z, Nogues I, ... Summers RM (2016) Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging 35(5):1285–1298

  50. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition arXiv preprint arXiv:1409.1556

  51. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition pp. 1-9

  52. Tan M, Le Q (2019) Efficientnet: rethinking model scaling for convolutional neural networks. In International conference on machine learning PMLR pp 6105–6114

  53. Ting DS, Wu WC, Toth C (2019) Deep learning for retinopathy of prematurity screening. Br J Ophthalmol 103(5):577–579

    Article  Google Scholar 

  54. Vashist P, Singh S, Gupta N, Saxena R (2011) Role of early screening for diabetic retinopathy in patients with diabetes mellitus: an overview. Indian J Community Med: official publication of Indian Association of Preventive & Social Medicine 36(4):247–252

    Article  Google Scholar 

  55. Vij R, Arora S (2022) A systematic survey of advances in retinal imaging modalities for Alzheimer’s disease diagnosis. Metab Brain Dis 37:1–31

    Article  Google Scholar 

  56. Vij R, Arora S (2022) Computer vision with deep learning techniques for neurodegenerative diseases analysis using neuroimaging: a survey. In: International conference on innovative computing and communications pp. 179-189

  57. Vij R, Kaushik B (2019) A survey on various face detecting and tracking techniques in video sequences. In: 2019 international conference on intelligent computing and control systems (ICCS) IEEE pp. 69-73

  58. Yu M, Wang Y (2022) Intelligent detection and applied research on diabetic retinopathy based on the residual attention network. Int J Imaging Syst Technol 32:1789–1800

    Article  Google Scholar 

  59. Zago GT, Andreão RV, Dorizzi B, Salles EO (2020) Diabetic retinopathy detection using red lesion localization and convolutional neural networks. Comput Biol Med 116:103537

    Article  Google Scholar 

  60. Zhang W, Zhong J, Yang S, Gao Z, Hu J, Chen Y, Yi Z (2019) Automated identification and grading system of diabetic retinopathy using deep neural networks. Knowl-Based Syst 175:12–25

    Article  Google Scholar 

  61. Zhao JJ, Pan L, Zhao PF, Tang XX (2017) Medical sign recognition of lung nodules based on image retrieval with semantic features and supervised hashing. J Comput Sci Technol 32(3):457–469

    Article  Google Scholar 

  62. Zhu CZ, Hu R, Zou BJ, Zhao RC, Chen CL, Xiao YL (2019) Automatic diabetic retinopathy screening via cascaded framework based on image-and lesion-level features fusion. J Comput Sci Technol 34(6):1307–1318

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computer Science & Engineering, Shri Mata Vaishno Devi University, Katra, Jammu and Kashmir, 182320, India

    Richa Vij & Sakshi Arora

Authors
  1. Richa Vij
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sakshi Arora
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

1Richa Vij: Conceptualization, Writing-Original draft preparation, Methodology, Formal analysis, Visualization. 2Sakshi Arora: Supervision, Writing- Reviewing and Editing, Validation.

Corresponding author

Correspondence to Richa Vij.

Ethics declarations

Conflict of interest

The authors have no conflict of interest.

Ethical approval

Not applicable.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Vij, R., Arora, S. A novel deep transfer learning based computerized diagnostic Systems for Multi-class imbalanced diabetic retinopathy severity classification. Multimed Tools Appl 82, 34847–34884 (2023). https://doi.org/10.1007/s11042-023-14963-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-14963-4

Keywords

Search

Navigation