Skip to main content

Advertisement

Log in

Automated Quality Assessment of Colour Fundus Images for Diabetic Retinopathy Screening in Telemedicine

  • Published:
Journal of Digital Imaging Aims and scope Submit manuscript

Abstract

Fundus images obtained in a telemedicine program are acquired at different sites that are captured by people who have varying levels of experience. These result in a relatively high percentage of images which are later marked as unreadable by graders. Unreadable images require a recapture which is time and cost intensive. An automated method that determines the image quality during acquisition is an effective alternative. To determine the image quality during acquisition, we describe here an automated method for the assessment of image quality in the context of diabetic retinopathy. The method explicitly applies machine learning techniques to access the image and to determine ‘accept’ and ‘reject’ categories. ‘Reject’ category image requires a recapture. A deep convolution neural network is trained to grade the images automatically. A large representative set of 7000 colour fundus images was used for the experiment which was obtained from the EyePACS that were made available by the California Healthcare Foundation. Three retinal image analysis experts were employed to categorise these images into ‘accept’ and ‘reject’ classes based on the precise definition of image quality in the context of DR. The network was trained using 3428 images. The method shows an accuracy of 100% to successfully categorise ‘accept’ and ‘reject’ images, which is about 2% higher than the traditional machine learning method. On a clinical trial, the proposed method shows 97% agreement with human grader. The method can be easily incorporated with the fundus image capturing system in the acquisition centre and can guide the photographer whether a recapture is necessary or not.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Notes

  1. Processor: Intel Core i7 2.90 GHz, RAM: 32 GB

References

  1. Michelson G Ed: Teleophthalmology in preventive medicine. Berlin Heidelberg: Springer, 2015

  2. Patton N, Aslam TM, MacGillivray T, Deary IJ, Dhillon B, Eikelboom RH, Yogesan K, Constable IJ: Retinal image analysis: concepts, applications and potential. Prog Retin Eye Res 25(1):99–127, 2011

    Article  Google Scholar 

  3. Luzio S, Hatcher S, Zahlmann G, Mazik L, Morgan M, Liesenfeld B, Bek T, Schuell H, Schneider S, Owens DR, Kohner E: Feasibility of using the TOSCA telescreening procedures for diabetic retinopathy. Diabet Med. 21(10):1121–1128, 2004

    Article  CAS  Google Scholar 

  4. Sim DA, Keane PA, Tufail A, Egan CA, Aiello LP, Silva PS: Automated retinal image analysis for diabetic retinopathy in telemedicine. Current Diabetes Reports 15:14, 2015

    Article  Google Scholar 

  5. Vashist P, Singh S, Gupta N, Saxena R: Role of early screening for diabetic retinopathy in patients with diabetes mellitus: an overview. Indian journal of community medicine: official publication of Indian Association of Preventive & Social Medicine 36(4):247, 2011

    Article  Google Scholar 

  6. ETDRS Research Group: ETDRS report number 9. Early treatment diabetic retinopathy study research group. Ophthalmology 98(5 Suppl):766–785, 1991

    Google Scholar 

  7. Niemeijer M, Abramoff MD, van Ginneken B: Image structure clustering for image quality verification of color retina images in diabetic retinopathy screening. Med Image Anal. 10(6):888–898, 2006

    Article  Google Scholar 

  8. Abramoff MD, Suttorp-schulten MSA: Web-based screening for diabetic retinopathy in a primary care population: the EyeCheck project. J Telemed e-Health 11(6):668–675, 2005

    Article  Google Scholar 

  9. LeCun Y, Bengio Y, Hinton G: Deep learning. Nature [Internet] 521(7553):436–444, 2015. https://doi.org/10.1038/nature14539%5Cn10.1038/nature14539

    Article  CAS  Google Scholar 

  10. Giancardo L, Meriaudeau F, Karnowski TP,Chaum E, Tobin K: New developments in biomedical engineering. Domenico Campolo, Online: IntechOpen, 2010

    Google Scholar 

  11. UK National Screening Committee. Essential Elements in Developing a Diabetic Retinopathy Screening Programme. Available at https://bulger.co.uk/dacorumhealth/daccom/PDF%20Documents/Diabetic%20Retinopathy%20Screening%20(Workbook%20R4.1%202Aug07).pdf. Accessed 26 January 2017.

  12. Paulus J, Meier J, Bock R, Hornegger J, Michelson G: Automated quality assessment of retinal fundus photos. Int J Comput Assist Radiol Surg. 5(6):557–564, 2010

    Article  Google Scholar 

  13. Imani E, Pourreza H, Banaee T: Retinal image quality assessment using Shearlet transform. In: Constanda C, Kirsch A Eds. Integral Methods in Science and Engineering. Cham: Birkhäuser, 2015, pp 329–339

    Chapter  Google Scholar 

  14. Lee SC, Wang Y: Automatic retinal image quality assessment and enhancement. Proceedings of SPIE Image Processing, 1999, pp 1581–1591

  15. Lalonde M, Gagnon L, Boucher M: Automatic visual quality assessment in optical fundus images. Ottawa Proceedings of Vision Interface, 2001, pp 259–264

  16. Davis H, Russell S, Barriga E, Abramoff M, Soliz P: Vision-based, real-time retinal image quality assessment. 22nd IEEE International Symposium on Computer-Based Medical Systems, 2009, pp 1–6

  17. Bartling H, Wanger P, Martin L: Automated quality evaluation of digital fundus photographs. Acta Ophthalmol 87(6):643–647, 2009

    Article  Google Scholar 

  18. Dias J, Oliveira CM, Da Silva Cruz LA: Retinal image quality assessment using generic image quality indicators. Inf Fusion 19(1):73–90, 2014

    Article  Google Scholar 

  19. Usher DB, Himaga M, Dumskyj MJ: Automated assessment of digital fundus image quality using detected vessel area. Proceedings of Medical Image Understanding and Analysis, 2003, pp 81–84

  20. Fleming AD, Philip S, Goatman KA, Olson JA, Sharp PF: Automated assessment of diabetic retinal image quality based on clarity and field definition. Investig Ophthalmol Vis Sci. 47(3):1120–1125, 2006

    Article  Google Scholar 

  21. Hunter A, Lowell JA, Habib M, Ryder B, Basu A, Steel D: An automated retinal image quality grading algorithm. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society. EMBS, 2011, pp 5955–5958

  22. Lowell J, Hunter A, Habib M, Steel D: Automated quantification of fundus image quality. 3rd European Medical and Biological Engineering Conference: 1618, 2005

  23. Giancardo L, Abramoff MD, Chaum E, Karnowski TP, Meriaudeau F, Tobin KW: Elliptical local vessel density: a fast and robust quality metric for retinal images. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society. EMBS, 2008, pp 3534–3537

  24. Bengio Y: Learning deep architectures for AI. Found Trends®. Mach Learn. 2(1):1–127, 2009

    Article  Google Scholar 

  25. Schmidhuber J: Deep learning in neural networks: an overview. Neural Networks 61:85–117, 2015

    Article  Google Scholar 

  26. Krizhevsky A, Sutskever I, Hinton GE: ImageNet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, 2012, pp 1–9

  27. Saha S, Fletcher A, Xiao D, Kanagasingam Y: A novel method for automated correction of non-uniform/poor illumination of retinal images without creating false artifacts. J Vis Commun Image Represent 51:95–103, 2018

    Article  Google Scholar 

  28. Goatman KA, Whitwam AD, Manivannan A, Olson JA, Sharp PF: Colour normalisation of retinal images. Proceedings of medical image understanding and analysis: 49-52, 2003

  29. Rosasco L, De Vito E, Caponnetto A, Piana M, Verri A: Are loss functions all the same? Neural Comput [Internet] 16(5):1063–1076, 2004 Available from: http://www.ncbi.nlm.nih.gov/pubmed/15070510

    Article  Google Scholar 

  30. Tajbakhsh N, Shin JY, Gurudu SR, Hurst RT, Kendall CB, Gotway MB, Liang J: Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE transactions on medical imaging. 35(5):1299–1312, 2016

    Article  Google Scholar 

  31. Saha SK, Xiao D, Fernando B, Tay-Kearney ML, An D, Kanagasingam Y: Deep learning based decision support system for automated diagnosis of age-related macular degeneration (AMD). Investigative Ophthalmology & Visual Science 58(8):25–25, 2017

    Google Scholar 

  32. Saha SK, Fernando B, Xiao D, Tay-Kearney ML, Kanagasingam Y: Deep learning for automatic detection and classification of microaneurysms, hard and soft exudates, and hemorrhages for diabetic retinopathy diagnosis. Investigative Ophthalmology & Visual Science 57(12):5962–5962, 2016

    Google Scholar 

  33. Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S, Darrell T: Caffe: convolutional architecture for fast feature embedding. Proceedings of the 22nd ACM International Conference on Multimedia, 2014, pp 675–678

  34. Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L: ImageNet: a large-scale hierarchical image database. IEEE Computer Vision and Pattern Recognition, 2009, pp 248–255

  35. Vedaldi A, Fulkerson B: An open and portable library of computer vision algorithms. Proceedings of the 18th ACM international conference on Multimedia, 2010, pp 1469–1472

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sajib Kumar Saha.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Saha, S.K., Fernando, B., Cuadros, J. et al. Automated Quality Assessment of Colour Fundus Images for Diabetic Retinopathy Screening in Telemedicine. J Digit Imaging 31, 869–878 (2018). https://doi.org/10.1007/s10278-018-0084-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10278-018-0084-9

Keywords

Navigation