Skip to main content
SpringerLink
Log in

Multiple graph reasoning network for joint optic disc and cup segmentation

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Glaucoma is one of the most irreversible eye diseases that causes visual damage worldwide. For glaucoma screening, it is essential to accurately segment the optic disc (OD) from the optic cup (OC) in fundus images. However, most of the known segmentation methods are two-stage processes and cannot obtain satisfactory segmentations without performing OD localization in advance. To overcome this limitation, in this paper, we propose a novel one-stage framework named the multiple graph reasoning network (MGRNet) to segment ODs and OCs from different fundus image datasets. The MGRNet performs graph inference in the Euclidean space, channel space, and hyperbolic space. Euclidean space-based graph reasoning captures the spatial dependencies between pixels from the coordinate dimension. Channel space-based graph reasoning constructs the channel relationship between any pair of channel maps. Hyperbolic space-based graph reasoning provides pixel-level hierarchical embeddings in the hyperbolic space. The MGRNet exhibits obvious advantages over a strong baseline without preprocessing operations, including OD localization, region of interest (ROI) cropping, and data augmentation advantages, and achieves satisfactory results on both the REFUGE (0.9442 mean intersection over union (IoU)) and DRISHTI-GS (0.8792 mean IoU) datasets. Additionally, the MGRNet can also provide reliable glaucoma screening results by measuring the cup-to-disc ratio (CDR) based on segmentation results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Algorithm 1
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Data Availability

The data that support the findings of this study are available from the corresponding author upon reasonable request.

References

  1. Fu H, Cheng J, Xu Y, Wong D W K, Liu J, Cao X (2018) Joint optic disc and cup segmentation based on multi-label deep network and polar transformation. IEEE Trans Med Imaging 37(7):1597–1605

    Article  Google Scholar 

  2. Wang S, Yu L, Yang X, Fu C -W, Heng P -A (2019) Patch-based output space adversarial learning for joint optic disc and cup segmentation. IEEE Trans Med Imaging 38(11):2485–2495

    Article  Google Scholar 

  3. Tabassum M, Khan T M, Arsalan M, Naqvi S S, Ahmed M, Madni H A, Mirza J (2020) Cded-net: joint segmentation of optic disc and optic cup for glaucoma screening. IEEE Access 8:102733–102747

    Article  Google Scholar 

  4. Khouloud S, Ahlem M, Fadel T, Amel S (2022) W-net and inception residual network for skin lesion segmentation and classification. Appl Intell 52(4):3976–3994

    Article  Google Scholar 

  5. Weng Z, Ogut M G, Limonchik S, Yeung S (2021) Unsupervised discovery of the long-tail in instance segmentation using hierarchical self-supervision. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 2603–2612

  6. Atigh M G, Schoep J, Acar E, van Noord N, Mettes P (2022) Hyperbolic image segmentation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 4453–4462

  7. Tong Z, Xu P, Denoeux T (2021) Evidential fully convolutional network for semantic segmentation. Appl Intell 51(9):6376–6399

    Article  Google Scholar 

  8. Li Y, Gupta A (2018) Beyond grids: learning graph representations for visual recognition. In: Advances in neural information processing systems, vol 31

  9. Liang X, Hu Z, Zhang H, Lin L, Xing E P (2018) Symbolic graph reasoning meets convolutions. In: Advances in neural information processing systems, vol 31

  10. Lyu J, Zhang Y, Huang Y, Lin L, Cheng P, Tang X (2022) Aadg: automatic augmentation for domain generalization on retinal image segmentation. IEEE Trans Med Imaging 41(12):3699–3711

    Article  Google Scholar 

  11. Xia H, Ma M, Li H, Song S (2022) Mc-net: multi-scale context-attention network for medical ct image segmentation. Appl Intell 52(2):1508–1519

    Article  Google Scholar 

  12. Lu X, Wang W, Ma C, Shen J, Shao L, Porikli F (2019) See more, know more: unsupervised video object segmentation with co-attention siamese networks. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 3623–3632

  13. Lu X, Wang W, Shen J, Crandall D, Luo J (2020) Zero-shot video object segmentation with co-attention siamese networks. In: IEEE Transactions on pattern analysis and machine intelligence

  14. Lu X, Wang W, Shen J, Crandall D, Van Gool L (2021) Segmenting objects from relational visual data. IEEE Trans Pattern Anal Mach Intell

  15. Zilly J, Buhmann J M, Mahapatra D (2017) Glaucoma detection using entropy sampling and ensemble learning for automatic optic cup and disc segmentation. Comput Med Imaging Graph 55:28–41

    Article  Google Scholar 

  16. Xu Y-L, Lu S, Li H-X, Li R-R (2019) Mixed maximum loss design for optic disc and optic cup segmentation with deep learning from imbalanced samples. Sensors 19(20):4401

    Article  Google Scholar 

  17. Shah S, Kasukurthi N, Pande H (2019) Dynamic region proposal networks for semantic segmentation in automated glaucoma screening. In: 2019 IEEE 16th international symposium on biomedical imaging (ISBI 2019), pp 578–582

  18. Liu B, Pan D, Song H (2021) Joint optic disc and cup segmentation based on densely connected depthwise separable convolution deep network. BMC Med Imaging 21(1):1–12

    Article  Google Scholar 

  19. Liu S, Hong J, Lu X, Jia X, Lin Z, Zhou Y, Liu Y, Zhang H (2019) Joint optic disc and cup segmentation using semi-supervised conditional gans. Comput Biol Med 115:103485

    Article  Google Scholar 

  20. Li S, Sui X, Luo X, Xu X, Liu Y, Goh R S M (2021) Medical image segmentation using squeeze-and-expansion transformers. In: 30th International joint conference on artificial intelligence: IJCAI 2021

  21. Guo X, Li J, Lin Q, Tu Z, Hu X, Che S (2022) Joint optic disc and cup segmentation using feature fusion and attention. Comput Biol Med 150:106094

    Article  Google Scholar 

  22. Li X, Yang Y, Zhao Q, Shen T, Lin Z, Liu H (2020) Spatial pyramid based graph reasoning for semantic segmentation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR)

  23. Hu H, Ji D, Gan W, Bai S, Wu W, Yan J (2020) Class-wise dynamic graph convolution for semantic segmentation. In: European conference on computer vision. Springer, pp 1–17

  24. Wang X, Gupta A (2018) Videos as space-time region graphs. In: Proceedings of the European conference on computer vision (ECCV), pp 399–417

  25. Chen Y, Rohrbach M, Yan Z, Shuicheng Y, Feng J, Kalantidis Y (2019) Graph-based global reasoning networks. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 433–442

  26. Meng Y, Zhang H, Gao D, Zhao Y, Yang X, Qian X, Huang X, Zheng Y (2021) Bi-gcn: boundary-aware input-dependent graph convolution network for biomedical image segmentation. In: 32nd British machine vision conference: BMVC 2021

  27. Khrulkov V, Mirvakhabova L, Ustinova E, Oseledets I, Lempitsky V (2020) Hyperbolic image embeddings. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 6418–6428

  28. Ganea O, Bécigneul G, Hofmann T (2018) Hyperbolic neural networks. In: Advances in neural information processing systems, vol 31

  29. Liu Q, Nickel M, Kiela D (2019) Hyperbolic graph neural networks. In: Advances in neural information processing systems, vol 32

  30. Krioukov D, Papadopoulos F, Kitsak M, Vahdat A, Boguná M (2010) Hyperbolic geometry of complex networks. Phys Rev E 82(3):036106

    Article  MathSciNet  Google Scholar 

  31. Papadopoulos F, Kitsak M, Serrano M, Boguná M, Krioukov D (2012) Popularity versus similarity in growing networks. Nature 489(7417):537–540

    Article  Google Scholar 

  32. Fu J, Liu J, Tian H, Li Y, Bao Y, Fang Z, Lu H (2019) Dual attention network for scene segmentation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 3146–3154

  33. Chami I, Ying Z, Ré C, Leskovec J (2019) Hyperbolic graph convolutional neural networks. In: Advances in neural information processing systems, vol 32

  34. Peng W, Varanka T, Mostafa A, Shi H, Zhao G (2021) Hyperbolic deep neural networks: a survey. In: IEEE Transactions on pattern analysis and machine intelligence

  35. Orlando J I, Fu H, Breda J B, van Keer K, Bathula D R, Diaz-Pinto A, Fang R, Heng P -A, Kim J, Lee J et al (2020) Refuge challenge: a unified framework for evaluating automated methods for glaucoma assessment from fundus photographs. Med Image Anal 59:101570

    Article  Google Scholar 

  36. Sivaswamy J, Krishnadas S, Joshi GD, Jain M, Tabish AUS (2014) Drishti-gs: retinal image dataset for optic nerve head (onh) segmentation. In: 2014 IEEE 11th international symposium on biomedical imaging (ISBI). IEEE, pp 53–56

  37. Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 234–241

  38. Badrinarayanan V, Kendall A, Cipolla R (2017) Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 39(12):2481–2495

    Article  Google Scholar 

  39. Singh V K, Rashwan H A, Akram F, Pandey N, Sarker M M K, Saleh A, Abdulwahab S, Maaroof N, Torrents-Barrena J, Romani S et al (2018) Retinal optic disc segmentation using conditional generative adversarial network. In: CCIA, pp 373–380

  40. Sevastopolsky A (2017) Optic disc and cup segmentation methods for glaucoma detection with modification of u-net convolutional neural network. Pattern Recognit Image Anal 27(3):618–624

    Article  Google Scholar 

  41. Javanmardi M, Tasdizen T (2018) Domain adaptation for biomedical image segmentation using adversarial training. In: 2018 IEEE 15th international symposium on biomedical imaging (ISBI 2018), pp 554–558

Download references

Acknowledgements

This work was supported by national natural science foundation of China under Grant 82071995, key research and development program of Jilin Province under Grant 20220201141GX and natural science foundation of Jilin Province under Grant 20200201292JC.

Author information

Authors and Affiliations

  1. College of Computer Science and Technology, Jilin University, 2699 Qianjin Street, Changchun, 130012, Jilin, China

    Baoliang Zhang, Xiaoxin Guo, Guangyu Li & Zhengran Shen

  2. Key Laboratory of Symbol Computation and Knowledge Engineering of Ministry of Education, Jilin University, 2699 Qianjin Street, Changchun, 130012, Jilin, China

    Xiaoxin Guo

  3. Ophthalmology Department, Bethune First Hospital of Jilin University, 1 Xinmin Street, Changchun, 130021, Jilin, China

    Xiaoying Hu

  4. Ophthalmology Department, Bethune Second Hospital of Jilin University, 218 Ziqiang Street, Changchun, 130041, Jilin, China

    Songtian Che

Authors
  1. Baoliang Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaoxin Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Guangyu Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhengran Shen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xiaoying Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Songtian Che
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiaoxin Guo.

Ethics declarations

Ethics Approval

Not applicable

Conflict of Interest

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, B., Guo, X., Li, G. et al. Multiple graph reasoning network for joint optic disc and cup segmentation. Appl Intell 53, 21268–21282 (2023). https://doi.org/10.1007/s10489-023-04560-1

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-023-04560-1

Keywords

Search

Navigation