Abstract
Nowadays, many different methods are used in diagnosing prostate cancer. Among these methods, MRI-based imaging methods provide more precise information than other methods by obtaining the prostate's image from different angles (axial, sagittal, coronal). However, manually segmenting these images is very time-consuming and laborious. Besides, another challenge is the inhomogeneous and inconsistent appearance around the prostate borders, which is essential for cancer diagnosis. Nowadays, scientists are working intensively on deep learning-based techniques to identify prostate boundaries more efficiently and with high accuracy. In this study, a dynamic fusion architecture is proposed. For the fusion model, the Unet + Resnet3D and Unet + Resnet2D models were fused. Evaluation experiments were performed on the MICCAI 2012 Prostate Segmentation Challenge Dataset (PROMISE12) and the NCI-ISBI 2013(NCI_ISBI-13) Prostate Segmentation Challenge Dataset. Comparative analyzes show that the advantages and robustness of our method are superior to state-of-the-art approaches.
Similar content being viewed by others
References
Siegel, R.L.; Miller, K.D.; Jemal, A.: Cancer Statistics 2021. CA Cancer J. Clin. 69, 7–33 (2021). https://doi.org/10.3322/caac.21654
Lemaitre, G.; Marti, R.; Rastgoo, M.; Meriaudeau, F.: Computer-aided detection for prostate cancer detection based on multi-parametric magnetic resonance imaging. Annu Int Conf IEEE Eng Med Biol Soc. (2017). https://doi.org/10.1109/EMBC.2017.8037522
Mohammed, Z.F.; Abdulla, A.A.: An efficient CAD system for ALL cell identification from microscopic blood images. Multim Tools Appl 80, 6355–6368 (2021). https://doi.org/10.1007/s11042-020-10066-6
Comelli, A.; Dahiya, N.; Stefano, A.; Vernuccio, F.; Portoghese, M.; GiuseppeCutaia, G., et al.: Deep learning-based methods for prostate segmentation in magnetic resonance imaging. Appl. Sci. 11, 782 (2021). https://doi.org/10.3390/app11020782
Yan, L.; Liu, D.; Xiang, Q.; Luo, Y.; Wang, T.; Wu, D., et al.: PSP net-based automatic segmentation network model for prostate magnetic resonance imaging. Comput. Methods Prog. Biomed. 207, 106211 (2021). https://doi.org/10.1016/j.cmpb.2021.106211
Salvaggio, G.; Comelli, A.; Portoghese, M.; Cutaia, G.; Cannella, R.; Vernuccio, F., et al.: Deep learning network for segmentation of the prostate gland with median lobe enlargement in T2-weighted mr images: comparison with manual segmentation method. Curr. Probl. Diagnos. Radiol. (2021). https://doi.org/10.1067/j.cpradiol.2021.06.006
Brosch, T.; Peters, J.; Groth, A.; Weber, F.M.; Weese, J.: Model-based segmentation using neural network-based boundary detectors: application to prostate and heart segmentation in MR images. Mach. Learn. App. 6, 100078 (2021). https://doi.org/10.1016/j.mlwa.2021.100078
Meyer, A.; Chlebus, G.; Rak, M.; Schindele, D.; Schostak, M.; van Ginneken, B., et al.: Anisotropic 3D Multi-Stream CNN for Accurate Prostate Segmentation from Multi-PlanarMRI. Comput. Methods Prog. Biomed. 200, 105821 (2021). https://doi.org/10.1016/j.cmpb.2020.105821
Anas, E.M.A.; Mousavi, P.; Abolmaesumi, P.: A deep learning approach for real-time prostate segmentation in freehand ultrasound-guided biopsy. Med. Image Anal. 48, 107–116 (2018). https://doi.org/10.1016/j.media.2018.05.010 (Epub 2018 Jun 1 PMID: 29886268)
Jia, H.; Xia, Y.; Song, Y.; Cai, W.; Fulham, M.; Feng, D.: Atlas registration and ensemble deep convolutional neural network-based prostate segmentation using magnetic resonance imaging. Neurocomputing 275, 1358–1369 (2018). https://doi.org/10.1016/j.neucom.2017.09.084
Liu, C.; Gardner, S.J.; Wen, N.; Elshaikh, M.A.; Siddiqui, F.; Movsas, B.; Chetty, I.J.: Automatic Segmentation of the Prostate on CT Images Using Deep Neural Networks (DNN). Int. J. Radiat. Oncol. Biol. Phys. 104(4), 924–932 (2019). https://doi.org/10.1016/j.ijrobp.2019.03.017 (Epub 2019 Mar 16 PMID: 30890447)
Abraham, B.; Nair, M.S.: Computer-aided classification of prostate cancer grade groups from MRI images using texture features and stacked sparse autoencoder. Comput. Med. Imaging Graph. 69, 60–68 (2018). https://doi.org/10.1016/j.compmedimag.2018.08.006 (Epub 2018 Aug 25 PMID: 30205334)
Cheng, R.; Lay, N.; Mertan, F.; Turkbey, B.; Roth, H.R.; Lu, L.; Gandler, W.; McCreedy, E.S. et al.: Deep learning with orthogonal volumetric HED segmentation and 3D surface reconstruction model of prostate MRI. In: 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017), pp. 749–753 (2017). https://doi.org/10.1109/ISBI.2017.7950627
Zhou, W.; Tao, X.; Wei, Z.; Lin, L.: Automatic segmentation of 3D prostate MR images with iterative localization refinement. Digital Signal Process. (2020). https://doi.org/10.1016/j.dsp.2019.102649
Yu, L.; Yang, X.; Chen, H.; Qin, J.; Heng, P.A.: Volumetric ConvNetswith mixed residual connections for automated prostate segmentation from 3D MR images. In: Thirty-First AAAI Conference on Artificial Intelligence (AAAI), pp. 66–72 (2017)
Mun, J.; Jang, W.; Sung, D.J.; Kim, C.: Comparison of objective functions in CNN-based prostate magnetic resonance image segmentation. IEEE Int. Conf. Image Process. (ICIP). 2017, 3859–3863 (2017). https://doi.org/10.1109/ICIP.2017.8297005
He, B.; Xiao, D.; Hu, Q.; Jia, F.: Automatic Magnetic Resonance Image Prostate Segmentation Based on Adaptive Feature Learning Probability Boosting Tree Initialization and CNN-ASM Refinement. IEEE Access 6, 2005–2015 (2018). https://doi.org/10.1109/ACCESS.2017.2781278
Tang, Z.; Wang, M.; Song, Z.: Rotationally resliced 3D prostate segmentation of MR images using Bhattacharyya similarity and active band theory. Phys Med. 54, 56–65 (2018). https://doi.org/10.1016/j.ejmp.2018.09.005
Brosch, T.; Peters, J.; Groth, A.; Stehle, T.; Weese J.: Deep learning-based boundary detection for model-based segmentation with application to MR prostate segmentation. in: Medical Image Computing and Computer-Assisted Intervention (MICCAI), pp. 515–522 (2018). https://doi.org/10.1007/978-3-030-00937-3_59
Meyer, A.; Mehrtash, A.; Rak, M.; Schindele, D.; Schostak, M.; Tempany, C. et al.: Automatic high-resolution segmentation of the prostate from multi-planar MRI. 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), pp. 177–181 (2018). https://doi.org/10.1109/ISBI.2018.8363549
Zhang, Y.; Wu, J.; Chen, W.; Chen, Y.; Tang, X.: Prostate Segmentation Using Z-Net. IN: 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019). pp. 11–14 (2019). https://doi.org/10.1109/ISBI.2019.8759554.
Jin, Y.; Yang, G.; Fang, Y.; Li, R.; Xu, X.; Liu, Y.; Lai, X.: 3D PBV-Net: An automated prostate MRI data segmentation method. Comput. Biol. Med. (2021). https://doi.org/10.1016/j.compbiomed.2020.104160
Ocal, H.; Barisci N.: Prostate segmentation via fusing the nested-V-net3d and V-net2d. In: 2019 1st International Informatics and Software Engineering Conference (UBMYK), pp. 1–4 (2019). https://doi.org/10.1109/UBMYK48245.2019.8965456
Litjens, G.; Toth, R.; van de Ven, W.; Hoeks, C.; Kerkstra, S.; van Ginneken, B., et al.: Evaluation of prostate segmentation algorithms for MRI: the PROMISE12 challenge. Med Image Anal. 18(2), 359–373 (2014). https://doi.org/10.1016/j.media.2013.12.002
Bloch, N.; Rusu, M.; Huisman, H.; Futterer, J.: NCI-ISBI 2013 challenge: automated segmentation of prostate structures. Int. Symp. Biomed. Imaging (ISBI) (2013). https://doi.org/10.7937/K9/TCIA.2015.zF0vlOPv
Ioffe, S.; Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift (2015). arXiv preprint arXiv:1502.03167
Glorot, X.; Bengio, Y.: Understanding the difficulty of training deep feedforward neural networks. In Aistats 9, 249–256 (2010)
Kingma, D.P.; Ba, J.: Adam: a method for stochastic optimization. In: International Conference on Learning Representations (ICLR), pp. 1–11 (2015)
Zhu, Q.; Du, B.; Yan, P.: Boundary-weighted domain adaptive neural network for prostate MR image segmentation. IEEE Trans. Med. Imaging (TMI) 1–11 (2019)
Lin, T.; Goyal, P.; Girshick, R.; He, K.; Dollár, P.: Focal Loss for Dense Object Detection. In: IEEE Transactions on Pattern Analysis and Machine Intelligence. vol. 42, no. 2, pp. 318–327 (2020). https://doi.org/10.1109/TPAMI.2018.2858826
Wang, P.; Chung, A.C.S.: Focal dice loss and image dilation for brain tumor segmentation, in: International Workshop on Deep Learning in Medical Image Analysis, pp. 119–127 (2018)
Abraham, N.; Khan, N.M.: A novel focal Tversky loss function with improved attention U-net for lesion segmentation. In: 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019), IEEE, pp. 683–687
Jiang, H.; Shi, T.; Bai, Z.; Huang, L.: AHCNet: an application of attention mechanism and hybrid connection for liver tumor segmentation in CT volumes. IEEE Access 7, 24898–24909 (2019). https://doi.org/10.1109/ACCESS.2019.2899608
Milletari, F.; Navab, N.; Ahmadi, S.A.: V-net: fully convolutional neural networks for volumetric medical image segmentation. in: International Conference on 3D Vision (3DV), pp. 565–571 (2016)
Drozdzal, M.; Chartrand, G.; Vorontsov, E.; Shakeri, M.; Jorio, L.D.; Tang, A.; Romero, A.; Bengio, Y.; Pal, C.; Kadoury, S.: Learning normalized inputs for iterative estimation in medical image segmentation. Med. Image Anal. 44, 1–13 (2018)
Zhu, Q.; Du, B.; Wu, J.; Yan, P.: A deep learning health data analysis approach: automatic 3D prostate MR segmentation with densely-connected volumetric ConvNets. Int. Joint Conf. Neural Networks (IJCNN) 2018, 1–6 (2018). https://doi.org/10.1109/IJCNN.2018.8489136
Jia, H.; Song, Y.; Huang, H.; Cai, W.; Xia, Y.: HD-Net: Hybrid Discriminative Network for Prostate Segmentation in MR Images. In: Shen D. et al. (ed.) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2019. MICCAI 2019. 2019. Lecture Notes in Computer Science, vol 11765. Springer, Cham. https://doi.org/10.1007/978-3-030-32245-8_13
Peng, C.; Zhang, X.; Yu, G.; Luo, G.; Sun, J.: Large kernel matters – improve semantic segmentation by global convolutional network. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.1743–1751 (2017)
Cicek, O.; Abdulkadir, A.; Lienkamp, S.; Brox, T.; Ronneberger, O.: 3D U-net: learning dense volumet-ric segmentation from sparse annotation. In: Medical Image Computing and Computer-Assisted Intervention (MICCAI), pp. 424–432 (2016). https://doi.org/10.1007/978-3-319-46723-8_49
Chen, H.; Dou, Q.; Yu, L.; Qin, H.; Heng, P.A.: VoxResNet: deep voxelwise residual networks for brain segmentation from 3D MR images. Neuroimage 170, 446–455 (2018). https://doi.org/10.1016/j.neuroimage.2017.04.041
Jia, H.; Xia, Y.; Song, Y.; Zhang, D.; Huang, H.; Zhang, Y.; Cai, W.: 3D APA-Net: 3D adversarial pyramid anisotropic convolutional network for prostate segmentation in MR images. IEEE Trans. Med. Imaging 39(2), 447–457 (2020). https://doi.org/10.1109/TMI.2019.2928056
Author information
Authors and Affiliations
Contributions
Hakan Ocal and Necaattin Barisci: Conceptualization, Validation, writing—review, and editing. Hakan Ocal: Methodology, Software, Data curation, Writing—Original draft preparation. Necaattin Barisci: Supervision, Visualization, Investigation. All authors have read and agreed to the published version of the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Rights and permissions
About this article
Cite this article
Ocal, H., Barisci, N. Prostate Segmentation via Dynamic Fusion Model. Arab J Sci Eng 47, 10211–10224 (2022). https://doi.org/10.1007/s13369-021-06502-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13369-021-06502-w