Skip to main content

Advertisement

SpringerLink
Log in

Automatic detection of breast cancer for mastectomy based on MRI images using Mask R-CNN and Detectron2 models

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Breast tumor diagnosis has seen widespread use of computer-aided techniques. Machine learning techniques can benefit doctors in making diagnosis decisions. One of the most important treatments for breast cancer is neoadjuvant chemotherapy (NAC). The reason is that NAC before surgery can downstage breast cancer and reduce local surgery. The problem of MRI, in brief, is how to distinguish between the types of pre-NAC and post-NAC, especially between the kinds of post-NAC. This study presents creating a system that goes through five stages: the input dataset, comparing normal and abnormal using EfficientNetV2L, determining the difference between malignant (pre- or post-NAC) and benign by utilizing a mask region-based convolutional neural network (R-CNN), comparing the types of post-NAC by using Detectron2, and finally the multidisciplinary team (MDT). Thus, it is decided if the breast needs a mastectomy or wide local excision (WLE) using Detectron2 with Faster R-CNN. The results showed that EfficientNetV2L achieved high accuracy, about 98%. The models successfully compared the types of post-NAC by using Detectron2 with Mask R-CNN. The study concludes that Detectron2 with Mask and Faster R-CNN is a reasonable model for detecting the type of MRI image and classifying whether the image is normal or abnormal.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

Data availability

The datasets I worked on it are collected in Erbil and Sulaymaniyah hospitals because I didn't publish my paper and the paper must be published; then I can publish the dataset on any website. Also, I had support for the datasets to publish as mentioned below.

References

  1. Benjelloun M, El Adoui M, Larhmam MA, Mahmoudi SA (2018) Automated breast tumor segmentation in DCE-MRI using deep learning. In: 2018 4th Int Conf Cloud Comput Technol Appl Cloudtech 2018, pp 1–6. https://doi.org/10.1109/CloudTech.2018.8713352.

  2. Wang L (2017) Early diagnosis of breast cancer. Sensors (Switzerland). https://doi.org/10.3390/s17071572

    Article  Google Scholar 

  3. Sivasangari A, Ajitha P, Bevishjenila, Vimali JS, Jose J, Gowri S (2022) Breast cancer detection using machine learning. Lect Notes Data Eng Commun Technol 68(07):693–702. https://doi.org/10.1007/978-981-16-1866-6_50

    Article  Google Scholar 

  4. Kim CM, Park RC, Hong EJ (2020) Breast mass classification using eLFA algorithm based on CRNN deep learning model. IEEE Access 8:197312–197323. https://doi.org/10.1109/ACCESS.2020.3034914

    Article  Google Scholar 

  5. Jones EF et al (2020) Current landscape of breast cancer imaging and potential quantitative imaging markers of response in er-positive breast cancers treated with neoadjuvant therapy. Cancers (Basel) 12(6):1–24. https://doi.org/10.3390/cancers12061511

    Article  Google Scholar 

  6. Militello C et al (2022) Semi-automated and interactive segmentation of contrast-enhancing masses on breast DCE-MRI using spatial fuzzy clustering. Biomed Signal Process Control 71:103113. https://doi.org/10.1016/j.bspc.2021.103113

    Article  Google Scholar 

  7. Ahmad N, Asghar S, Gillani SA (2022) Transfer learning-assisted multi-resolution breast cancer histopathological images classification. Vis Comput 38(8):2751–2770. https://doi.org/10.1007/s00371-021-02153-y

    Article  Google Scholar 

  8. Maicas G, Carneiro G, Bradley AP (2017) Globally optimal breast mass segmentation from DCE-MRI using deep semantic segmentation as shape prior. In: Proc—Int Symp Biomed Imaging, pp 305–309. https://doi.org/10.1109/ISBI.2017.7950525.

  9. Amkrane Y, El Adoui M, Benjelloun M (2020) Towards breast cancer response prediction using artificial intelligence and radiomics. In: Proc 2020 5th Int Conf Cloud Comput Artif Intell Technol Appl CloudTech 2020. https://doi.org/10.1109/CloudTech49835.2020.9365890.

  10. Zhang Y et al (2022) Automatic detection and segmentation of breast cancer on MRI using mask R-CNN trained on non–fat-sat images and tested on fat-sat images. Acad Radiol 29:S135–S144. https://doi.org/10.1016/j.acra.2020.12.001

    Article  Google Scholar 

  11. Maicas G, Carneiro G, Bradley AP, Nascimento JC, Reid I (2017) Deep reinforcement learning for active breast lesion detection from DCE-MRI. Lect Notes Comput Sci (including Subser Lect Notes Artif Intell Lect Notes Bioinformatics), vol 10435 LNCS, pp 665–673. https://doi.org/10.1007/978-3-319-66179-7_76.

  12. Ye G, He S, Pan R, Zhu L, Zhou D, Lu RL (2022) Research on DCE-MRI images based on deep transfer learning in breast cancer adjuvant curative effect prediction. J Healthc Eng. https://doi.org/10.1155/2022/4477099

    Article  Google Scholar 

  13. Sutton EJ et al (2020) A machine learning model that classifies breast cancer pathologic complete response on MRI post-neoadjuvant chemotherapy. Breast Cancer Res 22(1):1–11. https://doi.org/10.1186/s13058-020-01291-w

    Article  Google Scholar 

  14. Ayatollahi F, Shokouhi SB, Mann RM, Teuwen J (2021) Automatic breast lesion detection in ultrafast DCE-MRI using deep learning. Med Phys 48(10):5897–5907. https://doi.org/10.1002/mp.15156

    Article  Google Scholar 

  15. Chen Y et al (2022) A deep learning model based on dynamic contrast-enhanced magnetic resonance imaging enables accurate prediction of benign and malignant breast lessons. Front Oncol 12(July):1–10. https://doi.org/10.3389/fonc.2022.943415

    Article  Google Scholar 

  16. Hu Q, Whitney HM, Giger ML (2019) Transfer learning in 4D for breast cancer diagnosis using dynamic contrast-enhanced magnetic resonance imaging, no. NeurIPS, [Online]. http://arxiv.org/abs/1911.03022

  17. Minarno AE, Wandani LR, Azhar Y (2022) Classification of breast cancer based on histopathological image using efficientNet-B0 on convolutional neural network. Int J Emerg Technol Adv Eng 12(8):70–77. https://doi.org/10.46338/ijetae0822_09

    Article  Google Scholar 

  18. Amerikanos P, Maglogiannis I (2022) Image analysis in digital pathology utilizing machine learning and deep neural networks. J Pers Med. https://doi.org/10.3390/jpm12091444

    Article  Google Scholar 

  19. Zhao Y, Zhang J, Hu D, Qu H, Tian Y, Cui X (2022) Application of deep learning in histopathology images of breast cancer: a review. Micromachines 13(12):1–30. https://doi.org/10.3390/mi13122197

    Article  Google Scholar 

  20. Kim MS et al (2020) Artificial intelligence and lung cancer treatment decision: agreement with recommendation of multidisciplinary tumor board. Transl Lung Cancer Res 9(3):507–514. https://doi.org/10.21037/tlcr.2020.04.11

    Article  Google Scholar 

  21. Brown GTF, Bekker HL, Young AL (2022) Quality and efficacy of Multidisciplinary Team (MDT) quality assessment tools and discussion checklists: a systematic review. BMC Cancer 22(1):1–10. https://doi.org/10.1186/s12885-022-09369-8

    Article  Google Scholar 

  22. Wang J, Liu Q, Xie H, Yang Z, Zhou H (2021) Boosted efficientnet: detection of lymph node metastases in breast cancer using convolutional neural networks. Cancers (Basel) 13(4):1–14. https://doi.org/10.3390/cancers13040661

    Article  Google Scholar 

  23. Nayak DR, Padhy N, Mallick PK, Zymbler M, Kumar S (2022) Brain tumor classification using dense efficient-net. Axioms. https://doi.org/10.3390/axioms11010034

    Article  Google Scholar 

  24. Tan M, Le QV (2019) EfficientNet: rethinking model scaling for convolutional neural networks. In: 36th Int Conf Mach Learn ICML 2019, vol 2019-June, pp 10691–10700

  25. Min H et al (2020) Fully automatic computer-aided mass detection and segmentation via pseudo-color mammograms and mask R-CNN. In: Proc—Int Symp Biomed Imaging, vol 2020–April, pp 1111–1115. https://doi.org/10.1109/ISBI45749.2020.9098732.

  26. Lin TY, Goyal P, Girshick R, He K, Dollar P (2020) Focal loss for dense object detection. IEEE Trans Pattern Anal Mach Intell 42(2):318–327. https://doi.org/10.1109/TPAMI.2018.2858826

    Article  Google Scholar 

  27. Cai L, Long T, Dai Y, Huang Y (2020) Mask R-CNN-based detection and segmentation for pulmonary nodule 3D visualization diagnosis. IEEE Access 8:44400–44409. https://doi.org/10.1109/ACCESS.2020.2976432

    Article  Google Scholar 

  28. Chiao JY, Chen KY, Liao KY-K, Hsieh PH, Zhang G, Huang TC (2019) Detection and classification the breast tumors using mask R-CNN on sonograms. Med (United States) 98(19):1–5. https://doi.org/10.1097/MD.0000000000015200

    Article  Google Scholar 

  29. Ahmad S, Mouiad A (2021) Comparative study: 2D object detection & inferencing using Detectron2 2D object detection & inferencing using Detectron2: comparative study Abstract, August, pp 0–5

  30. Pham V, Pham C, Dang T (2020) Road damage detection and classification with Detectron2 and faster R-CNN. In: Proc—2020 IEEE Int Conf Big Data, Big Data 2020, pp 5592–5601. https://doi.org/10.1109/BigData50022.2020.9378027

  31. Ackermann M, Iren D, Wesselmecking S, Shetty D, Krupp U (2022) Automated segmentation of martensite-austenite islands in bainitic steel. Mater Charact 191(July):112091. https://doi.org/10.1016/j.matchar.2022.112091

    Article  Google Scholar 

  32. Cai N, Chen H, Li Y, Peng Y, Li J (2021) Adaptive weighting landmark-based group-wise registration on lung DCE-MRI images. IEEE Trans Med Imaging 40(2):673–687. https://doi.org/10.1109/TMI.2020.3035292

    Article  Google Scholar 

  33. Zhou J et al (2020) Diagnosis of benign and malignant breast lesions on DCE-MRI by using radiomics and deep learning with consideration of peritumor tissue. J Magn Reson Imaging 51(3):798–809. https://doi.org/10.1002/jmri.26981

    Article  MathSciNet  Google Scholar 

  34. Huang Y et al (2021) Prediction of tumor shrinkage pattern to neoadjuvant chemotherapy using a multiparametric MRI-based machine learning model in patients with breast cancer. Front Bioeng Biotechnol 9(July):1–15. https://doi.org/10.3389/fbioe.2021.662749

    Article  Google Scholar 

  35. Hu Q, Whitney HM, Li H, Ji Y, Liu P, Giger ML (2021) Improved classification of benign and malignant breast lesions using deep feature maximum intensity projection MRI in breast cancer diagnosis using dynamic contrast-enhanced MRI. Radiol Artif Intell. https://doi.org/10.1148/ryai.2021200159

    Article  Google Scholar 

  36. Choi JH et al (2020) Early prediction of neoadjuvant chemotherapy response for advanced breast cancer using PET/MRI image deep learning. Sci Rep 10(1):1–11. https://doi.org/10.1038/s41598-020-77875-5

    Article  Google Scholar 

  37. Conte L, Tafuri B, Portaluri M, Galiano A, Maggiulli E, De Nunzio G (2020) Breast cancer mass detection in dce-mri using deep-learning features followed by discrimination of infiltrative vs. in situ carcinoma through a machine-learning approach. Appl Sci. https://doi.org/10.3390/app10176109

    Article  Google Scholar 

  38. Li L, Tian H, Zhang B, Wang W, Li B (2022) Prediction for distant metastasis of breast cancer using dynamic contrast-enhanced magnetic resonance imaging images under deep learning. Comput Intell Neurosci. https://doi.org/10.1155/2022/6126061

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Information System Engineering, Erbil Technical Engineering College, Erbil Polytechnic University, Erbil, Iraq

    Chiman Haydar Salh

  2. Department of Software Engineering and Informatics, College of Engineering, Salahaddin University-Erbil, Erbil, Iraq

    Abbas M. Ali

Authors
  1. Chiman Haydar Salh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Abbas M. Ali
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chiman Haydar Salh.

Ethics declarations

Conflict of interest

We wish to confirm that there are no known conflicts of interest associated with this publication, and there has been no significant financial support for this work that could have influenced its outcome.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Salh, C.H., Ali, A.M. Automatic detection of breast cancer for mastectomy based on MRI images using Mask R-CNN and Detectron2 models. Neural Comput & Applic 36, 3017–3035 (2024). https://doi.org/10.1007/s00521-023-09237-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-023-09237-x

Keywords

Search

Navigation