skip to main content
10.1145/3577065.3577106acmotherconferencesArticle/Chapter ViewAbstractPublication PagesictceConference Proceedingsconference-collections
research-article

HC-Net: Hierarchical Context integration Network for medical image segmentation

Published:20 June 2023Publication History

ABSTRACT

Accurate medical image segmentation is essential to achieve precise medical image analysis, e.g., blood vessel detection or lung segmentation, which has attracted researchers’ attention. So far, state-of-the-art techniques improving segmentation results have extracted the multi-scale contextual features with dilated convolution. However, these techniques cannot capture sufficient scale information due to only using several parallel independent branches, which result in leaving a gap between existed and ideal segmentation results.To address this problem, we design a hierarchical context integration network (HC-Net) which includes encoder module, hierarchical context integration module (HCM), and decoder module. Our HCM can not only extract the scale features in a single branch, but also learn the scale correlation among different branches. Meanwhile, self-attention mechanism therein is utilized to integrate context features and global dependencies adaptively for decoder Module. The proposed HC-Net has been applied two popular datasets, DRIVE and LUNA, and the experimental results show that our method outperforms state-of-the-art ones.

References

  1. Md Zahangir Alom, Mahmudul Hasan, Chris Yakopcic, Tarek M Taha, and Vijayan K Asari. 2018. Recurrent residual convolutional neural network based on u-net (r2u-net) for medical image segmentation. arXiv preprint arXiv:1802.06955(2018).Google ScholarGoogle Scholar
  2. George Azzopardi, Nicola Strisciuglio, Mario Vento, and Nicolai Petkov. [n.d.]. Trainable COSFIRE filters for vessel delineation with application to retinal images. 19, 1([n. d.]), 46–57.Google ScholarGoogle Scholar
  3. Masoumeh Bakhtiariziabari and Mohsen Ghafoorian. 2020. Gambling Adversarial Nets for Hard Sample Mining and Structured Prediction: Application in Ultrasound Thyroid Nodule Segmentation. In International Workshop on Machine Learning in Medical Imaging. Springer, 513–522.Google ScholarGoogle Scholar
  4. Niloofar Borzooie, Habibollah Danyali, and Mohammad Sadegh Helfroush. 2018. Modified Density-Based Data Clustering for Interactive Liver Segmentation. Journal of Image and Graphics 6, 1 (2018), 84–87.Google ScholarGoogle ScholarCross RefCross Ref
  5. William R Crum, Oscar Camara, and Derek LG Hill. 2006. Generalized overlap measures for evaluation and validation in medical image analysis. IEEE transactions on medical imaging 25, 11 (2006), 1451–1461.Google ScholarGoogle ScholarCross RefCross Ref
  6. Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. 2009. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition. Ieee, 248–255.Google ScholarGoogle ScholarCross RefCross Ref
  7. Shuanglang Feng, Heming Zhao, Fei Shi, Xuena Cheng, Meng Wang, Yuhui Ma, Dehui Xiang, Weifang Zhu, and Xinjian Chen. 2020. CPFNet: Context pyramid fusion network for medical image segmentation. IEEE transactions on medical imaging 39, 10 (2020), 3008–3018.Google ScholarGoogle Scholar
  8. Huazhu Fu, Yanwu Xu, Stephen Lin, Damon Wing Kee Wong, and Jiang Liu. 2016. Deepvessel: Retinal vessel segmentation via deep learning and conditional random field. In International conference on medical image computing and computer-assisted intervention. Springer, 132–139.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Jun Fu, Jing Liu, Haijie Tian, Yong Li, Yongjun Bao, Zhiwei Fang, and Hanqing Lu. 2019. Dual attention network for scene segmentation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 3146–3154.Google ScholarGoogle ScholarCross RefCross Ref
  10. Zaiwang Gu, Jun Cheng, Huazhu Fu, Kang Zhou, Huaying Hao, Yitian Zhao, Tianyang Zhang, Shenghua Gao, and Jiang Liu. 2019. Ce-net: Context encoder network for 2d medical image segmentation. IEEE transactions on medical imaging 38, 10 (2019), 2281–2292.Google ScholarGoogle Scholar
  11. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770–778.Google ScholarGoogle ScholarCross RefCross Ref
  12. Tobias Heimann, Hans-Peter Meinzer, and Ivo Wolf. 2007. A statistical deformable model for the segmentation of liver CT volumes. 3D Segmentation in the clinic: A grand challenge (2007), 161–166.Google ScholarGoogle Scholar
  13. Yongbum Lee, Takeshi Hara, Hiroshi Fujita, Shigeki Itoh, and Takeo Ishigaki. 2001. Automated detection of pulmonary nodules in helical CT images based on an improved template-matching technique. IEEE Transactions on medical imaging 20, 7 (2001), 595–604.Google ScholarGoogle ScholarCross RefCross Ref
  14. Jonathan Long, Evan Shelhamer, and Trevor Darrell. 2015. Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition. 3431–3440.Google ScholarGoogle ScholarCross RefCross Ref
  15. Mingjun Ma, Haiying Xia, Yumei Tan, Haisheng Li, and Shuxiang Song. 2022. HT-Net: hierarchical context-attention transformer network for medical ct image segmentation. 52, 9 (15 1 2022), 10692–10705. https://doi.org/10.1007/s10489-021-03010-0Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Fausto Milletari, Nassir Navab, and Seyed-Ahmad Ahmadi. 2016. V-net: Fully convolutional neural networks for volumetric medical image segmentation. In 2016 fourth international conference on 3D vision (3DV). IEEE, 565–571.Google ScholarGoogle Scholar
  17. Lei Mou, Yitian Zhao, Li Chen, Jun Cheng, Zaiwang Gu, Huaying Hao, Hong Qi, Yalin Zheng, Alejandro Frangi, and Jiang Liu. 2019. CS-Net: channel and spatial attention network for curvilinear structure segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 721–730.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Kenji Ono, Yutaro Iwamoto, Yen-Wei Chen, and Masahiro Nonaka. 2020. Automatic segmentation of infant brain ventricles with hydrocephalus in MRI based on 2.5 D U-net and transfer learning. Journal of Image and Graphics 8, 2 (2020), 42–46.Google ScholarGoogle ScholarCross RefCross Ref
  19. Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention. Springer, 234–241.Google ScholarGoogle ScholarCross RefCross Ref
  20. Wei Shen, Mu Zhou, Feng Yang, Di Dong, Caiyun Yang, Yali Zang, and Jie Tian. 2016. Learning from experts: Developing transferable deep features for patient-level lung cancer prediction. In International conference on medical image computing and computer-assisted intervention. Springer, 124–131.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Naofumi Shigeta, Mikoto Kamata, and Masayuki Kikuchi. 2019. Effectiveness of Pseudo 3D Feature Learning for Spinal Segmentation by CNN with U-Net Architecture. Journal of Image and Graphics3 (2019).Google ScholarGoogle Scholar
  22. Jiangdian Song, Caiyun Yang, Li Fan, Kun Wang, Feng Yang, Shiyuan Liu, and Jie Tian. 2015. Lung lesion extraction using a toboggan based growing automatic segmentation approach. IEEE transactions on medical imaging 35, 1 (2015), 337–353.Google ScholarGoogle Scholar
  23. Shuo Wang, Mu Zhou, Zaiyi Liu, Zhenyu Liu, Dongsheng Gu, Yali Zang, Di Dong, Olivier Gevaert, and Jie Tian. 2017. Central focused convolutional neural networks: Developing a data-driven model for lung nodule segmentation. Medical image analysis 40 (2017), 172–183.Google ScholarGoogle Scholar
  24. Jiaqi Wu, Guangxu Li, Huimin Lu, and Tohru Kamiy. 2021. A Supervoxel Classification Based Method for Multi-organ Segmentation from Abdominal CT Images. Journal of Image and Graphics1 (2021).Google ScholarGoogle Scholar
  25. Yitian Zhao, Yalin Zheng, Yonghuai Liu, Yifan Zhao, Lingling Luo, Siyuan Yang, Tong Na, Yongtian Wang, and Jiang Liu. 2017. Automatic 2-D/3-D vessel enhancement in multiple modality images using a weighted symmetry filter. IEEE transactions on medical imaging 37, 2 (2017), 438–450.Google ScholarGoogle Scholar

Index Terms

  1. HC-Net: Hierarchical Context integration Network for medical image segmentation

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      ICTCE '22: Proceedings of the 2022 5th International Conference on Telecommunications and Communication Engineering
      November 2022
      299 pages
      ISBN:9781450397797
      DOI:10.1145/3577065

      Copyright © 2022 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 20 June 2023

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited
    • Article Metrics

      • Downloads (Last 12 months)18
      • Downloads (Last 6 weeks)2

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format