ABSTRACT
Accurate medical image segmentation is essential to achieve precise medical image analysis, e.g., blood vessel detection or lung segmentation, which has attracted researchers’ attention. So far, state-of-the-art techniques improving segmentation results have extracted the multi-scale contextual features with dilated convolution. However, these techniques cannot capture sufficient scale information due to only using several parallel independent branches, which result in leaving a gap between existed and ideal segmentation results.To address this problem, we design a hierarchical context integration network (HC-Net) which includes encoder module, hierarchical context integration module (HCM), and decoder module. Our HCM can not only extract the scale features in a single branch, but also learn the scale correlation among different branches. Meanwhile, self-attention mechanism therein is utilized to integrate context features and global dependencies adaptively for decoder Module. The proposed HC-Net has been applied two popular datasets, DRIVE and LUNA, and the experimental results show that our method outperforms state-of-the-art ones.
- Md Zahangir Alom, Mahmudul Hasan, Chris Yakopcic, Tarek M Taha, and Vijayan K Asari. 2018. Recurrent residual convolutional neural network based on u-net (r2u-net) for medical image segmentation. arXiv preprint arXiv:1802.06955(2018).Google Scholar
- George Azzopardi, Nicola Strisciuglio, Mario Vento, and Nicolai Petkov. [n.d.]. Trainable COSFIRE filters for vessel delineation with application to retinal images. 19, 1([n. d.]), 46–57.Google Scholar
- Masoumeh Bakhtiariziabari and Mohsen Ghafoorian. 2020. Gambling Adversarial Nets for Hard Sample Mining and Structured Prediction: Application in Ultrasound Thyroid Nodule Segmentation. In International Workshop on Machine Learning in Medical Imaging. Springer, 513–522.Google Scholar
- Niloofar Borzooie, Habibollah Danyali, and Mohammad Sadegh Helfroush. 2018. Modified Density-Based Data Clustering for Interactive Liver Segmentation. Journal of Image and Graphics 6, 1 (2018), 84–87.Google ScholarCross Ref
- William R Crum, Oscar Camara, and Derek LG Hill. 2006. Generalized overlap measures for evaluation and validation in medical image analysis. IEEE transactions on medical imaging 25, 11 (2006), 1451–1461.Google ScholarCross Ref
- Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. 2009. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition. Ieee, 248–255.Google ScholarCross Ref
- Shuanglang Feng, Heming Zhao, Fei Shi, Xuena Cheng, Meng Wang, Yuhui Ma, Dehui Xiang, Weifang Zhu, and Xinjian Chen. 2020. CPFNet: Context pyramid fusion network for medical image segmentation. IEEE transactions on medical imaging 39, 10 (2020), 3008–3018.Google Scholar
- Huazhu Fu, Yanwu Xu, Stephen Lin, Damon Wing Kee Wong, and Jiang Liu. 2016. Deepvessel: Retinal vessel segmentation via deep learning and conditional random field. In International conference on medical image computing and computer-assisted intervention. Springer, 132–139.Google ScholarDigital Library
- Jun Fu, Jing Liu, Haijie Tian, Yong Li, Yongjun Bao, Zhiwei Fang, and Hanqing Lu. 2019. Dual attention network for scene segmentation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 3146–3154.Google ScholarCross Ref
- Zaiwang Gu, Jun Cheng, Huazhu Fu, Kang Zhou, Huaying Hao, Yitian Zhao, Tianyang Zhang, Shenghua Gao, and Jiang Liu. 2019. Ce-net: Context encoder network for 2d medical image segmentation. IEEE transactions on medical imaging 38, 10 (2019), 2281–2292.Google Scholar
- Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770–778.Google ScholarCross Ref
- Tobias Heimann, Hans-Peter Meinzer, and Ivo Wolf. 2007. A statistical deformable model for the segmentation of liver CT volumes. 3D Segmentation in the clinic: A grand challenge (2007), 161–166.Google Scholar
- Yongbum Lee, Takeshi Hara, Hiroshi Fujita, Shigeki Itoh, and Takeo Ishigaki. 2001. Automated detection of pulmonary nodules in helical CT images based on an improved template-matching technique. IEEE Transactions on medical imaging 20, 7 (2001), 595–604.Google ScholarCross Ref
- Jonathan Long, Evan Shelhamer, and Trevor Darrell. 2015. Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition. 3431–3440.Google ScholarCross Ref
- Mingjun Ma, Haiying Xia, Yumei Tan, Haisheng Li, and Shuxiang Song. 2022. HT-Net: hierarchical context-attention transformer network for medical ct image segmentation. 52, 9 (15 1 2022), 10692–10705. https://doi.org/10.1007/s10489-021-03010-0Google ScholarDigital Library
- Fausto Milletari, Nassir Navab, and Seyed-Ahmad Ahmadi. 2016. V-net: Fully convolutional neural networks for volumetric medical image segmentation. In 2016 fourth international conference on 3D vision (3DV). IEEE, 565–571.Google Scholar
- Lei Mou, Yitian Zhao, Li Chen, Jun Cheng, Zaiwang Gu, Huaying Hao, Hong Qi, Yalin Zheng, Alejandro Frangi, and Jiang Liu. 2019. CS-Net: channel and spatial attention network for curvilinear structure segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 721–730.Google ScholarDigital Library
- Kenji Ono, Yutaro Iwamoto, Yen-Wei Chen, and Masahiro Nonaka. 2020. Automatic segmentation of infant brain ventricles with hydrocephalus in MRI based on 2.5 D U-net and transfer learning. Journal of Image and Graphics 8, 2 (2020), 42–46.Google ScholarCross Ref
- Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention. Springer, 234–241.Google ScholarCross Ref
- Wei Shen, Mu Zhou, Feng Yang, Di Dong, Caiyun Yang, Yali Zang, and Jie Tian. 2016. Learning from experts: Developing transferable deep features for patient-level lung cancer prediction. In International conference on medical image computing and computer-assisted intervention. Springer, 124–131.Google ScholarDigital Library
- Naofumi Shigeta, Mikoto Kamata, and Masayuki Kikuchi. 2019. Effectiveness of Pseudo 3D Feature Learning for Spinal Segmentation by CNN with U-Net Architecture. Journal of Image and Graphics3 (2019).Google Scholar
- Jiangdian Song, Caiyun Yang, Li Fan, Kun Wang, Feng Yang, Shiyuan Liu, and Jie Tian. 2015. Lung lesion extraction using a toboggan based growing automatic segmentation approach. IEEE transactions on medical imaging 35, 1 (2015), 337–353.Google Scholar
- Shuo Wang, Mu Zhou, Zaiyi Liu, Zhenyu Liu, Dongsheng Gu, Yali Zang, Di Dong, Olivier Gevaert, and Jie Tian. 2017. Central focused convolutional neural networks: Developing a data-driven model for lung nodule segmentation. Medical image analysis 40 (2017), 172–183.Google Scholar
- Jiaqi Wu, Guangxu Li, Huimin Lu, and Tohru Kamiy. 2021. A Supervoxel Classification Based Method for Multi-organ Segmentation from Abdominal CT Images. Journal of Image and Graphics1 (2021).Google Scholar
- Yitian Zhao, Yalin Zheng, Yonghuai Liu, Yifan Zhao, Lingling Luo, Siyuan Yang, Tong Na, Yongtian Wang, and Jiang Liu. 2017. Automatic 2-D/3-D vessel enhancement in multiple modality images using a weighted symmetry filter. IEEE transactions on medical imaging 37, 2 (2017), 438–450.Google Scholar
Index Terms
- HC-Net: Hierarchical Context integration Network for medical image segmentation
Recommendations
Review of brain MRI image segmentation methods
Brain image segmentation is one of the most important parts of clinical diagnostic tools. Brain images mostly contain noise, inhomogeneity and sometimes deviation. Therefore, accurate segmentation of brain images is a very difficult task. However, the ...
An interactive medical image segmentation framework using iterative refinement
Segmentation is often performed on medical images for identifying diseases in clinical evaluation. Hence it has become one of the major research areas. Conventional image segmentation techniques are unable to provide satisfactory segmentation results ...
Survey on liver CT image segmentation methods
The segmentation of liver using computed tomography (CT) data has gained a lot of importance in the medical image processing field. In this paper, we present a survey on liver segmentation methods and techniques using CT images, recent methods presented ...
Comments