Weakly supervised brain tumor segmentation via semantic affinity deep neural network

Moshe Yerachmiel; Hayit Greenspan

doi:10.1117/12.2612775

4 April 2022 Weakly supervised brain tumor segmentation via semantic affinity deep neural network

Moshe Yerachmiel, Hayit Greenspan

Proceedings Volume 12032, Medical Imaging 2022: Image Processing; 120323B (2022) https://doi.org/10.1117/12.2612775
Event: SPIE Medical Imaging, 2022, San Diego, California, United States

Abstract

Image segmentation tasks are considered resource intensive. These tasks require domain specialists to labor manually over long periods of time. When considering medical image segmentation tasks, the personnel and the error margin make these tasks expensive. Therefore there is a need for an automated tool. Deep learning has fast become the state of the art for such tasks, yet the methods applied require large data-sets of fully annotated examples. The need for supervision prevents researchers from developing deep learning and machine learning solutions on new datasets, which were not annotated by professional personnel. In this paper we utilize weak supervision to train a deep neural network to perform instance segmentation. The data used for this project is the Multimodal Brain Tumor Segmentation Challenge 3D MRI scans. The method used is a two-step DNN. The first step is binary classification of slices to either pathological or healthy. This is the only step which uses supervision for the training of the DNNs. In the second step, another DNN in the form of a Unet encoder-decoder network is utilized. This network encodes the input raw data and decodes each pixel to a 32 dimensional vector representing a semantic identity (semantic map). The supervision for training this second network is derived from the GradCAM of the classification DNN. Lastly, to segment the input data we determine the semantic distance between suspected lesion points and the entirety of the map. We achieve an average Dice score of 0.73 over three test sets of 38 patients each.

Citation Download Citation

Moshe Yerachmiel and Hayit Greenspan "Weakly supervised brain tumor segmentation via semantic affinity deep neural network", Proc. SPIE 12032, Medical Imaging 2022: Image Processing, 120323B (4 April 2022); https://doi.org/10.1117/12.2612775

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
7 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Computer programming

Image segmentation

Tumors

Classification systems

Brain

Neural networks

Binary data

Show All Keywords

Keywords/Phrases

Search In:

Publication Years