CT synthesis using CycleGAN with Swin transformer for magnetic resonance imaging guided radiotherapy

Youngeun Choi; Seungwan Lee

doi:10.1117/12.3006377

1 April 2024 CT synthesis using CycleGAN with Swin transformer for magnetic resonance imaging guided radiotherapy

Youngeun Choi, Seungwan Lee

Proceedings Volume 12925, Medical Imaging 2024: Physics of Medical Imaging; 129254B (2024) https://doi.org/10.1117/12.3006377
Event: SPIE Medical Imaging, 2024, San Diego, California, United States

Conference Poster

Abstract

Synthetic computed tomography (sCT) techniques for magnetic resonance imaging guided radiotherapy (MRIgRT) play an important role in eliminating the risks caused by ionizing radiation exposures and simplifying a clinical workflow. However, conventional sCT techniques cause errors in the MR image-to-CT image conversion and require high computational costs. These limitations interrupt the clinical applications of the conventional sCT techniques. In this study, we proposed a Swin transformer-based cycle generative adversarial network (SCGAN) for generating accurate synthetic computed tomography (sCT) images for magnetic resonance imaging guided radiotherapy (MRIgRT). The convolution layers in the generator of the SCGAN were partially replaced by 4 to 6 residual Swin transformer blocks (RSTBs) for reducing trainable parameters. In each RSTB, the deep features of an input image were extracted by 2 sequential Swin transformer layers, which can implement the multi-head self-attention (W-MSA) and shift window multi-head self-attention (SW-MSA). The performance of the proposed model was compared to those of the Pix2Pix and CycleGAN. The results showed that the sCT images for the proposed models were close to a ground-truth image, and the SSIMs of the proposed models were averagely 21.57 and 9.67% higher than those of the Pix2Pix and CycleGAN, respectively. In conclusion, the proposed SCGAN is able to provide accurate sCT images for the MRIgRT

Citation Download Citation

Youngeun Choi and Seungwan Lee "CT synthesis using CycleGAN with Swin transformer for magnetic resonance imaging guided radiotherapy", Proc. SPIE 12925, Medical Imaging 2024: Physics of Medical Imaging, 129254B (1 April 2024); https://doi.org/10.1117/12.3006377

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available