Multichannel Residual Conditional GAN-Leveraged Abdominal Pseudo-CT Generation via Dixon MR Images

Abstract

Magnetic resonance (MR) images have distinctive advantages in radiation treatment (RT) planning due to their superior, anatomic and functional information compared with computed tomography (CT). For the RT dose calculation, MR images cannot be directly used because of the lack of electron density information. To address this issue, we propose to generate pseudo-CT (pCT) in terms of multiple matching Dixon MR images to support MR-only RT, particularly in the challenging body section of the abdomen. To this end, we design the dedicated multichannel residual conditional generative adversarial network (MCRCGAN). The significance of our efforts is three-fold: 1) The MCRCGAN organically incorporates multiple theories and techniques, such as multichannel residual network (ResNet) and conditional generative adversarial network (cGAN), which facilitate its more authentic pCT generation than many existing methods. 2) The usage of residual modules effectively deepens the network without performance degradation, and the multichannel ResNet helps to simultaneously capture the substance of images, as extensively as possible, which is implicitly contained in the multiple different MR images of the same subject. 3) Due to the designed dedicated network structure, the MCRCGAN is capable of generating satisfactory pCTs under the condition of limited training data as well as prompt prediction response. Experimental studies on ten patients' paired MR-CT images demonstrate the effectiveness of our proposed MCRCGAN model on both the pCT generation quality and the performance stability.

Keywords

• Generative adversarial network (GAN)
• pseudo-CT
• abdomen
• deep learning