3D multi-modality medical image registration with GAN-based synthetic image augmentation

• Main Author: Guo, Zhiwei
• Other Authors: Jagath C Rajapakse
• Format: Final Year Project
• Language: English
• Published: Nanyang Technological University 2021
• Subjects: Engineering::Computer science and engineering
• Online Access: https://hdl.handle.net/10356/152248
• Institution: Nanyang Technological University

Medical image registration is a crucial yet challenging task in medical image analysis and processing. we propose an end-to-end unsupervised multi-modality deformable image registration network with CycleGAN augmentation. The proposed method is designed for intra-subject brain MRI-CT registration. The registration network can be divided into two stage. First, it generates a synthetic CT image from its corresponding MRI image by using CycleGAN. Second, by feeding the synthetic CT (sCT) and original CT into an unsupervised registration network, the deformation field to align the sCT and CT image is obtained, which is also the deformation field applied to the MRI image to align with CT image. Compared with state-of-art unsupervised registration method, instead of calculating a single mono-modality image similarity on CT and warped sCT, we also include a mutual information multi-modality image similarity on CT and warped MRI. We demonstrated that our proposed method outperforms both current state-of-the-art registration algorithm and existing registration tools. Because of an impending Technical Disclosure, some details of methodology have been omitted in this report.