3D multi-modality medical image registration with synthetic image augmentation using CycleGAN

This report proposes a 3D multi-modality medical image registration network with CycleGAN-based synthetic image augmentation. The method is designed for intra-subject brain CT-MRI registration. A broad overview of our method is to first generate a synthetic CT image from the MRI using the CycleGAN a...

Full description

Saved in:
Bibliographic Details
Main Author: Mukherjee, Mitali Nirmallya
Other Authors: Jagath C Rajapakse
Format: Final Year Project
Language:English
Published: Nanyang Technological University 2022
Subjects:
Online Access:https://hdl.handle.net/10356/156702
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
Description
Summary:This report proposes a 3D multi-modality medical image registration network with CycleGAN-based synthetic image augmentation. The method is designed for intra-subject brain CT-MRI registration. A broad overview of our method is to first generate a synthetic CT image from the MRI using the CycleGAN and then align it with the MRI using the registration network to learn a deformation field which is then used to register the MRI with the CT. Furthermore, we use image-to-image similarity metrics between the synthetic CT and the CT along with an additional auxiliary loss between the warped MRI and the CT. Finally, we perform thorough experiments on our method and prove that it outperforms the state-of-the-art methods and tools.