Multi-task learning approach for volumetric segmentation and reconstruction in 3D OCT images

• Main Authors: Cahyo, Dheo A. Y., Yow, Ai Ping, Saw, Seang-Mei, Ang, Marcus, Girard, Michael, Schmetterer, Leopold, Wong, Damon Wing Kee
• Other Authors: School of Chemical and Biomedical Engineering
• Format: Article
• Language: English
• Published: 2022
• Subjects: Engineering::Chemical engineering; Engineering::Electrical and electronic engineering::Optics, optoelectronics, photonics; Image Reconstruction; Optical Tomography
• Online Access: https://hdl.handle.net/10356/156185
• Institution: Nanyang Technological University

The choroid is the vascular layer of the eye that supplies photoreceptors with oxygen. Changes in the choroid are associated with many pathologies including myopia where the choroid progressively thins due to axial elongation. To quantize these changes, there is a need to automatically and accurately segment the choroidal layer from optical coherence tomography (OCT) images. In this paper, we propose a multi-task learning approach to segment the choroid from three-dimensional OCT images. Our proposed architecture aggregates the spatial context from adjacent cross-sectional slices to reconstruct the central slice. Spatial context learned by this reconstruction mechanism is then fused with a U-Net based architecture for segmentation. The proposed approach was evaluated on volumetric OCT scans of 166 myopic eyes acquired with a commercial OCT system, and achieved a cross-validation Intersection over Union (IoU) score of 94.69% which significantly outperformed (p<0.001) the other state-of-the-art methods on the same data set. Choroidal thickness maps generated by our approach also achieved a better structural similarity index (SSIM) of 72.11% with respect to the groundtruth. In particular, our approach performs well for highly challenging eyes with thinner choroids. Compared to other methods, our proposed approach also requires lesser processing time and has lower computational requirements. The results suggest that our proposed approach could potentially be used as a fast and reliable method for automated choroidal segmentation.