Evaluation of generative adversarial networks for high-resolution synthetic image generation of circumpapillary optical coherence tomography images for glaucoma

Importance: Deep learning (DL) networks require large data sets for training, which can be challenging to collect clinically. Generative models could be used to generate large numbers of synthetic optical coherence tomography (OCT) images to train such DL networks for glaucoma detection. Objective:...

Full description

Saved in:
Bibliographic Details
Main Authors: Sreejith Kumar, Ashish Jith, Chong, Rachel S., Crowston, Jonathan G., Chua, Jacqueline, Bujor, Inna, Husain, Rahat, Vithana, Eranga N., Girard, Michaël J. A., Ting, Daniel S. W., Cheng, Ching-Yu, Aung, Tin, Popa-Cherecheanu, Alina, Schmetterer, Leopold, Wong, Damon
Other Authors: School of Chemical and Biomedical Engineering
Format: Article
Language:English
Published: 2023
Subjects:
Online Access:https://hdl.handle.net/10356/165014
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-165014
record_format dspace
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Bioengineering
Glaucoma
Diagnostic Imaging
spellingShingle Engineering::Bioengineering
Glaucoma
Diagnostic Imaging
Sreejith Kumar, Ashish Jith
Chong, Rachel S.
Crowston, Jonathan G.
Chua, Jacqueline
Bujor, Inna
Husain, Rahat
Vithana, Eranga N.
Girard, Michaël J. A.
Ting, Daniel S. W.
Cheng, Ching-Yu
Aung, Tin
Popa-Cherecheanu, Alina
Schmetterer, Leopold
Wong, Damon
Evaluation of generative adversarial networks for high-resolution synthetic image generation of circumpapillary optical coherence tomography images for glaucoma
description Importance: Deep learning (DL) networks require large data sets for training, which can be challenging to collect clinically. Generative models could be used to generate large numbers of synthetic optical coherence tomography (OCT) images to train such DL networks for glaucoma detection. Objective: To assess whether generative models can synthesize circumpapillary optic nerve head OCT images of normal and glaucomatous eyes and determine the usability of synthetic images for training DL models for glaucoma detection. Design, Setting, and Participants: Progressively growing generative adversarial network models were trained to generate circumpapillary OCT scans. Image gradeability and authenticity were evaluated on a clinical set of 100 real and 100 synthetic images by 2 clinical experts. DL networks for glaucoma detection were trained with real or synthetic images and evaluated on independent internal and external test data sets of 140 and 300 real images, respectively. Main Outcomes and Measures: Evaluations of the clinical set between the experts were compared. Glaucoma detection performance of the DL networks was assessed using area under the curve (AUC) analysis. Class activation maps provided visualizations of the regions contributing to the respective classifications. Results: A total of 990 normal and 862 glaucomatous eyes were analyzed. Evaluations of the clinical set were similar for gradeability (expert 1: 92.0%; expert 2: 93.0%) and authenticity (expert 1: 51.8%; expert 2: 51.3%). The best-performing DL network trained on synthetic images had AUC scores of 0.97 (95% CI, 0.95-0.99) on the internal test data set and 0.90 (95% CI, 0.87-0.93) on the external test data set, compared with AUCs of 0.96 (95% CI, 0.94-0.99) on the internal test data set and 0.84 (95% CI, 0.80-0.87) on the external test data set for the network trained with real images. An increase in the AUC for the synthetic DL network was observed with the use of larger synthetic data set sizes. Class activation maps showed that the regions of the synthetic images contributing to glaucoma detection were generally similar to that of real images. Conclusions and Relevance: DL networks trained with synthetic OCT images for glaucoma detection were comparable with networks trained with real images. These results suggest potential use of generative models in the training of DL networks and as a means of data sharing across institutions without patient information confidentiality issues.
author2 School of Chemical and Biomedical Engineering
author_facet School of Chemical and Biomedical Engineering
Sreejith Kumar, Ashish Jith
Chong, Rachel S.
Crowston, Jonathan G.
Chua, Jacqueline
Bujor, Inna
Husain, Rahat
Vithana, Eranga N.
Girard, Michaël J. A.
Ting, Daniel S. W.
Cheng, Ching-Yu
Aung, Tin
Popa-Cherecheanu, Alina
Schmetterer, Leopold
Wong, Damon
format Article
author Sreejith Kumar, Ashish Jith
Chong, Rachel S.
Crowston, Jonathan G.
Chua, Jacqueline
Bujor, Inna
Husain, Rahat
Vithana, Eranga N.
Girard, Michaël J. A.
Ting, Daniel S. W.
Cheng, Ching-Yu
Aung, Tin
Popa-Cherecheanu, Alina
Schmetterer, Leopold
Wong, Damon
author_sort Sreejith Kumar, Ashish Jith
title Evaluation of generative adversarial networks for high-resolution synthetic image generation of circumpapillary optical coherence tomography images for glaucoma
title_short Evaluation of generative adversarial networks for high-resolution synthetic image generation of circumpapillary optical coherence tomography images for glaucoma
title_full Evaluation of generative adversarial networks for high-resolution synthetic image generation of circumpapillary optical coherence tomography images for glaucoma
title_fullStr Evaluation of generative adversarial networks for high-resolution synthetic image generation of circumpapillary optical coherence tomography images for glaucoma
title_full_unstemmed Evaluation of generative adversarial networks for high-resolution synthetic image generation of circumpapillary optical coherence tomography images for glaucoma
title_sort evaluation of generative adversarial networks for high-resolution synthetic image generation of circumpapillary optical coherence tomography images for glaucoma
publishDate 2023
url https://hdl.handle.net/10356/165014
_version_ 1787136649217441792
spelling sg-ntu-dr.10356-1650142023-12-29T06:50:10Z Evaluation of generative adversarial networks for high-resolution synthetic image generation of circumpapillary optical coherence tomography images for glaucoma Sreejith Kumar, Ashish Jith Chong, Rachel S. Crowston, Jonathan G. Chua, Jacqueline Bujor, Inna Husain, Rahat Vithana, Eranga N. Girard, Michaël J. A. Ting, Daniel S. W. Cheng, Ching-Yu Aung, Tin Popa-Cherecheanu, Alina Schmetterer, Leopold Wong, Damon School of Chemical and Biomedical Engineering Engineering::Bioengineering Glaucoma Diagnostic Imaging Importance: Deep learning (DL) networks require large data sets for training, which can be challenging to collect clinically. Generative models could be used to generate large numbers of synthetic optical coherence tomography (OCT) images to train such DL networks for glaucoma detection. Objective: To assess whether generative models can synthesize circumpapillary optic nerve head OCT images of normal and glaucomatous eyes and determine the usability of synthetic images for training DL models for glaucoma detection. Design, Setting, and Participants: Progressively growing generative adversarial network models were trained to generate circumpapillary OCT scans. Image gradeability and authenticity were evaluated on a clinical set of 100 real and 100 synthetic images by 2 clinical experts. DL networks for glaucoma detection were trained with real or synthetic images and evaluated on independent internal and external test data sets of 140 and 300 real images, respectively. Main Outcomes and Measures: Evaluations of the clinical set between the experts were compared. Glaucoma detection performance of the DL networks was assessed using area under the curve (AUC) analysis. Class activation maps provided visualizations of the regions contributing to the respective classifications. Results: A total of 990 normal and 862 glaucomatous eyes were analyzed. Evaluations of the clinical set were similar for gradeability (expert 1: 92.0%; expert 2: 93.0%) and authenticity (expert 1: 51.8%; expert 2: 51.3%). The best-performing DL network trained on synthetic images had AUC scores of 0.97 (95% CI, 0.95-0.99) on the internal test data set and 0.90 (95% CI, 0.87-0.93) on the external test data set, compared with AUCs of 0.96 (95% CI, 0.94-0.99) on the internal test data set and 0.84 (95% CI, 0.80-0.87) on the external test data set for the network trained with real images. An increase in the AUC for the synthetic DL network was observed with the use of larger synthetic data set sizes. Class activation maps showed that the regions of the synthetic images contributing to glaucoma detection were generally similar to that of real images. Conclusions and Relevance: DL networks trained with synthetic OCT images for glaucoma detection were comparable with networks trained with real images. These results suggest potential use of generative models in the training of DL networks and as a means of data sharing across institutions without patient information confidentiality issues. Agency for Science, Technology and Research (A*STAR) Nanyang Technological University National Medical Research Council (NMRC) National Research Foundation (NRF) Published version This work was funded by grants from the National Medical Research Council (grants CG/C010A/2017_SERI, OFLCG/004c/2018-00, MOH-000249-00, MOH-000647-00, MOH-001001-00, MOH-001015-00, MOH-000500-00, and MOH-000707-00), National Research Foundation Singapore (grants NRF2019-THE002-0006 and NRF-CRP24-2020-0001), A*STAR (grant A20H4b0141), the Singapore Eye Research Institute & Nanyang Technological University (SERI-NTU Advanced Ocular Engineering [STANCE] Program), and the SERI-Lee Foundation (grant LF1019-1) in Singapore. 2023-03-07T08:24:41Z 2023-03-07T08:24:41Z 2022 Journal Article Sreejith Kumar, A. J., Chong, R. S., Crowston, J. G., Chua, J., Bujor, I., Husain, R., Vithana, E. N., Girard, M. J. A., Ting, D. S. W., Cheng, C., Aung, T., Popa-Cherecheanu, A., Schmetterer, L. & Wong, D. (2022). Evaluation of generative adversarial networks for high-resolution synthetic image generation of circumpapillary optical coherence tomography images for glaucoma. JAMA Ophthalmology, 140(10), 974-981. https://dx.doi.org/10.1001/jamaophthalmol.2022.3375 2168-6165 https://hdl.handle.net/10356/165014 10.1001/jamaophthalmol.2022.3375 36048435 2-s2.0-85137562904 10 140 974 981 en CG/C010A/2017_SERI OFLCG/004c/2018-00 MOH-000249-00 MOH-000647-00 MOH-001001-00 MOH-001015-00 MOH-000500-00 MOH-000707-00 NRF2019-THE002-0006 NRF-CRP24-2020-0001 A20H4b0141 LF1019-1 JAMA Ophthalmology © 2022 Sreejith Kumar AJ et al. This is an open access article distributed under the terms of the CC-BY License. application/pdf