Cross-domain retinopathy classification with optical coherence tomography images via a novel deep domain adaptation method

Deep learning based retinopathy classification with optical coherence tomography (OCT) images has recently attracted great attention. However, existing deep learning methods fail to work well when training and testing datasets are different due to the general issue of domain shift between datasets c...

Full description

Saved in:
Bibliographic Details
Main Authors: Luo, Yuemei, Xu, Qing, Hou, Yubo, Liu, Linbo, Wu, Min
Other Authors: School of Electrical and Electronic Engineering
Format: Article
Language:English
Published: 2023
Subjects:
Online Access:https://hdl.handle.net/10356/169485
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-169485
record_format dspace
spelling sg-ntu-dr.10356-1694852023-07-21T15:40:36Z Cross-domain retinopathy classification with optical coherence tomography images via a novel deep domain adaptation method Luo, Yuemei Xu, Qing Hou, Yubo Liu, Linbo Wu, Min School of Electrical and Electronic Engineering School of Chemical and Biomedical Engineering Engineering::Bioengineering Deep Domain Adaptation Deep Learning Deep learning based retinopathy classification with optical coherence tomography (OCT) images has recently attracted great attention. However, existing deep learning methods fail to work well when training and testing datasets are different due to the general issue of domain shift between datasets caused by different collection devices, subjects, imaging parameters, etc. To address this practical and challenging issue, we propose a novel deep domain adaptation (DDA) method to train a model on a labeled dataset and adapt it to an unlabelled dataset (collected under different conditions). It consists of two modules for domain alignment, that is, adversarial learning and entropy minimization. We conduct extensive experiments on three public datasets to evaluate the performance of the proposed method. The results indicate that there are large domain shifts between datasets, resulting a poor performance for conventional deep learning methods. The proposed DDA method can significantly outperform existing methods for retinopathy classification with OCT images. It achieves retinopathy classification accuracies of 0.915, 0.959 and 0.990 under three cross-domain (cross-dataset) scenarios. Moreover, it obtains a comparable performance with human experts on a dataset where no labeled data in this dataset have been used to train the proposed DDA method. We have also visualized the learnt features by using the t-distributed stochastic neighbor embedding (t-SNE) technique. The results demonstrate that the proposed method can learn discriminative features for retinopathy classification. Ministry of Education (MOE) Ministry of Health (MOH) National Medical Research Council (NMRC) Submitted/Accepted version We sincerely appreciate funding support from Singapore Ministry of Health's National Medical Research Council under its Open Fund Individual Research Grant (MOH-OFIRG19may-0009), and Ministry of Education Singapore under its Academic Research Fund Tier1 (2018-T1-001-144) and its Academic Research Funding Tier 2 (MOE-T2EP30120-0001). 2023-07-20T07:27:38Z 2023-07-20T07:27:38Z 2021 Journal Article Luo, Y., Xu, Q., Hou, Y., Liu, L. & Wu, M. (2021). Cross-domain retinopathy classification with optical coherence tomography images via a novel deep domain adaptation method. Journal of Biophotonics, 14(8), e202100096-. https://dx.doi.org/10.1002/jbio.202100096 1864-063X https://hdl.handle.net/10356/169485 10.1002/jbio.202100096 33934549 2-s2.0-85105683104 8 14 e202100096 en MOH-OFIRG19may-0009 2018-T1-001-14 MOE-T2EP30120-0001 Journal of Biophotonics © 2021 Wiley-VCH GmbH. All rights reserved. This is the peer reviewed version of the following article: Luo, Y., Xu, Q., Hou, Y., Liu, L. & Wu, M. (2021). Cross-domain retinopathy classification with optical coherence tomography images via a novel deep domain adaptation method. Journal of Biophotonics, 14(8), e202100096-, which has been published in final form at https://doi.org/10.1002/jbio.202100096. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Use of Self-Archived Versions. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Bioengineering
Deep Domain Adaptation
Deep Learning
spellingShingle Engineering::Bioengineering
Deep Domain Adaptation
Deep Learning
Luo, Yuemei
Xu, Qing
Hou, Yubo
Liu, Linbo
Wu, Min
Cross-domain retinopathy classification with optical coherence tomography images via a novel deep domain adaptation method
description Deep learning based retinopathy classification with optical coherence tomography (OCT) images has recently attracted great attention. However, existing deep learning methods fail to work well when training and testing datasets are different due to the general issue of domain shift between datasets caused by different collection devices, subjects, imaging parameters, etc. To address this practical and challenging issue, we propose a novel deep domain adaptation (DDA) method to train a model on a labeled dataset and adapt it to an unlabelled dataset (collected under different conditions). It consists of two modules for domain alignment, that is, adversarial learning and entropy minimization. We conduct extensive experiments on three public datasets to evaluate the performance of the proposed method. The results indicate that there are large domain shifts between datasets, resulting a poor performance for conventional deep learning methods. The proposed DDA method can significantly outperform existing methods for retinopathy classification with OCT images. It achieves retinopathy classification accuracies of 0.915, 0.959 and 0.990 under three cross-domain (cross-dataset) scenarios. Moreover, it obtains a comparable performance with human experts on a dataset where no labeled data in this dataset have been used to train the proposed DDA method. We have also visualized the learnt features by using the t-distributed stochastic neighbor embedding (t-SNE) technique. The results demonstrate that the proposed method can learn discriminative features for retinopathy classification.
author2 School of Electrical and Electronic Engineering
author_facet School of Electrical and Electronic Engineering
Luo, Yuemei
Xu, Qing
Hou, Yubo
Liu, Linbo
Wu, Min
format Article
author Luo, Yuemei
Xu, Qing
Hou, Yubo
Liu, Linbo
Wu, Min
author_sort Luo, Yuemei
title Cross-domain retinopathy classification with optical coherence tomography images via a novel deep domain adaptation method
title_short Cross-domain retinopathy classification with optical coherence tomography images via a novel deep domain adaptation method
title_full Cross-domain retinopathy classification with optical coherence tomography images via a novel deep domain adaptation method
title_fullStr Cross-domain retinopathy classification with optical coherence tomography images via a novel deep domain adaptation method
title_full_unstemmed Cross-domain retinopathy classification with optical coherence tomography images via a novel deep domain adaptation method
title_sort cross-domain retinopathy classification with optical coherence tomography images via a novel deep domain adaptation method
publishDate 2023
url https://hdl.handle.net/10356/169485
_version_ 1773551246699921408