Cross-domain retinopathy classification with optical coherence tomography images via a novel deep domain adaptation method
Deep learning based retinopathy classification with optical coherence tomography (OCT) images has recently attracted great attention. However, existing deep learning methods fail to work well when training and testing datasets are different due to the general issue of domain shift between datasets c...
Saved in:
Main Authors: | , , , , |
---|---|
Other Authors: | |
Format: | Article |
Language: | English |
Published: |
2023
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/169485 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-169485 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1694852023-07-21T15:40:36Z Cross-domain retinopathy classification with optical coherence tomography images via a novel deep domain adaptation method Luo, Yuemei Xu, Qing Hou, Yubo Liu, Linbo Wu, Min School of Electrical and Electronic Engineering School of Chemical and Biomedical Engineering Engineering::Bioengineering Deep Domain Adaptation Deep Learning Deep learning based retinopathy classification with optical coherence tomography (OCT) images has recently attracted great attention. However, existing deep learning methods fail to work well when training and testing datasets are different due to the general issue of domain shift between datasets caused by different collection devices, subjects, imaging parameters, etc. To address this practical and challenging issue, we propose a novel deep domain adaptation (DDA) method to train a model on a labeled dataset and adapt it to an unlabelled dataset (collected under different conditions). It consists of two modules for domain alignment, that is, adversarial learning and entropy minimization. We conduct extensive experiments on three public datasets to evaluate the performance of the proposed method. The results indicate that there are large domain shifts between datasets, resulting a poor performance for conventional deep learning methods. The proposed DDA method can significantly outperform existing methods for retinopathy classification with OCT images. It achieves retinopathy classification accuracies of 0.915, 0.959 and 0.990 under three cross-domain (cross-dataset) scenarios. Moreover, it obtains a comparable performance with human experts on a dataset where no labeled data in this dataset have been used to train the proposed DDA method. We have also visualized the learnt features by using the t-distributed stochastic neighbor embedding (t-SNE) technique. The results demonstrate that the proposed method can learn discriminative features for retinopathy classification. Ministry of Education (MOE) Ministry of Health (MOH) National Medical Research Council (NMRC) Submitted/Accepted version We sincerely appreciate funding support from Singapore Ministry of Health's National Medical Research Council under its Open Fund Individual Research Grant (MOH-OFIRG19may-0009), and Ministry of Education Singapore under its Academic Research Fund Tier1 (2018-T1-001-144) and its Academic Research Funding Tier 2 (MOE-T2EP30120-0001). 2023-07-20T07:27:38Z 2023-07-20T07:27:38Z 2021 Journal Article Luo, Y., Xu, Q., Hou, Y., Liu, L. & Wu, M. (2021). Cross-domain retinopathy classification with optical coherence tomography images via a novel deep domain adaptation method. Journal of Biophotonics, 14(8), e202100096-. https://dx.doi.org/10.1002/jbio.202100096 1864-063X https://hdl.handle.net/10356/169485 10.1002/jbio.202100096 33934549 2-s2.0-85105683104 8 14 e202100096 en MOH-OFIRG19may-0009 2018-T1-001-14 MOE-T2EP30120-0001 Journal of Biophotonics © 2021 Wiley-VCH GmbH. All rights reserved. This is the peer reviewed version of the following article: Luo, Y., Xu, Q., Hou, Y., Liu, L. & Wu, M. (2021). Cross-domain retinopathy classification with optical coherence tomography images via a novel deep domain adaptation method. Journal of Biophotonics, 14(8), e202100096-, which has been published in final form at https://doi.org/10.1002/jbio.202100096. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Use of Self-Archived Versions. application/pdf |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Engineering::Bioengineering Deep Domain Adaptation Deep Learning |
spellingShingle |
Engineering::Bioengineering Deep Domain Adaptation Deep Learning Luo, Yuemei Xu, Qing Hou, Yubo Liu, Linbo Wu, Min Cross-domain retinopathy classification with optical coherence tomography images via a novel deep domain adaptation method |
description |
Deep learning based retinopathy classification with optical coherence tomography (OCT) images has recently attracted great attention. However, existing deep learning methods fail to work well when training and testing datasets are different due to the general issue of domain shift between datasets caused by different collection devices, subjects, imaging parameters, etc. To address this practical and challenging issue, we propose a novel deep domain adaptation (DDA) method to train a model on a labeled dataset and adapt it to an unlabelled dataset (collected under different conditions). It consists of two modules for domain alignment, that is, adversarial learning and entropy minimization. We conduct extensive experiments on three public datasets to evaluate the performance of the proposed method. The results indicate that there are large domain shifts between datasets, resulting a poor performance for conventional deep learning methods. The proposed DDA method can significantly outperform existing methods for retinopathy classification with OCT images. It achieves retinopathy classification accuracies of 0.915, 0.959 and 0.990 under three cross-domain (cross-dataset) scenarios. Moreover, it obtains a comparable performance with human experts on a dataset where no labeled data in this dataset have been used to train the proposed DDA method. We have also visualized the learnt features by using the t-distributed stochastic neighbor embedding (t-SNE) technique. The results demonstrate that the proposed method can learn discriminative features for retinopathy classification. |
author2 |
School of Electrical and Electronic Engineering |
author_facet |
School of Electrical and Electronic Engineering Luo, Yuemei Xu, Qing Hou, Yubo Liu, Linbo Wu, Min |
format |
Article |
author |
Luo, Yuemei Xu, Qing Hou, Yubo Liu, Linbo Wu, Min |
author_sort |
Luo, Yuemei |
title |
Cross-domain retinopathy classification with optical coherence tomography images via a novel deep domain adaptation method |
title_short |
Cross-domain retinopathy classification with optical coherence tomography images via a novel deep domain adaptation method |
title_full |
Cross-domain retinopathy classification with optical coherence tomography images via a novel deep domain adaptation method |
title_fullStr |
Cross-domain retinopathy classification with optical coherence tomography images via a novel deep domain adaptation method |
title_full_unstemmed |
Cross-domain retinopathy classification with optical coherence tomography images via a novel deep domain adaptation method |
title_sort |
cross-domain retinopathy classification with optical coherence tomography images via a novel deep domain adaptation method |
publishDate |
2023 |
url |
https://hdl.handle.net/10356/169485 |
_version_ |
1773551246699921408 |