The use of generative adversarial network and graph convolution network for neuroimaging-based diagnostic classification

Functional connectivity (FC) obtained from resting-state functional magnetic resonance imaging has been integrated with machine learning algorithms to deliver consistent and reliable brain disease classification outcomes. However, in classical learning procedures, custom-built specialized feature se...

Full description

Saved in:
Bibliographic Details
Main Authors: Huynh, Nguyen, Yan, Da, Ma, Yueen, Wu, Shengbin, Long, Cheng, Sami, Mirza Tanzim, Almudaifer, Abdullateef, Jiang, Zhe, Chen, Haiquan, Dretsch, Michael N., Denney, Thomas S., Deshpande, Rangaprakash, Deshpande, Gopikrishna
Other Authors: School of Computer Science and Engineering
Format: Article
Language:English
Published: 2024
Subjects:
Online Access:https://hdl.handle.net/10356/179759
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-179759
record_format dspace
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Computer and Information Science
Deep learning
Generative adversarial network
spellingShingle Computer and Information Science
Deep learning
Generative adversarial network
Huynh, Nguyen
Yan, Da
Ma, Yueen
Wu, Shengbin
Long, Cheng
Sami, Mirza Tanzim
Almudaifer, Abdullateef
Jiang, Zhe
Chen, Haiquan
Dretsch, Michael N.
Denney, Thomas S.
Deshpande, Rangaprakash
Deshpande, Gopikrishna
The use of generative adversarial network and graph convolution network for neuroimaging-based diagnostic classification
description Functional connectivity (FC) obtained from resting-state functional magnetic resonance imaging has been integrated with machine learning algorithms to deliver consistent and reliable brain disease classification outcomes. However, in classical learning procedures, custom-built specialized feature selection techniques are typically used to filter out uninformative features from FC patterns to generalize efficiently on the datasets. The ability of convolutional neural networks (CNN) and other deep learning models to extract informative features from data with grid structure (such as images) has led to the surge in popularity of these techniques. However, the designs of many existing CNN models still fail to exploit the relationships between entities of graph-structure data (such as networks). Therefore, graph convolution network (GCN) has been suggested as a means for uncovering the intricate structure of brain network data, which has the potential to substantially improve classification accuracy. Furthermore, overfitting in classifiers can be largely attributed to the limited number of available training samples. Recently, the generative adversarial network (GAN) has been widely used in the medical field for its generative aspect that can generate synthesis images to cope with the problems of data scarcity and patient privacy. In our previous work, GCN and GAN have been designed to investigate FC patterns to perform diagnosis tasks, and their effectiveness has been tested on the ABIDE-I dataset. In this paper, the models will be further applied to FC data derived from more public datasets (ADHD, ABIDE-II, and ADNI) and our in-house dataset (PTSD) to justify their generalization on all types of data. The results of a number of experiments show the powerful characteristic of GAN to mimic FC data to achieve high performance in disease prediction. When employing GAN for data augmentation, the diagnostic accuracy across ADHD-200, ABIDE-II, and ADNI datasets surpasses that of other machine learning models, including results achieved with BrainNetCNN. Specifically, in ADHD, the accuracy increased from 67.74% to 73.96% with GAN, in ABIDE-II from 70.36% to 77.40%, and in ADNI, reaching 52.84% and 88.56% for multiclass and binary classification, respectively. GCN also obtains decent results, with the best accuracy in ADHD datasets at 71.38% for multinomial and 75% for binary classification, respectively, and the second-best accuracy in the ABIDE-II dataset (72.28% and 75.16%, respectively). Both GAN and GCN achieved the highest accuracy for the PTSD dataset, reaching 97.76%. However, there are still some limitations that can be improved. Both methods have many opportunities for the prediction and diagnosis of diseases.
author2 School of Computer Science and Engineering
author_facet School of Computer Science and Engineering
Huynh, Nguyen
Yan, Da
Ma, Yueen
Wu, Shengbin
Long, Cheng
Sami, Mirza Tanzim
Almudaifer, Abdullateef
Jiang, Zhe
Chen, Haiquan
Dretsch, Michael N.
Denney, Thomas S.
Deshpande, Rangaprakash
Deshpande, Gopikrishna
format Article
author Huynh, Nguyen
Yan, Da
Ma, Yueen
Wu, Shengbin
Long, Cheng
Sami, Mirza Tanzim
Almudaifer, Abdullateef
Jiang, Zhe
Chen, Haiquan
Dretsch, Michael N.
Denney, Thomas S.
Deshpande, Rangaprakash
Deshpande, Gopikrishna
author_sort Huynh, Nguyen
title The use of generative adversarial network and graph convolution network for neuroimaging-based diagnostic classification
title_short The use of generative adversarial network and graph convolution network for neuroimaging-based diagnostic classification
title_full The use of generative adversarial network and graph convolution network for neuroimaging-based diagnostic classification
title_fullStr The use of generative adversarial network and graph convolution network for neuroimaging-based diagnostic classification
title_full_unstemmed The use of generative adversarial network and graph convolution network for neuroimaging-based diagnostic classification
title_sort use of generative adversarial network and graph convolution network for neuroimaging-based diagnostic classification
publishDate 2024
url https://hdl.handle.net/10356/179759
_version_ 1814047041259569152
spelling sg-ntu-dr.10356-1797592024-08-23T15:36:04Z The use of generative adversarial network and graph convolution network for neuroimaging-based diagnostic classification Huynh, Nguyen Yan, Da Ma, Yueen Wu, Shengbin Long, Cheng Sami, Mirza Tanzim Almudaifer, Abdullateef Jiang, Zhe Chen, Haiquan Dretsch, Michael N. Denney, Thomas S. Deshpande, Rangaprakash Deshpande, Gopikrishna School of Computer Science and Engineering Computer and Information Science Deep learning Generative adversarial network Functional connectivity (FC) obtained from resting-state functional magnetic resonance imaging has been integrated with machine learning algorithms to deliver consistent and reliable brain disease classification outcomes. However, in classical learning procedures, custom-built specialized feature selection techniques are typically used to filter out uninformative features from FC patterns to generalize efficiently on the datasets. The ability of convolutional neural networks (CNN) and other deep learning models to extract informative features from data with grid structure (such as images) has led to the surge in popularity of these techniques. However, the designs of many existing CNN models still fail to exploit the relationships between entities of graph-structure data (such as networks). Therefore, graph convolution network (GCN) has been suggested as a means for uncovering the intricate structure of brain network data, which has the potential to substantially improve classification accuracy. Furthermore, overfitting in classifiers can be largely attributed to the limited number of available training samples. Recently, the generative adversarial network (GAN) has been widely used in the medical field for its generative aspect that can generate synthesis images to cope with the problems of data scarcity and patient privacy. In our previous work, GCN and GAN have been designed to investigate FC patterns to perform diagnosis tasks, and their effectiveness has been tested on the ABIDE-I dataset. In this paper, the models will be further applied to FC data derived from more public datasets (ADHD, ABIDE-II, and ADNI) and our in-house dataset (PTSD) to justify their generalization on all types of data. The results of a number of experiments show the powerful characteristic of GAN to mimic FC data to achieve high performance in disease prediction. When employing GAN for data augmentation, the diagnostic accuracy across ADHD-200, ABIDE-II, and ADNI datasets surpasses that of other machine learning models, including results achieved with BrainNetCNN. Specifically, in ADHD, the accuracy increased from 67.74% to 73.96% with GAN, in ABIDE-II from 70.36% to 77.40%, and in ADNI, reaching 52.84% and 88.56% for multiclass and binary classification, respectively. GCN also obtains decent results, with the best accuracy in ADHD datasets at 71.38% for multinomial and 75% for binary classification, respectively, and the second-best accuracy in the ABIDE-II dataset (72.28% and 75.16%, respectively). Both GAN and GCN achieved the highest accuracy for the PTSD dataset, reaching 97.76%. However, there are still some limitations that can be improved. Both methods have many opportunities for the prediction and diagnosis of diseases. Published version Attention deficit hyperactivity disorder (ADHD) data acquisition was supported by NIMH (National Institute of Mental Health, Bethesda, MD, USA) grant # R03MH096321. Alzheimer’s disease neuroimaging initiative (ADNI) data acquisition was funded by multiple agencies and the list can be obtained from http://adni.loni.usc.edu/wp-content/uploads/how_to_apply/ADNI_ Acknowledgement_List.pdf, accessed on 19 March 2024. As such, the investigators within the ADNI contributed to the design and implementation of ADNI and/or provided data but did not participate in analysis or writing of this report. Autism brain imaging data exchange (ABIDE) data acquisition was supported by NIMH grant # K23MH087770. The authors acknowledge financial support for this work from the U.S. Army Medical Research and Development Command (MRDC) (Grant number 00007218). 2024-08-21T02:31:46Z 2024-08-21T02:31:46Z 2024 Journal Article Huynh, N., Yan, D., Ma, Y., Wu, S., Long, C., Sami, M. T., Almudaifer, A., Jiang, Z., Chen, H., Dretsch, M. N., Denney, T. S., Deshpande, R. & Deshpande, G. (2024). The use of generative adversarial network and graph convolution network for neuroimaging-based diagnostic classification. Brain Sciences, 14(5), 14050456-. https://dx.doi.org/10.3390/brainsci14050456 2076-3425 https://hdl.handle.net/10356/179759 10.3390/brainsci14050456 38790434 2-s2.0-85194410012 5 14 14050456 en Brain Sciences © 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https:// creativecommons.org/licenses/by/ 4.0/). application/pdf