Development of an explainable artificial intelligence model for Asian vascular wound images
Chronic wounds contribute to significant healthcare and economic burden worldwide. Wound assessment remains challenging given its complex and dynamic nature. The use of artificial intelligence (AI) and machine learning methods in wound analysis is promising. Explainable modelling can help its integr...
Saved in:
Main Authors: | , , , , , , , , , |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2023
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/8546 https://ink.library.smu.edu.sg/context/sis_research/article/9549/viewcontent/International_Wound_Journal___2023___Lo___Development_of_an_explainable_artificial_intelligence_model_for_Asian_vascular.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
id |
sg-smu-ink.sis_research-9549 |
---|---|
record_format |
dspace |
spelling |
sg-smu-ink.sis_research-95492024-01-22T14:50:13Z Development of an explainable artificial intelligence model for Asian vascular wound images LO, Zhiwen Joseph MAK, Malcolm Han Wen LIANG, Shanying CHAN, Yam Meng GOH, Cheng Cheng LAI, Tina Peiting TAN, Audrey Hui Min THNG, Patrick THNG, Patrick WEYDE, Tillman SMIT, Sylvia Chronic wounds contribute to significant healthcare and economic burden worldwide. Wound assessment remains challenging given its complex and dynamic nature. The use of artificial intelligence (AI) and machine learning methods in wound analysis is promising. Explainable modelling can help its integration and acceptance in healthcare systems. We aim to develop an explainable AI model for analysing vascular wound images among an Asian population. Two thousand nine hundred and fifty-seven wound images from a vascular wound image registry from a tertiary institution in Singapore were utilized. The dataset was split into training, validation and test sets. Wound images were classified into four types (neuroischaemic ulcer [NIU], surgical site infections [SSI], venous leg ulcers [VLU], pressure ulcer [PU]), measured with automatic estimation of width, length and depth and segmented into 18 wound and peri-wound features. Data pre-processing was performed using oversampling and augmentation techniques. Convolutional and deep learning models were utilized for model development. The model was evaluated with accuracy, F1 score and receiver operating characteristic (ROC) curves. Explainability methods were used to interpret AI decision reasoning. A web browser application was developed to demonstrate results of the wound AI model with explainability. After development, the model was tested on additional 15 476 unlabelled images to evaluate effectiveness. After the development on the training and validation dataset, the model performance on unseen labelled images in the test set achieved an AUROC of 0.99 for wound classification with mean accuracy of 95.9%. For wound measurements, the model achieved AUROC of 0.97 with mean accuracy of 85.0% for depth classification, and AUROC of 0.92 with mean accuracy of 87.1% for width and length determination. For wound segmentation, an AUROC of 0.95 and mean accuracy of 87.8% was achieved. Testing on unlabelled images, the model confidence score for wound classification was 82.8% with an explainability score of 60.6%. Confidence score was 87.6% for depth classification with 68.0% explainability score, while width and length measurement obtained 93.0% accuracy score with 76.6% explainability. Confidence score for wound segmentation was 83.9%, while explainability was 72.1%. Using explainable AI models, we have developed an algorithm and application for analysis of vascular wound images from an Asian population with accuracy and explainability. With further development, it can be utilized as a clinical decision support system and integrated into existing healthcare electronic systems. 2023-12-01T08:00:00Z text application/pdf https://ink.library.smu.edu.sg/sis_research/8546 info:doi/10.1111/iwj.14565 https://ink.library.smu.edu.sg/context/sis_research/article/9549/viewcontent/International_Wound_Journal___2023___Lo___Development_of_an_explainable_artificial_intelligence_model_for_Asian_vascular.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University artificial intelligence computer-assisted image analysis machine learning vascular wounds wound imaging explainable artificial intelligence Artificial Intelligence and Robotics Databases and Information Systems |
institution |
Singapore Management University |
building |
SMU Libraries |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
SMU Libraries |
collection |
InK@SMU |
language |
English |
topic |
artificial intelligence computer-assisted image analysis machine learning vascular wounds wound imaging explainable artificial intelligence Artificial Intelligence and Robotics Databases and Information Systems |
spellingShingle |
artificial intelligence computer-assisted image analysis machine learning vascular wounds wound imaging explainable artificial intelligence Artificial Intelligence and Robotics Databases and Information Systems LO, Zhiwen Joseph MAK, Malcolm Han Wen LIANG, Shanying CHAN, Yam Meng GOH, Cheng Cheng LAI, Tina Peiting TAN, Audrey Hui Min THNG, Patrick THNG, Patrick WEYDE, Tillman SMIT, Sylvia Development of an explainable artificial intelligence model for Asian vascular wound images |
description |
Chronic wounds contribute to significant healthcare and economic burden worldwide. Wound assessment remains challenging given its complex and dynamic nature. The use of artificial intelligence (AI) and machine learning methods in wound analysis is promising. Explainable modelling can help its integration and acceptance in healthcare systems. We aim to develop an explainable AI model for analysing vascular wound images among an Asian population. Two thousand nine hundred and fifty-seven wound images from a vascular wound image registry from a tertiary institution in Singapore were utilized. The dataset was split into training, validation and test sets. Wound images were classified into four types (neuroischaemic ulcer [NIU], surgical site infections [SSI], venous leg ulcers [VLU], pressure ulcer [PU]), measured with automatic estimation of width, length and depth and segmented into 18 wound and peri-wound features. Data pre-processing was performed using oversampling and augmentation techniques. Convolutional and deep learning models were utilized for model development. The model was evaluated with accuracy, F1 score and receiver operating characteristic (ROC) curves. Explainability methods were used to interpret AI decision reasoning. A web browser application was developed to demonstrate results of the wound AI model with explainability. After development, the model was tested on additional 15 476 unlabelled images to evaluate effectiveness. After the development on the training and validation dataset, the model performance on unseen labelled images in the test set achieved an AUROC of 0.99 for wound classification with mean accuracy of 95.9%. For wound measurements, the model achieved AUROC of 0.97 with mean accuracy of 85.0% for depth classification, and AUROC of 0.92 with mean accuracy of 87.1% for width and length determination. For wound segmentation, an AUROC of 0.95 and mean accuracy of 87.8% was achieved. Testing on unlabelled images, the model confidence score for wound classification was 82.8% with an explainability score of 60.6%. Confidence score was 87.6% for depth classification with 68.0% explainability score, while width and length measurement obtained 93.0% accuracy score with 76.6% explainability. Confidence score for wound segmentation was 83.9%, while explainability was 72.1%. Using explainable AI models, we have developed an algorithm and application for analysis of vascular wound images from an Asian population with accuracy and explainability. With further development, it can be utilized as a clinical decision support system and integrated into existing healthcare electronic systems. |
format |
text |
author |
LO, Zhiwen Joseph MAK, Malcolm Han Wen LIANG, Shanying CHAN, Yam Meng GOH, Cheng Cheng LAI, Tina Peiting TAN, Audrey Hui Min THNG, Patrick THNG, Patrick WEYDE, Tillman SMIT, Sylvia |
author_facet |
LO, Zhiwen Joseph MAK, Malcolm Han Wen LIANG, Shanying CHAN, Yam Meng GOH, Cheng Cheng LAI, Tina Peiting TAN, Audrey Hui Min THNG, Patrick THNG, Patrick WEYDE, Tillman SMIT, Sylvia |
author_sort |
LO, Zhiwen Joseph |
title |
Development of an explainable artificial intelligence model for Asian vascular wound images |
title_short |
Development of an explainable artificial intelligence model for Asian vascular wound images |
title_full |
Development of an explainable artificial intelligence model for Asian vascular wound images |
title_fullStr |
Development of an explainable artificial intelligence model for Asian vascular wound images |
title_full_unstemmed |
Development of an explainable artificial intelligence model for Asian vascular wound images |
title_sort |
development of an explainable artificial intelligence model for asian vascular wound images |
publisher |
Institutional Knowledge at Singapore Management University |
publishDate |
2023 |
url |
https://ink.library.smu.edu.sg/sis_research/8546 https://ink.library.smu.edu.sg/context/sis_research/article/9549/viewcontent/International_Wound_Journal___2023___Lo___Development_of_an_explainable_artificial_intelligence_model_for_Asian_vascular.pdf |
_version_ |
1789483262613127168 |