Medical image segmentation based on deep feature learning and multistage classification

Automatic segmentation of target organs in medical image plays a crucial role in the computer-aided diagnosis of human diseases, like retinal vessel from fundus image, and melanoma from dermoscopic image. Manual segmentation of those tissues is a time-consuming and labor-intensive task that is not f...

Full description

Saved in:
Bibliographic Details
Main Author: Wang, Xiaohong
Other Authors: Jiang Xudong
Format: Thesis-Doctor of Philosophy
Language:English
Published: Nanyang Technological University 2020
Subjects:
Online Access:https://hdl.handle.net/10356/137579
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-137579
record_format dspace
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Electrical and electronic engineering
spellingShingle Engineering::Electrical and electronic engineering
Wang, Xiaohong
Medical image segmentation based on deep feature learning and multistage classification
description Automatic segmentation of target organs in medical image plays a crucial role in the computer-aided diagnosis of human diseases, like retinal vessel from fundus image, and melanoma from dermoscopic image. Manual segmentation of those tissues is a time-consuming and labor-intensive task that is not feasible for clinicians to annotate a large amount of medical images by hand. Thus, a reliable medical image segmentation system with lower cost and less human interaction than the observation-based techniques is attractive in the field of medical image analysis. This thesis investigates medical image segmentation architectures through deep feature learning and multistage classification. Specifically, we proposed two novel multistage classification schemes for retinal vessel segmentation. For more complex and large dermoscopic image data analysis issue, we proposed a novel deep feature learning scheme for skin lesion segmentation. Details of the completed works are summarized as follows: In the first scheme, a novel and robust retinal vessel segmentation framework is proposed, which envelops a set of computationally efficient Mahalanobis distance classifiers to form a highly nonlinear decision. Different from other nonlinear classifiers that need a predefined nonlinear kernel or an iterative training, the proposed cascade classification framework is trained by a one-pass feedforward process. Thus, the degree of nonlinearity of the proposed classifier is not predefined, but determined by the complexity of the data structure. Experimental evaluations on three publicly available datasets show that the proposed cascade classification framework achieves high vessel segmentation accuracy consistently on all three diverse datasets. In the second scheme, a hierarchical architecture for retinal vessel segmentation based on a divide-and-conquer strategy is designed. Current works for retinal vessel segmentation typically train a global discriminative model for retinal vessel classification that is still not sufficient to fit the complex pattern of vessel structure. In fact, the large geometrical structure difference among retinal vessels with different scales and positions greatly limits the precision of the decision boundary of the global discriminative model. To overcome this problem, an efficient dividing algorithm, named multiplex vessel partition (MVP), is proposed to divide the retinal vessel into well constrained subsets where vessel samples with the same geometrical property are assigned together. Then, a set of homogeneous classifiers are trained in parallel to form discriminative decision for each subset. Moreover, a funnel-structured vessel segmentation (FsVS) framework is proposed to link the classification results from each disjoint subset. It reduces the probability of poor partition at the dividing phase and further enhances the discriminative capability of the decision model. Both quantitative and qualitative experimental comparisons on three publicly datasets demonstrate the flexibility and efficiency of the proposed work on retinal vessel segmentation. In the last scheme, a bi-directional feature dermoscopic learning framework with multiscale consistent decision fusion is proposed for skin lesion segmentation. Previously published skin lesion segmentation works enhance lesion detection performance by using deep learning based methods like fully convolutional network (FCN). Nevertheless, relationship between skin lesions and their informative context, as well as the consistency of the decision from multiple classification layers, have not yet been well explored by these previous studies. Different from the naive way of FCN learning an abstract feature representation of image, this thesis proposes a bi-directional dermoscopic feature learning (biDFL) framework that produces rich dermoscopic feature maps by controlling information propagation from two complementary directions at high level parsing layer. With the integration of bi-directional feature information passing, the proposed biDFL module gives better insight to the network about the complex structure of the skin lesion. Furthermore, this thesis proposes a multiscale consistent decision fusion (mCDF) that is capable of selectively focusing on the informative decisions generated from multiple classification layers. By analysis of the consistency of the decision at each position, mCDF automatically adjusts the reliability of decisions and thus allows a more insightful skin lesion delineation. With the embedding of consistency analysis to the decisions from each classification layer, the proposed mCDF assists the network to learn better about which scales of features are more desirable for each pixel. The comprehensive experimental results show the effectiveness of the proposed method on skin lesion segmentation, achieving state-of-the-art performance consistently on two publicly available dermoscopic image datasets.
author2 Jiang Xudong
author_facet Jiang Xudong
Wang, Xiaohong
format Thesis-Doctor of Philosophy
author Wang, Xiaohong
author_sort Wang, Xiaohong
title Medical image segmentation based on deep feature learning and multistage classification
title_short Medical image segmentation based on deep feature learning and multistage classification
title_full Medical image segmentation based on deep feature learning and multistage classification
title_fullStr Medical image segmentation based on deep feature learning and multistage classification
title_full_unstemmed Medical image segmentation based on deep feature learning and multistage classification
title_sort medical image segmentation based on deep feature learning and multistage classification
publisher Nanyang Technological University
publishDate 2020
url https://hdl.handle.net/10356/137579
_version_ 1772827379552485376
spelling sg-ntu-dr.10356-1375792023-07-04T17:22:42Z Medical image segmentation based on deep feature learning and multistage classification Wang, Xiaohong Jiang Xudong School of Electrical and Electronic Engineering exdjiang@ntu.edu.sg Engineering::Electrical and electronic engineering Automatic segmentation of target organs in medical image plays a crucial role in the computer-aided diagnosis of human diseases, like retinal vessel from fundus image, and melanoma from dermoscopic image. Manual segmentation of those tissues is a time-consuming and labor-intensive task that is not feasible for clinicians to annotate a large amount of medical images by hand. Thus, a reliable medical image segmentation system with lower cost and less human interaction than the observation-based techniques is attractive in the field of medical image analysis. This thesis investigates medical image segmentation architectures through deep feature learning and multistage classification. Specifically, we proposed two novel multistage classification schemes for retinal vessel segmentation. For more complex and large dermoscopic image data analysis issue, we proposed a novel deep feature learning scheme for skin lesion segmentation. Details of the completed works are summarized as follows: In the first scheme, a novel and robust retinal vessel segmentation framework is proposed, which envelops a set of computationally efficient Mahalanobis distance classifiers to form a highly nonlinear decision. Different from other nonlinear classifiers that need a predefined nonlinear kernel or an iterative training, the proposed cascade classification framework is trained by a one-pass feedforward process. Thus, the degree of nonlinearity of the proposed classifier is not predefined, but determined by the complexity of the data structure. Experimental evaluations on three publicly available datasets show that the proposed cascade classification framework achieves high vessel segmentation accuracy consistently on all three diverse datasets. In the second scheme, a hierarchical architecture for retinal vessel segmentation based on a divide-and-conquer strategy is designed. Current works for retinal vessel segmentation typically train a global discriminative model for retinal vessel classification that is still not sufficient to fit the complex pattern of vessel structure. In fact, the large geometrical structure difference among retinal vessels with different scales and positions greatly limits the precision of the decision boundary of the global discriminative model. To overcome this problem, an efficient dividing algorithm, named multiplex vessel partition (MVP), is proposed to divide the retinal vessel into well constrained subsets where vessel samples with the same geometrical property are assigned together. Then, a set of homogeneous classifiers are trained in parallel to form discriminative decision for each subset. Moreover, a funnel-structured vessel segmentation (FsVS) framework is proposed to link the classification results from each disjoint subset. It reduces the probability of poor partition at the dividing phase and further enhances the discriminative capability of the decision model. Both quantitative and qualitative experimental comparisons on three publicly datasets demonstrate the flexibility and efficiency of the proposed work on retinal vessel segmentation. In the last scheme, a bi-directional feature dermoscopic learning framework with multiscale consistent decision fusion is proposed for skin lesion segmentation. Previously published skin lesion segmentation works enhance lesion detection performance by using deep learning based methods like fully convolutional network (FCN). Nevertheless, relationship between skin lesions and their informative context, as well as the consistency of the decision from multiple classification layers, have not yet been well explored by these previous studies. Different from the naive way of FCN learning an abstract feature representation of image, this thesis proposes a bi-directional dermoscopic feature learning (biDFL) framework that produces rich dermoscopic feature maps by controlling information propagation from two complementary directions at high level parsing layer. With the integration of bi-directional feature information passing, the proposed biDFL module gives better insight to the network about the complex structure of the skin lesion. Furthermore, this thesis proposes a multiscale consistent decision fusion (mCDF) that is capable of selectively focusing on the informative decisions generated from multiple classification layers. By analysis of the consistency of the decision at each position, mCDF automatically adjusts the reliability of decisions and thus allows a more insightful skin lesion delineation. With the embedding of consistency analysis to the decisions from each classification layer, the proposed mCDF assists the network to learn better about which scales of features are more desirable for each pixel. The comprehensive experimental results show the effectiveness of the proposed method on skin lesion segmentation, achieving state-of-the-art performance consistently on two publicly available dermoscopic image datasets. Doctor of Philosophy 2020-04-03T02:19:15Z 2020-04-03T02:19:15Z 2020 Thesis-Doctor of Philosophy Wang, X. (2020). Medical image segmentation based on deep feature learning and multistage classification. Doctoral thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/137579 10.32657/10356/137579 en This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0). application/pdf Nanyang Technological University