Further studies of extreme learning machine and compressed signal detection

In this thesis, we present further studies of extreme learning machine and signal detection in compressed sensing. In Chapter 1, we give literature reviews of extreme learning machine (ELM) and compressed sensing (CS). In part I of the thesis (Chapters 2, 3, and 4), we consider the recent ELM for tr...

Full description

Saved in:
Bibliographic Details
Main Author: Cao, Jiuwen
Other Authors: Huang Guangbin
Format: Theses and Dissertations
Language:English
Published: 2013
Subjects:
Online Access:https://hdl.handle.net/10356/53458
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-53458
record_format dspace
spelling sg-ntu-dr.10356-534582023-07-04T15:11:37Z Further studies of extreme learning machine and compressed signal detection Cao, Jiuwen Huang Guangbin Lin Zhiping School of Electrical and Electronic Engineering Centre for Signal Processing DRNTU::Engineering::Electrical and electronic engineering In this thesis, we present further studies of extreme learning machine and signal detection in compressed sensing. In Chapter 1, we give literature reviews of extreme learning machine (ELM) and compressed sensing (CS). In part I of the thesis (Chapters 2, 3, and 4), we consider the recent ELM for training neural networks and present several improved algorithms. We first propose a composite function wavelet neural network (WNN) learning with the recent ELM algorithm in Chapter 2. The main contributions of the proposed WNN comparing with traditional ones are using composite functions at the hidden nodes and applying ELM algorithm to WNN as a learning algorithm. To reduce the network size and optimize the hidden node parameters, we then introduce an improvement method for training the proposed WNN by incorporating the global optimization algorithm Differential Evolution into searching for the optimal network input weights and the dilation and translation values in Chapter 3. To further enhance the classification rate of the ELM, we propose an improved algorithm named voting based ELM (V-ELM) for signal classification in Chapter 4. In V-ELM, the voting method is incorporated into the ELM in classification applications. Several individual ELMs with the same network structure are trained with the same dataset and the final class label of a test sample is determined by majority voting method on all the results obtained by these independent ELMs. Numerical simulations are provided to illustrate the efficiency of our proposed methods. In part II of the thesis (Chapters 5 and 6), we study the signal detection in CS. We first consider the theoretical bound of the probability of error by detecting the signal reconstructed in CS with the Bayesian approach in Chapter 5. Utilizing the oracle estimator in CS, we provide a theoretical bound of the probability of error when the noise in CS is white Gaussian noise. We then consider the Bayesian approach to signal detection in CS using compressed measurements directly in Chapter 6. We start by revisiting the classical signal detection problem and show that with an additive Gaussian noise, the probability of error for unequal prior probabilities of the hypotheses is always smaller than the one with equal prior probability. We then consider signal detection with compressed measurements directly, assuming that the additive noise is Gaussian but with unequal variances. A general expression is obtained for the probability of error where the prior probabilities could be equal or unequal. We have also derived performance bounds for the probability of error using the restricted isometry property constant and then the computationally more feasible mutual coherence of a given sampling matrix in CS. An approximate but simpler expression of the probability of error and its approximate upper bound are also obtained. % the measurement domain which is easier to calculate than computing the Numerical simulations are given to verify the new theoretical results. In Chapter 7, conclusions and future work are provided. DOCTOR OF PHILOSOPHY (EEE) 2013-06-04T02:45:58Z 2013-06-04T02:45:58Z 2013 2013 Thesis Cao, J. (2013). Further studies of extreme learning machine and compressed signal detection. Doctoral thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/53458 10.32657/10356/53458 en 189 p. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic DRNTU::Engineering::Electrical and electronic engineering
spellingShingle DRNTU::Engineering::Electrical and electronic engineering
Cao, Jiuwen
Further studies of extreme learning machine and compressed signal detection
description In this thesis, we present further studies of extreme learning machine and signal detection in compressed sensing. In Chapter 1, we give literature reviews of extreme learning machine (ELM) and compressed sensing (CS). In part I of the thesis (Chapters 2, 3, and 4), we consider the recent ELM for training neural networks and present several improved algorithms. We first propose a composite function wavelet neural network (WNN) learning with the recent ELM algorithm in Chapter 2. The main contributions of the proposed WNN comparing with traditional ones are using composite functions at the hidden nodes and applying ELM algorithm to WNN as a learning algorithm. To reduce the network size and optimize the hidden node parameters, we then introduce an improvement method for training the proposed WNN by incorporating the global optimization algorithm Differential Evolution into searching for the optimal network input weights and the dilation and translation values in Chapter 3. To further enhance the classification rate of the ELM, we propose an improved algorithm named voting based ELM (V-ELM) for signal classification in Chapter 4. In V-ELM, the voting method is incorporated into the ELM in classification applications. Several individual ELMs with the same network structure are trained with the same dataset and the final class label of a test sample is determined by majority voting method on all the results obtained by these independent ELMs. Numerical simulations are provided to illustrate the efficiency of our proposed methods. In part II of the thesis (Chapters 5 and 6), we study the signal detection in CS. We first consider the theoretical bound of the probability of error by detecting the signal reconstructed in CS with the Bayesian approach in Chapter 5. Utilizing the oracle estimator in CS, we provide a theoretical bound of the probability of error when the noise in CS is white Gaussian noise. We then consider the Bayesian approach to signal detection in CS using compressed measurements directly in Chapter 6. We start by revisiting the classical signal detection problem and show that with an additive Gaussian noise, the probability of error for unequal prior probabilities of the hypotheses is always smaller than the one with equal prior probability. We then consider signal detection with compressed measurements directly, assuming that the additive noise is Gaussian but with unequal variances. A general expression is obtained for the probability of error where the prior probabilities could be equal or unequal. We have also derived performance bounds for the probability of error using the restricted isometry property constant and then the computationally more feasible mutual coherence of a given sampling matrix in CS. An approximate but simpler expression of the probability of error and its approximate upper bound are also obtained. % the measurement domain which is easier to calculate than computing the Numerical simulations are given to verify the new theoretical results. In Chapter 7, conclusions and future work are provided.
author2 Huang Guangbin
author_facet Huang Guangbin
Cao, Jiuwen
format Theses and Dissertations
author Cao, Jiuwen
author_sort Cao, Jiuwen
title Further studies of extreme learning machine and compressed signal detection
title_short Further studies of extreme learning machine and compressed signal detection
title_full Further studies of extreme learning machine and compressed signal detection
title_fullStr Further studies of extreme learning machine and compressed signal detection
title_full_unstemmed Further studies of extreme learning machine and compressed signal detection
title_sort further studies of extreme learning machine and compressed signal detection
publishDate 2013
url https://hdl.handle.net/10356/53458
_version_ 1772828598852386816