Online neuro-fuzzy models for real time flow forecasting

Forecasting with limited data or sparse data are two main challenges needed to be addressed. Data should be representative of the system under consideration when forecasting with traditional neuro-fuzzy models (NFMs); the condition which is not met in case of forecasting with limited data. Also trad...

Full description

Saved in:
Bibliographic Details
Main Author: Mohammad Ashrafi
Other Authors: Qin Xiaosheng
Format: Theses and Dissertations
Language:English
Published: 2017
Subjects:
Online Access:http://hdl.handle.net/10356/69917
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-69917
record_format dspace
spelling sg-ntu-dr.10356-699172023-03-03T19:16:59Z Online neuro-fuzzy models for real time flow forecasting Mohammad Ashrafi Qin Xiaosheng School of Civil and Environmental Engineering DRNTU::Engineering::Civil engineering Forecasting with limited data or sparse data are two main challenges needed to be addressed. Data should be representative of the system under consideration when forecasting with traditional neuro-fuzzy models (NFMs); the condition which is not met in case of forecasting with limited data. Also traditional NFMs cannot handle sparse rule base; the condition which is not suitable for modeling the low-frequency events. Generic Self-Evolving Takagi-Sugeno-Kang or GSETSK is a state-of-the-art NFM with specific capabilities due to its specific clustering, rule pruning and optimization mechanisms. The fully online property allows the model to be used independent of historical data. Also its dynamic expanding-shrinking structure makes its rule base dynamic, compact, up-to-date and interpretable. GSETSK was run fully-online form the 1st sample onwards for two real time hydrologic forecasting problems in this study. The two commonly encountered problems; rainfall-runoff and flow routing modeling represent different modelling complexities. The data used belongs to two totally different datasets including a catchment in Sweden and Lower Mekong River in South-east Asia. In this research firstly the capability of GSETSK in forecasting with large datasets were critically examined. GSETSK was evaluated against traditional NFMs including the local NFM, DENFIS (Dynamic Evolving Neural-Fuzzy Inference System) and global NFM, ANFIS (Adaptive-Network-Based Fuzzy Inference System). Also the rule base dynamics of GSETSK were evaluated in relation to the complexity of the problem. Secondly the fully-online property of GSETSK was examined in forecasting with limited data e.g. forecasting in basins with limited data. Eventually for handling the sparse data, the Fuzzy Interpolative-Extrapolative Reasoning (FIER) was developed and imbedded in GSETSK. The overall findings of this research are as follows. i) In case of large datasets, GSETSK was able to provide comparable results to traditional NFMs, ANFIS and DENFIS. However GSETSK does not need any knowledge of data upper/lower bound plus that its rule base was more compact, up-to-date and interpretable comparing to DENFIS. Also GSETSK needs less training data and time compared to ANFIS. GSETSK was found to be more suited for the complex problem of rainfall-runoff forecasting comparing to river routing problem. ii) In case of limited data, e.g. forecasting in basins with limited data, GSETSK was found to be a good candidate. In addition it provided a compact, up-to-date rule base which was easily interpretable and could be related to the physical process under consideration. iii) The sparse data was handled by proposed FIER algorithm. The new model, FIER-GSETSK appeared to model the infrequent events better than GSETSK when evaluated based on threshold-based indices. In all experiments, the results of GSETSK were comparable to the physically-based models currently in use for each dataset. The two datasets used in this study are representative of rainfall-runoff and river routing problem. Extensive datasets should be used in other researches in future and also other hydrologic applications to examine its generalization ability. Also boosting the model with online input selection and online optimization of the clusters are recommended as the future research direction. Doctor of Philosophy (CEE) 2017-03-31T03:50:04Z 2017-03-31T03:50:04Z 2017 Thesis Mohammad Ashrafi. (2017). Online neuro-fuzzy models for real time flow forecasting. Doctoral thesis, Nanyang Technological University, Singapore. http://hdl.handle.net/10356/69917 10.32657/10356/69917 en 147 p. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic DRNTU::Engineering::Civil engineering
spellingShingle DRNTU::Engineering::Civil engineering
Mohammad Ashrafi
Online neuro-fuzzy models for real time flow forecasting
description Forecasting with limited data or sparse data are two main challenges needed to be addressed. Data should be representative of the system under consideration when forecasting with traditional neuro-fuzzy models (NFMs); the condition which is not met in case of forecasting with limited data. Also traditional NFMs cannot handle sparse rule base; the condition which is not suitable for modeling the low-frequency events. Generic Self-Evolving Takagi-Sugeno-Kang or GSETSK is a state-of-the-art NFM with specific capabilities due to its specific clustering, rule pruning and optimization mechanisms. The fully online property allows the model to be used independent of historical data. Also its dynamic expanding-shrinking structure makes its rule base dynamic, compact, up-to-date and interpretable. GSETSK was run fully-online form the 1st sample onwards for two real time hydrologic forecasting problems in this study. The two commonly encountered problems; rainfall-runoff and flow routing modeling represent different modelling complexities. The data used belongs to two totally different datasets including a catchment in Sweden and Lower Mekong River in South-east Asia. In this research firstly the capability of GSETSK in forecasting with large datasets were critically examined. GSETSK was evaluated against traditional NFMs including the local NFM, DENFIS (Dynamic Evolving Neural-Fuzzy Inference System) and global NFM, ANFIS (Adaptive-Network-Based Fuzzy Inference System). Also the rule base dynamics of GSETSK were evaluated in relation to the complexity of the problem. Secondly the fully-online property of GSETSK was examined in forecasting with limited data e.g. forecasting in basins with limited data. Eventually for handling the sparse data, the Fuzzy Interpolative-Extrapolative Reasoning (FIER) was developed and imbedded in GSETSK. The overall findings of this research are as follows. i) In case of large datasets, GSETSK was able to provide comparable results to traditional NFMs, ANFIS and DENFIS. However GSETSK does not need any knowledge of data upper/lower bound plus that its rule base was more compact, up-to-date and interpretable comparing to DENFIS. Also GSETSK needs less training data and time compared to ANFIS. GSETSK was found to be more suited for the complex problem of rainfall-runoff forecasting comparing to river routing problem. ii) In case of limited data, e.g. forecasting in basins with limited data, GSETSK was found to be a good candidate. In addition it provided a compact, up-to-date rule base which was easily interpretable and could be related to the physical process under consideration. iii) The sparse data was handled by proposed FIER algorithm. The new model, FIER-GSETSK appeared to model the infrequent events better than GSETSK when evaluated based on threshold-based indices. In all experiments, the results of GSETSK were comparable to the physically-based models currently in use for each dataset. The two datasets used in this study are representative of rainfall-runoff and river routing problem. Extensive datasets should be used in other researches in future and also other hydrologic applications to examine its generalization ability. Also boosting the model with online input selection and online optimization of the clusters are recommended as the future research direction.
author2 Qin Xiaosheng
author_facet Qin Xiaosheng
Mohammad Ashrafi
format Theses and Dissertations
author Mohammad Ashrafi
author_sort Mohammad Ashrafi
title Online neuro-fuzzy models for real time flow forecasting
title_short Online neuro-fuzzy models for real time flow forecasting
title_full Online neuro-fuzzy models for real time flow forecasting
title_fullStr Online neuro-fuzzy models for real time flow forecasting
title_full_unstemmed Online neuro-fuzzy models for real time flow forecasting
title_sort online neuro-fuzzy models for real time flow forecasting
publishDate 2017
url http://hdl.handle.net/10356/69917
_version_ 1759854751492603904