Investigation of meta-heuristics algorithms in ANN streamflow forecasting

The deterministic approach, which utilizes the gradient information in the search process, is prone to trapping at local minima, primarily due to the presence of saddle points and local minima in the non-convex objective function of an artificial neural network (ANN). This study investigated the eff...

Full description

Saved in:
Bibliographic Details
Main Authors: Wei, Yaxing, Hashim, Huzaifa, Chong, K. L., Huang, Y. F., Ahmed, Ali Najah, El-Shafie, Ahmed
Format: Article
Published: Korean Society of Civil Engineers-KSCE 2023
Subjects:
Online Access:http://eprints.um.edu.my/38316/
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Universiti Malaya
id my.um.eprints.38316
record_format eprints
spelling my.um.eprints.383162024-06-12T02:08:12Z http://eprints.um.edu.my/38316/ Investigation of meta-heuristics algorithms in ANN streamflow forecasting Wei, Yaxing Hashim, Huzaifa Chong, K. L. Huang, Y. F. Ahmed, Ali Najah El-Shafie, Ahmed TA Engineering (General). Civil engineering (General) The deterministic approach, which utilizes the gradient information in the search process, is prone to trapping at local minima, primarily due to the presence of saddle points and local minima in the non-convex objective function of an artificial neural network (ANN). This study investigated the efficacy of a hybrid model that adopted a meta-heuristic algorithm (MHA) as an optimizer to extend the training ANN method, from a gradient-based to a stochastic population-based approach for streamflow forecasting. In the latter, parameter tuning utilizing the design of experiment (DOE) technique, has become an integral element in the optimization process due to reliance on their parameters. For model convenience, a wavelet transform was employed to decompose the series into sub-series. The empirical studies of MHA performance showed that the hybrid MHA-ANN was superior for streamflow forecasting, especially with the firefly algorithm that had an average RMSE = 96.06, an improvement of approximately 17% over the gradient-based ANN (RMSE = 113.92). However, among the adopted MHAs, not all are compatible with optimizing the ANN for streamflow forecasting, thus requiring a thorough study as performance varies from case to case. Two additional statistical tests, such as the Kruskal-Wallis H test and the Mann-Whitney U test, further validated such disparity in the MHA's performance. Korean Society of Civil Engineers-KSCE 2023-05 Article PeerReviewed Wei, Yaxing and Hashim, Huzaifa and Chong, K. L. and Huang, Y. F. and Ahmed, Ali Najah and El-Shafie, Ahmed (2023) Investigation of meta-heuristics algorithms in ANN streamflow forecasting. KSCE Journal of Civil Engineering, 27 (5). pp. 2297-2312. ISSN 1226-7988, DOI https://doi.org/10.1007/s12205-023-0821-6 <https://doi.org/10.1007/s12205-023-0821-6>. 10.1007/s12205-023-0821-6
institution Universiti Malaya
building UM Library
collection Institutional Repository
continent Asia
country Malaysia
content_provider Universiti Malaya
content_source UM Research Repository
url_provider http://eprints.um.edu.my/
topic TA Engineering (General). Civil engineering (General)
spellingShingle TA Engineering (General). Civil engineering (General)
Wei, Yaxing
Hashim, Huzaifa
Chong, K. L.
Huang, Y. F.
Ahmed, Ali Najah
El-Shafie, Ahmed
Investigation of meta-heuristics algorithms in ANN streamflow forecasting
description The deterministic approach, which utilizes the gradient information in the search process, is prone to trapping at local minima, primarily due to the presence of saddle points and local minima in the non-convex objective function of an artificial neural network (ANN). This study investigated the efficacy of a hybrid model that adopted a meta-heuristic algorithm (MHA) as an optimizer to extend the training ANN method, from a gradient-based to a stochastic population-based approach for streamflow forecasting. In the latter, parameter tuning utilizing the design of experiment (DOE) technique, has become an integral element in the optimization process due to reliance on their parameters. For model convenience, a wavelet transform was employed to decompose the series into sub-series. The empirical studies of MHA performance showed that the hybrid MHA-ANN was superior for streamflow forecasting, especially with the firefly algorithm that had an average RMSE = 96.06, an improvement of approximately 17% over the gradient-based ANN (RMSE = 113.92). However, among the adopted MHAs, not all are compatible with optimizing the ANN for streamflow forecasting, thus requiring a thorough study as performance varies from case to case. Two additional statistical tests, such as the Kruskal-Wallis H test and the Mann-Whitney U test, further validated such disparity in the MHA's performance.
format Article
author Wei, Yaxing
Hashim, Huzaifa
Chong, K. L.
Huang, Y. F.
Ahmed, Ali Najah
El-Shafie, Ahmed
author_facet Wei, Yaxing
Hashim, Huzaifa
Chong, K. L.
Huang, Y. F.
Ahmed, Ali Najah
El-Shafie, Ahmed
author_sort Wei, Yaxing
title Investigation of meta-heuristics algorithms in ANN streamflow forecasting
title_short Investigation of meta-heuristics algorithms in ANN streamflow forecasting
title_full Investigation of meta-heuristics algorithms in ANN streamflow forecasting
title_fullStr Investigation of meta-heuristics algorithms in ANN streamflow forecasting
title_full_unstemmed Investigation of meta-heuristics algorithms in ANN streamflow forecasting
title_sort investigation of meta-heuristics algorithms in ann streamflow forecasting
publisher Korean Society of Civil Engineers-KSCE
publishDate 2023
url http://eprints.um.edu.my/38316/
_version_ 1805881104983392256