Investigation of Meta-heuristics Algorithms in ANN Streamflow Forecasting

• Main Authors: Wei Y., Hashim H., Chong K.L., Huang Y.F., Ahmed A.N., El-Shafie A.
• Other Authors: 58169750800
• Format: Article
• Published: Korean Society of Civil Engineers 2024
• Subjects: Machine learning; Meta-heuristic algorithms; Optimization; Statistical tests; Time series forecasting; Wavelet transform; Design of experiments; Forecasting; Heuristic algorithms; Heuristic methods; Neural networks; Statistics; Stochastic models; Stochastic systems; Stream flow; Wavelet transforms; Deterministic approach; Gradient based; Local minimums; Machine-learning; Meta-heuristics algorithms; Optimisations; Performance; Streamflow forecasting; Wavelets transform
• Institution: Universiti Tenaga Nasional

The deterministic approach, which utilizes the gradient information in the search process, is prone to trapping at local minima, primarily due to the presence of saddle points and local minima in the non-convex objective function of an artificial neural network (ANN). This study investigated the efficacy of a hybrid model that adopted a meta-heuristic algorithm (MHA) as an optimizer to extend the training ANN method, from a gradient-based to a stochastic population-based approach for streamflow forecasting. In the latter, parameter tuning utilizing the design of experiment (DOE) technique, has become an integral element in the optimization process due to reliance on their parameters. For model convenience, a wavelet transform was employed to decompose the series into sub-series. The empirical studies of MHA performance showed that the hybrid MHA-ANN was superior for streamflow forecasting, especially with the firefly algorithm that had an average RMSE = 96.06, an improvement of approximately 17% over the gradient-based ANN (RMSE = 113.92). However, among the adopted MHAs, not all are compatible with optimizing the ANN for streamflow forecasting, thus requiring a thorough study as performance varies from case to case. Two additional statistical tests, such as the Kruskal-Wallis H test and the Mann-Whitney U test, further validated such disparity in the MHA�s performance. � 2023, Korean Society of Civil Engineers.