Covariance matrix adaptation evolution strategy for improving machine learning approaches in streamflow prediction

Precise streamflow estimation plays a key role in optimal water resource use, reservoirs operations, and designing and planning future hydropower projects. Machine learning models were successfully utilized to estimate streamflow in recent years In this study, a new approach, covariance matrix adapt...

Full description

Saved in:
Bibliographic Details
Main Authors: Ikram, Rana Muhammad Adnan, Goliatt, Leonardo, Kisi, Ozgur, Trajkovic, Slavisa, Shahid, Shamsuddin
Format: Article
Language:English
Published: MDPI 2022
Subjects:
Online Access:http://eprints.utm.my/103107/1/ShamsuddinShahid2022_CovarianceMatrixAdaptationEvolution.pdf
http://eprints.utm.my/103107/
http://dx.doi.org/10.3390/math10162971
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Universiti Teknologi Malaysia
Language: English
id my.utm.103107
record_format eprints
spelling my.utm.1031072023-10-17T00:48:56Z http://eprints.utm.my/103107/ Covariance matrix adaptation evolution strategy for improving machine learning approaches in streamflow prediction Ikram, Rana Muhammad Adnan Goliatt, Leonardo Kisi, Ozgur Trajkovic, Slavisa Shahid, Shamsuddin TA Engineering (General). Civil engineering (General) Precise streamflow estimation plays a key role in optimal water resource use, reservoirs operations, and designing and planning future hydropower projects. Machine learning models were successfully utilized to estimate streamflow in recent years In this study, a new approach, covariance matrix adaptation evolution strategy (CMAES), was utilized to improve the accuracy of seven machine learning models, namely extreme learning machine (ELM), elastic net (EN), Gaussian processes regression (GPR), support vector regression (SVR), least square SVR (LSSVR), extreme gradient boosting (XGB), and radial basis function neural network (RBFNN), in predicting streamflow. The CMAES was used for proper tuning of control parameters of these selected machine learning models. Seven input combinations were decided to estimate streamflow based on previous lagged temperature and streamflow data values. For numerical prediction accuracy comparison of these machine learning models, six statistical indexes are used, i.e., relative root mean squared error (RRMSE), mean absolute error (MAE), mean absolute percentage error (MAPE), Nash–Sutcliffe efficiency (NSE), and the Kling–Gupta efficiency agreement index (KGE). In contrast, this study uses scatter plots, radar charts, and Taylor diagrams for graphically predicted accuracy comparison. Results show that SVR provided more accurate results than the other methods, especially for the temperature input cases. In contrast, in some streamflow input cases, the LSSVR and GPR were better than the SVR. The SVR tuned by CMAES with temperature and streamflow inputs produced the least RRMSE (0.266), MAE (263.44), and MAPE (12.44) in streamflow estimation. The EN method was found to be the worst model in streamflow prediction. Uncertainty analysis also endorsed the superiority of the SVR over other machine learning methods by having low uncertainty values. Overall, the SVR model based on either temperature or streamflow as inputs, tuned by CMAES, is highly recommended for streamflow estimation. MDPI 2022-08 Article PeerReviewed application/pdf en http://eprints.utm.my/103107/1/ShamsuddinShahid2022_CovarianceMatrixAdaptationEvolution.pdf Ikram, Rana Muhammad Adnan and Goliatt, Leonardo and Kisi, Ozgur and Trajkovic, Slavisa and Shahid, Shamsuddin (2022) Covariance matrix adaptation evolution strategy for improving machine learning approaches in streamflow prediction. Mathematics, 10 (16). pp. 1-30. ISSN 2227-7390 http://dx.doi.org/10.3390/math10162971 DOI:10.3390/math10162971
institution Universiti Teknologi Malaysia
building UTM Library
collection Institutional Repository
continent Asia
country Malaysia
content_provider Universiti Teknologi Malaysia
content_source UTM Institutional Repository
url_provider http://eprints.utm.my/
language English
topic TA Engineering (General). Civil engineering (General)
spellingShingle TA Engineering (General). Civil engineering (General)
Ikram, Rana Muhammad Adnan
Goliatt, Leonardo
Kisi, Ozgur
Trajkovic, Slavisa
Shahid, Shamsuddin
Covariance matrix adaptation evolution strategy for improving machine learning approaches in streamflow prediction
description Precise streamflow estimation plays a key role in optimal water resource use, reservoirs operations, and designing and planning future hydropower projects. Machine learning models were successfully utilized to estimate streamflow in recent years In this study, a new approach, covariance matrix adaptation evolution strategy (CMAES), was utilized to improve the accuracy of seven machine learning models, namely extreme learning machine (ELM), elastic net (EN), Gaussian processes regression (GPR), support vector regression (SVR), least square SVR (LSSVR), extreme gradient boosting (XGB), and radial basis function neural network (RBFNN), in predicting streamflow. The CMAES was used for proper tuning of control parameters of these selected machine learning models. Seven input combinations were decided to estimate streamflow based on previous lagged temperature and streamflow data values. For numerical prediction accuracy comparison of these machine learning models, six statistical indexes are used, i.e., relative root mean squared error (RRMSE), mean absolute error (MAE), mean absolute percentage error (MAPE), Nash–Sutcliffe efficiency (NSE), and the Kling–Gupta efficiency agreement index (KGE). In contrast, this study uses scatter plots, radar charts, and Taylor diagrams for graphically predicted accuracy comparison. Results show that SVR provided more accurate results than the other methods, especially for the temperature input cases. In contrast, in some streamflow input cases, the LSSVR and GPR were better than the SVR. The SVR tuned by CMAES with temperature and streamflow inputs produced the least RRMSE (0.266), MAE (263.44), and MAPE (12.44) in streamflow estimation. The EN method was found to be the worst model in streamflow prediction. Uncertainty analysis also endorsed the superiority of the SVR over other machine learning methods by having low uncertainty values. Overall, the SVR model based on either temperature or streamflow as inputs, tuned by CMAES, is highly recommended for streamflow estimation.
format Article
author Ikram, Rana Muhammad Adnan
Goliatt, Leonardo
Kisi, Ozgur
Trajkovic, Slavisa
Shahid, Shamsuddin
author_facet Ikram, Rana Muhammad Adnan
Goliatt, Leonardo
Kisi, Ozgur
Trajkovic, Slavisa
Shahid, Shamsuddin
author_sort Ikram, Rana Muhammad Adnan
title Covariance matrix adaptation evolution strategy for improving machine learning approaches in streamflow prediction
title_short Covariance matrix adaptation evolution strategy for improving machine learning approaches in streamflow prediction
title_full Covariance matrix adaptation evolution strategy for improving machine learning approaches in streamflow prediction
title_fullStr Covariance matrix adaptation evolution strategy for improving machine learning approaches in streamflow prediction
title_full_unstemmed Covariance matrix adaptation evolution strategy for improving machine learning approaches in streamflow prediction
title_sort covariance matrix adaptation evolution strategy for improving machine learning approaches in streamflow prediction
publisher MDPI
publishDate 2022
url http://eprints.utm.my/103107/1/ShamsuddinShahid2022_CovarianceMatrixAdaptationEvolution.pdf
http://eprints.utm.my/103107/
http://dx.doi.org/10.3390/math10162971
_version_ 1781777646342897664