Island-based evolutionary computation with diverse surrogates and adaptive knowledge transfer for high-dimensional data-driven optimization

In recent years, there has been a growing interest in data-driven evolutionary algorithms (DDEAs) employing surrogate models to approximate the objective functions with limited data. However, current DDEAs are primarily designed for lower-dimensional problems and their performance drops significantl...

Full description

Saved in:
Bibliographic Details
Main Authors: ZHANG, Xian-Rong, GONG, Yue-Jiao, CAO, Zhiguang, ZHANG, Jun
Format: text
Language:English
Published: Institutional Knowledge at Singapore Management University 2024
Subjects:
Online Access:https://ink.library.smu.edu.sg/sis_research/9746
https://ink.library.smu.edu.sg/context/sis_research/article/10746/viewcontent/Island_based_EC_av_cc_by.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Singapore Management University
Language: English
id sg-smu-ink.sis_research-10746
record_format dspace
spelling sg-smu-ink.sis_research-107462024-12-16T03:30:22Z Island-based evolutionary computation with diverse surrogates and adaptive knowledge transfer for high-dimensional data-driven optimization ZHANG, Xian-Rong GONG, Yue-Jiao CAO, Zhiguang ZHANG, Jun In recent years, there has been a growing interest in data-driven evolutionary algorithms (DDEAs) employing surrogate models to approximate the objective functions with limited data. However, current DDEAs are primarily designed for lower-dimensional problems and their performance drops significantly when applied to large-scale optimization problems (LSOPs). To address the challenge, this paper proposes an offline DDEA named DSKT-DDEA. DSKT-DDEA leverages multiple islands that utilize different data to establish diverse surrogate models, fostering diverse subpopulations and mitigating the risk of premature convergence. In the intra-island optimization phase, a semi-supervised learning method is devised to fine-tune the surrogates. It not only facilitates data argumentation, but also incorporates the distribution information gathered during the search process to align the surrogates with the evolving local landscapes. Then, in the inter-island knowledge transfer phase, the algorithm incorporates an adaptive strategy that periodically transfers individual information and evaluates the transfer effectiveness in the new environment, facilitating global optimization efficacy. Experimental results demonstrate that our algorithm is competitive with state-of-the-art DDEAs on problems with up to 1000 dimensions, while also exhibiting decent parallelism and scalability. Our DSKT-DDEA is open-source and accessible at: https://github.com/LabGong/DSKT-DDEA. 2024-11-01T07:00:00Z text application/pdf https://ink.library.smu.edu.sg/sis_research/9746 info:doi/10.1145/3700886 https://ink.library.smu.edu.sg/context/sis_research/article/10746/viewcontent/Island_based_EC_av_cc_by.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University Data-driven evolutionary algorithm large-scale optimization problems diverse surrogate models semi-supervised learning adaptive knowledge transfer Databases and Information Systems Theory and Algorithms
institution Singapore Management University
building SMU Libraries
continent Asia
country Singapore
Singapore
content_provider SMU Libraries
collection InK@SMU
language English
topic Data-driven evolutionary algorithm
large-scale optimization problems
diverse surrogate models
semi-supervised learning
adaptive knowledge transfer
Databases and Information Systems
Theory and Algorithms
spellingShingle Data-driven evolutionary algorithm
large-scale optimization problems
diverse surrogate models
semi-supervised learning
adaptive knowledge transfer
Databases and Information Systems
Theory and Algorithms
ZHANG, Xian-Rong
GONG, Yue-Jiao
CAO, Zhiguang
ZHANG, Jun
Island-based evolutionary computation with diverse surrogates and adaptive knowledge transfer for high-dimensional data-driven optimization
description In recent years, there has been a growing interest in data-driven evolutionary algorithms (DDEAs) employing surrogate models to approximate the objective functions with limited data. However, current DDEAs are primarily designed for lower-dimensional problems and their performance drops significantly when applied to large-scale optimization problems (LSOPs). To address the challenge, this paper proposes an offline DDEA named DSKT-DDEA. DSKT-DDEA leverages multiple islands that utilize different data to establish diverse surrogate models, fostering diverse subpopulations and mitigating the risk of premature convergence. In the intra-island optimization phase, a semi-supervised learning method is devised to fine-tune the surrogates. It not only facilitates data argumentation, but also incorporates the distribution information gathered during the search process to align the surrogates with the evolving local landscapes. Then, in the inter-island knowledge transfer phase, the algorithm incorporates an adaptive strategy that periodically transfers individual information and evaluates the transfer effectiveness in the new environment, facilitating global optimization efficacy. Experimental results demonstrate that our algorithm is competitive with state-of-the-art DDEAs on problems with up to 1000 dimensions, while also exhibiting decent parallelism and scalability. Our DSKT-DDEA is open-source and accessible at: https://github.com/LabGong/DSKT-DDEA.
format text
author ZHANG, Xian-Rong
GONG, Yue-Jiao
CAO, Zhiguang
ZHANG, Jun
author_facet ZHANG, Xian-Rong
GONG, Yue-Jiao
CAO, Zhiguang
ZHANG, Jun
author_sort ZHANG, Xian-Rong
title Island-based evolutionary computation with diverse surrogates and adaptive knowledge transfer for high-dimensional data-driven optimization
title_short Island-based evolutionary computation with diverse surrogates and adaptive knowledge transfer for high-dimensional data-driven optimization
title_full Island-based evolutionary computation with diverse surrogates and adaptive knowledge transfer for high-dimensional data-driven optimization
title_fullStr Island-based evolutionary computation with diverse surrogates and adaptive knowledge transfer for high-dimensional data-driven optimization
title_full_unstemmed Island-based evolutionary computation with diverse surrogates and adaptive knowledge transfer for high-dimensional data-driven optimization
title_sort island-based evolutionary computation with diverse surrogates and adaptive knowledge transfer for high-dimensional data-driven optimization
publisher Institutional Knowledge at Singapore Management University
publishDate 2024
url https://ink.library.smu.edu.sg/sis_research/9746
https://ink.library.smu.edu.sg/context/sis_research/article/10746/viewcontent/Island_based_EC_av_cc_by.pdf
_version_ 1819113126186975232