Evolution by adapting surrogates

To deal with complex optimization problems plagued with computationally expensive fitness functions, the use of surrogates to replace the original functions within the evolutionary framework is becoming a common practice. However, the appropriate datacentric approximation methodology to use for the...

Full description

Saved in:
Bibliographic Details
Main Authors: Ong, Yew Soon, Le, Minh Nghia, Menzel, Stefan, Jin, Yaochu, Sendhoff, Bernhard
Other Authors: School of Computer Engineering
Format: Article
Language:English
Published: 2014
Subjects:
Online Access:https://hdl.handle.net/10356/98489
http://hdl.handle.net/10220/18584
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-98489
record_format dspace
spelling sg-ntu-dr.10356-984892020-05-28T07:17:39Z Evolution by adapting surrogates Ong, Yew Soon Le, Minh Nghia Menzel, Stefan Jin, Yaochu Sendhoff, Bernhard School of Computer Engineering DRNTU::Engineering::Computer science and engineering::Computer applications::Life and medical sciences To deal with complex optimization problems plagued with computationally expensive fitness functions, the use of surrogates to replace the original functions within the evolutionary framework is becoming a common practice. However, the appropriate datacentric approximation methodology to use for the construction of surrogate model would depend largely on the nature of the problem of interest, which varies from fitness landscape and state of the evolutionary search, to the characteristics of search algorithm used. This has given rise to the plethora of surrogate-assisted evolutionary frameworks proposed in the literature with ad hoc approximation/surrogate modeling methodologies considered. Since prior knowledge on the suitability of the data centric approximation methodology to use in surrogate-assisted evolutionary optimization is typically unavailable beforehand, this paper presents a novel evolutionary framework with the evolvability learning of surrogates (EvoLS) operating on multiple diverse approximation methodologies in the search. Further, in contrast to the common use of fitness prediction error as a criterion for the selection of surrogates, the concept of evolvability to indicate the productivity or suitability of an approximation methodology that brings about fitness improvement in the evolutionary search is introduced as the basis for adaptation. The backbone of the proposed EvoLS is a statistical learning scheme to determine the evolvability of each approximation methodology while the search progresses online. For each individual solution, the most productive approximation methodology is inferred, that is, the method with highest evolvability measure. Fitness improving surrogates are subsequently constructed for use within a trust-region enabled local search strategy, leading to the self-configuration of a surrogate-assisted memetic algorithm for solving computationally expensive problems. A numerical study of EvoLS on commonly used benchmark problems and a real-world computationally expensive aerodynamic car rear design problem highlights the efficacy of the proposed EvoLS in attaining reliable, high quality, and efficient performance under a limited computational budget. Published version 2014-01-14T09:10:35Z 2019-12-06T19:55:56Z 2014-01-14T09:10:35Z 2019-12-06T19:55:56Z 2013 2013 Journal Article Le, M. N., Ong, Y. S., Menzel, S., Jin, Y., & Sendhoff, B. (2013). Evolution by Adapting Surrogates. Evolutionary Computation, 21(2), 313-340. https://hdl.handle.net/10356/98489 http://hdl.handle.net/10220/18584 10.1162/EVCO_a_00079 en Evolutionary computation © 2013 Massachusetts Institute of Technology. This paper was published in Evolutionary Computation and is made available as an electronic reprint (preprint) with permission of Massachusetts Institute of Technology. The paper can be found at the following official DOI: [http://dx.doi.org/10.1162/EVCO_a_00079]. One print or electronic copy may be made for personal use only. Systematic or multiple reproduction, distribution to multiple locations via electronic or other means, duplication of any material in this paper for a fee or for commercial purposes, or modification of the content of the paper is prohibited and is subject to penalties under law. application/pdf
institution Nanyang Technological University
building NTU Library
country Singapore
collection DR-NTU
language English
topic DRNTU::Engineering::Computer science and engineering::Computer applications::Life and medical sciences
spellingShingle DRNTU::Engineering::Computer science and engineering::Computer applications::Life and medical sciences
Ong, Yew Soon
Le, Minh Nghia
Menzel, Stefan
Jin, Yaochu
Sendhoff, Bernhard
Evolution by adapting surrogates
description To deal with complex optimization problems plagued with computationally expensive fitness functions, the use of surrogates to replace the original functions within the evolutionary framework is becoming a common practice. However, the appropriate datacentric approximation methodology to use for the construction of surrogate model would depend largely on the nature of the problem of interest, which varies from fitness landscape and state of the evolutionary search, to the characteristics of search algorithm used. This has given rise to the plethora of surrogate-assisted evolutionary frameworks proposed in the literature with ad hoc approximation/surrogate modeling methodologies considered. Since prior knowledge on the suitability of the data centric approximation methodology to use in surrogate-assisted evolutionary optimization is typically unavailable beforehand, this paper presents a novel evolutionary framework with the evolvability learning of surrogates (EvoLS) operating on multiple diverse approximation methodologies in the search. Further, in contrast to the common use of fitness prediction error as a criterion for the selection of surrogates, the concept of evolvability to indicate the productivity or suitability of an approximation methodology that brings about fitness improvement in the evolutionary search is introduced as the basis for adaptation. The backbone of the proposed EvoLS is a statistical learning scheme to determine the evolvability of each approximation methodology while the search progresses online. For each individual solution, the most productive approximation methodology is inferred, that is, the method with highest evolvability measure. Fitness improving surrogates are subsequently constructed for use within a trust-region enabled local search strategy, leading to the self-configuration of a surrogate-assisted memetic algorithm for solving computationally expensive problems. A numerical study of EvoLS on commonly used benchmark problems and a real-world computationally expensive aerodynamic car rear design problem highlights the efficacy of the proposed EvoLS in attaining reliable, high quality, and efficient performance under a limited computational budget.
author2 School of Computer Engineering
author_facet School of Computer Engineering
Ong, Yew Soon
Le, Minh Nghia
Menzel, Stefan
Jin, Yaochu
Sendhoff, Bernhard
format Article
author Ong, Yew Soon
Le, Minh Nghia
Menzel, Stefan
Jin, Yaochu
Sendhoff, Bernhard
author_sort Ong, Yew Soon
title Evolution by adapting surrogates
title_short Evolution by adapting surrogates
title_full Evolution by adapting surrogates
title_fullStr Evolution by adapting surrogates
title_full_unstemmed Evolution by adapting surrogates
title_sort evolution by adapting surrogates
publishDate 2014
url https://hdl.handle.net/10356/98489
http://hdl.handle.net/10220/18584
_version_ 1681057446198509568