Evolutionary optimization for computationally expensive problems

Despite all the appealing features of Evolutionary Algorithms (EAs), thousands of calls to the analysis or simulation codes are often required to locate a near optimal solution. Two major solutions for this issue are: 1) to use computationally less expensive surrogate models, and 2) to use parallel...

Full description

Saved in:
Bibliographic Details
Main Author: Lim, Dudy
Other Authors: Jin Yaochu
Format: Theses and Dissertations
Language:English
Published: 2009
Subjects:
Online Access:https://hdl.handle.net/10356/19262
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-19262
record_format dspace
spelling sg-ntu-dr.10356-192622023-03-04T00:40:15Z Evolutionary optimization for computationally expensive problems Lim, Dudy Jin Yaochu Bernhard Sendhoff Ong Yew Soon School of Computer Engineering Centre for Computational Intelligence DRNTU::Engineering::Computer science and engineering::Computer systems organization::Computer-communication networks Despite all the appealing features of Evolutionary Algorithms (EAs), thousands of calls to the analysis or simulation codes are often required to locate a near optimal solution. Two major solutions for this issue are: 1) to use computationally less expensive surrogate models, and 2) to use parallel and distributed computers. In this thesis, model management frameworks utilizing a diverse set of surrogate models are proposed. The proposed Generalized Surrogate Memetic (GSM) framework aims to unify diverse set of data-fitting models synergistically in the evolutionary search. In particular, the GSM framework exploits both the positive and negative impacts of approximation errors in the surrogate models used. An extended management framework is also proposed for EAs using multi-scale models and demonstrated on two real-world examples. Experimental study performed using data-fitting and multi-scale models indicates that the proposed frameworks are capable of attaining reliable, high quality, and e±cient performance under a limited omputational budget. In what follows, possibilities for further acceleration of the evolutionary optimization life cycle through parallelization are also considered. When applied to small-scale, dedicated, and homogeneous computing nodes, this seems to be a formidable solution. However, in a large-scale computing farm such as the Grid, reality proves otherwise. In a Grid computing environment, which emphasizes on the seamless sharing of computing resources across institutions, heterogeneity of resources is inevitable. In such situation, conventional parallelization without considering the heterogeneity of computing resources is likely to produce ine±cient optimization. The latter part of this thesis summarizes our works on parallelizing evolutionary optimization in a heterogeneous Grid computing environment. DOCTOR OF PHILOSOPHY (SCE) 2009-11-02T02:46:45Z 2009-11-02T02:46:45Z 2009 2009 Thesis Lim, D. (2009). Evolutionary optimization for computationally expensive problems. Doctoral thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/19262 10.32657/10356/19262 en 192 p. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic DRNTU::Engineering::Computer science and engineering::Computer systems organization::Computer-communication networks
spellingShingle DRNTU::Engineering::Computer science and engineering::Computer systems organization::Computer-communication networks
Lim, Dudy
Evolutionary optimization for computationally expensive problems
description Despite all the appealing features of Evolutionary Algorithms (EAs), thousands of calls to the analysis or simulation codes are often required to locate a near optimal solution. Two major solutions for this issue are: 1) to use computationally less expensive surrogate models, and 2) to use parallel and distributed computers. In this thesis, model management frameworks utilizing a diverse set of surrogate models are proposed. The proposed Generalized Surrogate Memetic (GSM) framework aims to unify diverse set of data-fitting models synergistically in the evolutionary search. In particular, the GSM framework exploits both the positive and negative impacts of approximation errors in the surrogate models used. An extended management framework is also proposed for EAs using multi-scale models and demonstrated on two real-world examples. Experimental study performed using data-fitting and multi-scale models indicates that the proposed frameworks are capable of attaining reliable, high quality, and e±cient performance under a limited omputational budget. In what follows, possibilities for further acceleration of the evolutionary optimization life cycle through parallelization are also considered. When applied to small-scale, dedicated, and homogeneous computing nodes, this seems to be a formidable solution. However, in a large-scale computing farm such as the Grid, reality proves otherwise. In a Grid computing environment, which emphasizes on the seamless sharing of computing resources across institutions, heterogeneity of resources is inevitable. In such situation, conventional parallelization without considering the heterogeneity of computing resources is likely to produce ine±cient optimization. The latter part of this thesis summarizes our works on parallelizing evolutionary optimization in a heterogeneous Grid computing environment.
author2 Jin Yaochu
author_facet Jin Yaochu
Lim, Dudy
format Theses and Dissertations
author Lim, Dudy
author_sort Lim, Dudy
title Evolutionary optimization for computationally expensive problems
title_short Evolutionary optimization for computationally expensive problems
title_full Evolutionary optimization for computationally expensive problems
title_fullStr Evolutionary optimization for computationally expensive problems
title_full_unstemmed Evolutionary optimization for computationally expensive problems
title_sort evolutionary optimization for computationally expensive problems
publishDate 2009
url https://hdl.handle.net/10356/19262
_version_ 1759854028431294464