Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning

The application of specific learning schemes in memetic algorithms (MAs) can have significant impact on their performances. One main issue revolves around two different learning schemes, specifically, Lamarckian and Baldwinian. It has been shown that the two learning schemes are better suited for di...

Full description

Saved in:
Bibliographic Details
Main Authors: Kheng, Cheng Wai, Chong, Siang Yew, Lim, Meng-Hiot
Other Authors: School of Electrical and Electronic Engineering
Format: Article
Language:English
Published: 2013
Subjects:
Online Access:https://hdl.handle.net/10356/98662
http://hdl.handle.net/10220/17110
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-98662
record_format dspace
spelling sg-ntu-dr.10356-986622020-03-07T13:57:30Z Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning Kheng, Cheng Wai Chong, Siang Yew Lim, Meng-Hiot School of Electrical and Electronic Engineering DRNTU::Engineering::Electrical and electronic engineering::Electronic systems The application of specific learning schemes in memetic algorithms (MAs) can have significant impact on their performances. One main issue revolves around two different learning schemes, specifically, Lamarckian and Baldwinian. It has been shown that the two learning schemes are better suited for different types of problems and some previous studies have attempted to combine both learning schemes as a means to develop a single optimisation framework capable of solving more classes of problems. However, most of the past approaches are often implemented heuristically and have not investigated the effect of different learning scheme on noisy design optimisation. In this article, we introduce a simple probabilistic approach to address this issue. In particular, we investigate a centroid-based approach that combines the two learning schemes within an MA framework (centroid-based MS; CBMA) through the effective allocation of resources (in terms of local search cost) that are based on information obtained during the optimisation process itself. A scheme that applies the right learning scheme (Lamarckian or Baldwinian) at the right time (during search) would lead to higher search performance. We conducted an empirical study to test this hypothesis using two different types of benchmark problems. The first problem set consists of simple benchmark problems whereby the problem landscape is static and gradient information can be obtained accurately. These problems are known to favour Lamarckian learning while Baldwinian learning is known to exhibit slower convergence. The second problem set consists of noisy versions of the first problem set whereby the problem landscape is dynamic as a result of the random noise perturbation injected into the design vector. These problems are known to favour learning processes that re-sample search points such as Baldwinian learning. Our experiments show that CBMA manages to adaptively allocate resources productively according to problem in most of the cases. 2013-10-31T03:01:54Z 2019-12-06T19:58:13Z 2013-10-31T03:01:54Z 2019-12-06T19:58:13Z 2012 2012 Journal Article Kheng, C. W., Chong, S. Y., & Lim, M.-H. (2012). Centroid-based memetic algorithm – adaptive Lamarckian and Baldwinian learning. International journal of systems science, 43(7), 1193-1216. 0020–7721 https://hdl.handle.net/10356/98662 http://hdl.handle.net/10220/17110 10.1080/00207721.2011.617526 en International journal of systems science
institution Nanyang Technological University
building NTU Library
country Singapore
collection DR-NTU
language English
topic DRNTU::Engineering::Electrical and electronic engineering::Electronic systems
spellingShingle DRNTU::Engineering::Electrical and electronic engineering::Electronic systems
Kheng, Cheng Wai
Chong, Siang Yew
Lim, Meng-Hiot
Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning
description The application of specific learning schemes in memetic algorithms (MAs) can have significant impact on their performances. One main issue revolves around two different learning schemes, specifically, Lamarckian and Baldwinian. It has been shown that the two learning schemes are better suited for different types of problems and some previous studies have attempted to combine both learning schemes as a means to develop a single optimisation framework capable of solving more classes of problems. However, most of the past approaches are often implemented heuristically and have not investigated the effect of different learning scheme on noisy design optimisation. In this article, we introduce a simple probabilistic approach to address this issue. In particular, we investigate a centroid-based approach that combines the two learning schemes within an MA framework (centroid-based MS; CBMA) through the effective allocation of resources (in terms of local search cost) that are based on information obtained during the optimisation process itself. A scheme that applies the right learning scheme (Lamarckian or Baldwinian) at the right time (during search) would lead to higher search performance. We conducted an empirical study to test this hypothesis using two different types of benchmark problems. The first problem set consists of simple benchmark problems whereby the problem landscape is static and gradient information can be obtained accurately. These problems are known to favour Lamarckian learning while Baldwinian learning is known to exhibit slower convergence. The second problem set consists of noisy versions of the first problem set whereby the problem landscape is dynamic as a result of the random noise perturbation injected into the design vector. These problems are known to favour learning processes that re-sample search points such as Baldwinian learning. Our experiments show that CBMA manages to adaptively allocate resources productively according to problem in most of the cases.
author2 School of Electrical and Electronic Engineering
author_facet School of Electrical and Electronic Engineering
Kheng, Cheng Wai
Chong, Siang Yew
Lim, Meng-Hiot
format Article
author Kheng, Cheng Wai
Chong, Siang Yew
Lim, Meng-Hiot
author_sort Kheng, Cheng Wai
title Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning
title_short Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning
title_full Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning
title_fullStr Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning
title_full_unstemmed Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning
title_sort centroid-based memetic algorithm : adaptive lamarckian and baldwinian learning
publishDate 2013
url https://hdl.handle.net/10356/98662
http://hdl.handle.net/10220/17110
_version_ 1681039870511808512