Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning
The application of specific learning schemes in memetic algorithms (MAs) can have significant impact on their performances. One main issue revolves around two different learning schemes, specifically, Lamarckian and Baldwinian. It has been shown that the two learning schemes are better suited for di...
Saved in:
Main Authors: | , , |
---|---|
Other Authors: | |
Format: | Article |
Language: | English |
Published: |
2013
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/98662 http://hdl.handle.net/10220/17110 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-98662 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-986622020-03-07T13:57:30Z Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning Kheng, Cheng Wai Chong, Siang Yew Lim, Meng-Hiot School of Electrical and Electronic Engineering DRNTU::Engineering::Electrical and electronic engineering::Electronic systems The application of specific learning schemes in memetic algorithms (MAs) can have significant impact on their performances. One main issue revolves around two different learning schemes, specifically, Lamarckian and Baldwinian. It has been shown that the two learning schemes are better suited for different types of problems and some previous studies have attempted to combine both learning schemes as a means to develop a single optimisation framework capable of solving more classes of problems. However, most of the past approaches are often implemented heuristically and have not investigated the effect of different learning scheme on noisy design optimisation. In this article, we introduce a simple probabilistic approach to address this issue. In particular, we investigate a centroid-based approach that combines the two learning schemes within an MA framework (centroid-based MS; CBMA) through the effective allocation of resources (in terms of local search cost) that are based on information obtained during the optimisation process itself. A scheme that applies the right learning scheme (Lamarckian or Baldwinian) at the right time (during search) would lead to higher search performance. We conducted an empirical study to test this hypothesis using two different types of benchmark problems. The first problem set consists of simple benchmark problems whereby the problem landscape is static and gradient information can be obtained accurately. These problems are known to favour Lamarckian learning while Baldwinian learning is known to exhibit slower convergence. The second problem set consists of noisy versions of the first problem set whereby the problem landscape is dynamic as a result of the random noise perturbation injected into the design vector. These problems are known to favour learning processes that re-sample search points such as Baldwinian learning. Our experiments show that CBMA manages to adaptively allocate resources productively according to problem in most of the cases. 2013-10-31T03:01:54Z 2019-12-06T19:58:13Z 2013-10-31T03:01:54Z 2019-12-06T19:58:13Z 2012 2012 Journal Article Kheng, C. W., Chong, S. Y., & Lim, M.-H. (2012). Centroid-based memetic algorithm – adaptive Lamarckian and Baldwinian learning. International journal of systems science, 43(7), 1193-1216. 0020–7721 https://hdl.handle.net/10356/98662 http://hdl.handle.net/10220/17110 10.1080/00207721.2011.617526 en International journal of systems science |
institution |
Nanyang Technological University |
building |
NTU Library |
country |
Singapore |
collection |
DR-NTU |
language |
English |
topic |
DRNTU::Engineering::Electrical and electronic engineering::Electronic systems |
spellingShingle |
DRNTU::Engineering::Electrical and electronic engineering::Electronic systems Kheng, Cheng Wai Chong, Siang Yew Lim, Meng-Hiot Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning |
description |
The application of specific learning schemes in memetic algorithms (MAs) can have significant impact on their performances. One main issue revolves around two different learning schemes, specifically, Lamarckian and Baldwinian. It has been shown that the two learning schemes are better suited for different types of problems and some previous studies have attempted to combine both learning schemes as a means to develop a single optimisation framework capable of solving more classes of problems. However, most of the past approaches are often implemented heuristically and have not investigated the effect of different learning scheme on noisy design optimisation. In this article, we introduce a simple probabilistic approach to address this issue. In particular, we investigate a centroid-based approach that combines the two learning schemes within an MA framework (centroid-based MS; CBMA) through the effective allocation of resources (in terms of local search cost) that are based on information obtained during the optimisation process itself. A scheme that applies the right learning scheme (Lamarckian or Baldwinian) at the right time (during search) would lead to higher search performance. We conducted an empirical study to test this hypothesis using two different types of benchmark problems. The first problem set consists of simple benchmark problems whereby the problem landscape is static and gradient information can be obtained accurately. These problems are known to favour Lamarckian learning while Baldwinian learning is known to exhibit slower convergence. The second problem set consists of noisy versions of the first problem set whereby the problem landscape is dynamic as a result of the random noise perturbation injected into the design vector. These problems are known to favour learning processes that re-sample search points such as Baldwinian learning. Our experiments show that CBMA manages to adaptively allocate resources productively according to problem in most of the cases. |
author2 |
School of Electrical and Electronic Engineering |
author_facet |
School of Electrical and Electronic Engineering Kheng, Cheng Wai Chong, Siang Yew Lim, Meng-Hiot |
format |
Article |
author |
Kheng, Cheng Wai Chong, Siang Yew Lim, Meng-Hiot |
author_sort |
Kheng, Cheng Wai |
title |
Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning |
title_short |
Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning |
title_full |
Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning |
title_fullStr |
Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning |
title_full_unstemmed |
Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning |
title_sort |
centroid-based memetic algorithm : adaptive lamarckian and baldwinian learning |
publishDate |
2013 |
url |
https://hdl.handle.net/10356/98662 http://hdl.handle.net/10220/17110 |
_version_ |
1681039870511808512 |