Multifactorial evolutionary algorithm with online transfer parameter estimation : MFEA-II

Humans rarely tackle every problem from scratch. Given this observation, the motivation for this paper is to improve optimization performance through adaptive knowledge transfer across related problems. The scope for spontaneous transfers under the simultaneous occurrence of multiple problems unveil...

Full description

Saved in:
Bibliographic Details
Main Authors: Bali, Kavitesh Kumar, Ong, Yew-Soon, Gupta, Abhishek, Tan, Puay Siew
Other Authors: School of Computer Science and Engineering
Format: Article
Language:English
Published: 2020
Subjects:
Online Access:https://hdl.handle.net/10356/143194
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-143194
record_format dspace
spelling sg-ntu-dr.10356-1431942020-08-12T01:23:59Z Multifactorial evolutionary algorithm with online transfer parameter estimation : MFEA-II Bali, Kavitesh Kumar Ong, Yew-Soon Gupta, Abhishek Tan, Puay Siew School of Computer Science and Engineering Data Science and Artificial Intelligence Research Centre Engineering::Computer science and engineering Evolutionary Multitasking General Optimization Intelligence (GOI) Humans rarely tackle every problem from scratch. Given this observation, the motivation for this paper is to improve optimization performance through adaptive knowledge transfer across related problems. The scope for spontaneous transfers under the simultaneous occurrence of multiple problems unveils the benefits of multitasking. Multitask optimization has recently demonstrated competence in solving multiple (related) optimization tasks concurrently. Notably, in the presence of underlying relationships between problems, the transfer of high-quality solutions across them has shown to facilitate superior performance characteristics. However, in the absence of any prior knowledge about the intertask synergies (as is often the case with general black-box optimization), the threat of predominantly negative transfer prevails. Susceptibility to negative intertask interactions can impede the overall convergence behavior. To allay such fears, in this paper, we propose a novel evolutionary computation framework that enables online learning and exploitation of the similarities (and discrepancies) between distinct tasks in multitask settings, for an enhanced optimization process. Our proposal is based on the principled theoretical arguments that seek to minimize the tendency of harmful interactions between tasks, based on a purely data-driven learning of relationships among them. The efficacy of our proposed method is validated experimentally on a series of synthetic benchmarks, as well as a practical study that provides insights into the behavior of the method in the face of several tasks occurring at once. Accepted version 2020-08-12T01:23:59Z 2020-08-12T01:23:59Z 2019 Journal Article Bali, K. K., Ong, Y.-S., Gupta, A., & Tan, P. S. (2020). Multifactorial evolutionary algorithm with online transfer parameter estimation : MFEA-II. IEEE Transactions on Evolutionary Computation, 24(1), 69-83. doi:10.1109/tevc.2019.2906927 1089-778X https://hdl.handle.net/10356/143194 10.1109/TEVC.2019.2906927 2-s2.0-85063385017 1 24 69 83 en IEEE Transactions on Evolutionary Computation © 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtaind for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The published version is available at: https://doi.org/10.1109/TEVC.2019.2906927. application/pdf
institution Nanyang Technological University
building NTU Library
country Singapore
collection DR-NTU
language English
topic Engineering::Computer science and engineering
Evolutionary Multitasking
General Optimization Intelligence (GOI)
spellingShingle Engineering::Computer science and engineering
Evolutionary Multitasking
General Optimization Intelligence (GOI)
Bali, Kavitesh Kumar
Ong, Yew-Soon
Gupta, Abhishek
Tan, Puay Siew
Multifactorial evolutionary algorithm with online transfer parameter estimation : MFEA-II
description Humans rarely tackle every problem from scratch. Given this observation, the motivation for this paper is to improve optimization performance through adaptive knowledge transfer across related problems. The scope for spontaneous transfers under the simultaneous occurrence of multiple problems unveils the benefits of multitasking. Multitask optimization has recently demonstrated competence in solving multiple (related) optimization tasks concurrently. Notably, in the presence of underlying relationships between problems, the transfer of high-quality solutions across them has shown to facilitate superior performance characteristics. However, in the absence of any prior knowledge about the intertask synergies (as is often the case with general black-box optimization), the threat of predominantly negative transfer prevails. Susceptibility to negative intertask interactions can impede the overall convergence behavior. To allay such fears, in this paper, we propose a novel evolutionary computation framework that enables online learning and exploitation of the similarities (and discrepancies) between distinct tasks in multitask settings, for an enhanced optimization process. Our proposal is based on the principled theoretical arguments that seek to minimize the tendency of harmful interactions between tasks, based on a purely data-driven learning of relationships among them. The efficacy of our proposed method is validated experimentally on a series of synthetic benchmarks, as well as a practical study that provides insights into the behavior of the method in the face of several tasks occurring at once.
author2 School of Computer Science and Engineering
author_facet School of Computer Science and Engineering
Bali, Kavitesh Kumar
Ong, Yew-Soon
Gupta, Abhishek
Tan, Puay Siew
format Article
author Bali, Kavitesh Kumar
Ong, Yew-Soon
Gupta, Abhishek
Tan, Puay Siew
author_sort Bali, Kavitesh Kumar
title Multifactorial evolutionary algorithm with online transfer parameter estimation : MFEA-II
title_short Multifactorial evolutionary algorithm with online transfer parameter estimation : MFEA-II
title_full Multifactorial evolutionary algorithm with online transfer parameter estimation : MFEA-II
title_fullStr Multifactorial evolutionary algorithm with online transfer parameter estimation : MFEA-II
title_full_unstemmed Multifactorial evolutionary algorithm with online transfer parameter estimation : MFEA-II
title_sort multifactorial evolutionary algorithm with online transfer parameter estimation : mfea-ii
publishDate 2020
url https://hdl.handle.net/10356/143194
_version_ 1681058949071110144