Composite optimization with coupling constraints via dual proximal gradient method with applications to asynchronous networks
In this article, we consider solving a composite optimization problem with affine coupling constraints in a multi-agent network based on proximal gradient method. In this problem, all the agents jointly minimize the sum of individual cost functions composed of smooth and possibly non-smooth parts. T...
Saved in:
Main Authors: | , |
---|---|
Other Authors: | |
Format: | Article |
Language: | English |
Published: |
2022
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/162128 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-162128 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1621282022-10-19T04:49:43Z Composite optimization with coupling constraints via dual proximal gradient method with applications to asynchronous networks Wang, Jianzheng Hu, Guoqiang School of Electrical and Electronic Engineering Centre for system intelligence and efficiency (EXQUISITUS) Engineering::Electrical and electronic engineering::Control and instrumentation::Control engineering Asynchronous Network Dual Problem In this article, we consider solving a composite optimization problem with affine coupling constraints in a multi-agent network based on proximal gradient method. In this problem, all the agents jointly minimize the sum of individual cost functions composed of smooth and possibly non-smooth parts. To this end, we derive the dual problem by the concept of Fenchel conjugate, which gives rise to the dual proximal gradient (DPG) algorithm by allowing for the asymmetric individual interpretations of the coupling constraints. Then, an asynchronous DPG (Asyn-DPG) algorithm is proposed for the asynchronous networks with heterogeneous step-sizes and communication delays. For both the two algorithms, if the non-smooth parts of the objective functions are simple-structured, we only need to update dual variables by some simple operations, accounting for the reduction of the overall computational complexity. Analytical convergence rate of the proposed algorithms is derived and their efficacy is verified by solving a social welfare optimization problem of electricity market in the numerical simulation. Economic Development Board (EDB) National Research Foundation (NRF) Submitted/Accepted version This work was supported in part by Singapore Economic Development Board under EIRP Grant S14-1172-NRFEIRP-IHL, and in part by the Republic of Singapore’s National Research Foundation under its Campus for Research Excellence and Technological Enterprise (CREATE) Programme through a grant to the Berkeley Education Alliance for Research in Singapore (BEARS) for the Singapore-Berkeley Building Efficiency and Sustainability in the Tropics (SinBerBEST) Program. 2022-10-05T01:07:34Z 2022-10-05T01:07:34Z 2022 Journal Article Wang, J. & Hu, G. (2022). Composite optimization with coupling constraints via dual proximal gradient method with applications to asynchronous networks. International Journal of Robust and Nonlinear Control, 32(8), 4752-4770. https://dx.doi.org/10.1002/rnc.6048 1049-8923 https://hdl.handle.net/10356/162128 10.1002/rnc.6048 2-s2.0-85124459570 8 32 4752 4770 en S14-1172-NRFEIRP-IHL International Journal of Robust and Nonlinear Control © 2022 John Wiley & Sons Ltd. This is the peer reviewed version of the following article: Wang, J. & Hu, G. (2022). Composite optimization with coupling constraints via dual proximal gradient method with applications to asynchronous networks. International Journal of Robust and Nonlinear Control, 32(8), 4752-4770, which has been published in final form at https://doi.org/10.1002/rnc.6048]. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Use of Self-Archived Versions. application/pdf |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Engineering::Electrical and electronic engineering::Control and instrumentation::Control engineering Asynchronous Network Dual Problem |
spellingShingle |
Engineering::Electrical and electronic engineering::Control and instrumentation::Control engineering Asynchronous Network Dual Problem Wang, Jianzheng Hu, Guoqiang Composite optimization with coupling constraints via dual proximal gradient method with applications to asynchronous networks |
description |
In this article, we consider solving a composite optimization problem with affine coupling constraints in a multi-agent network based on proximal gradient method. In this problem, all the agents jointly minimize the sum of individual cost functions composed of smooth and possibly non-smooth parts. To this end, we derive the dual problem by the concept of Fenchel conjugate, which gives rise to the dual proximal gradient (DPG) algorithm by allowing for the asymmetric individual interpretations of the coupling constraints. Then, an asynchronous DPG (Asyn-DPG) algorithm is proposed for the asynchronous networks with heterogeneous step-sizes and communication delays. For both the two algorithms, if the non-smooth parts of the objective functions are simple-structured, we only need to update dual variables by some simple operations, accounting for the reduction of the overall computational complexity. Analytical convergence rate of the proposed algorithms is derived and their efficacy is verified by solving a social welfare optimization problem of electricity market in the numerical simulation. |
author2 |
School of Electrical and Electronic Engineering |
author_facet |
School of Electrical and Electronic Engineering Wang, Jianzheng Hu, Guoqiang |
format |
Article |
author |
Wang, Jianzheng Hu, Guoqiang |
author_sort |
Wang, Jianzheng |
title |
Composite optimization with coupling constraints via dual proximal gradient method with applications to asynchronous networks |
title_short |
Composite optimization with coupling constraints via dual proximal gradient method with applications to asynchronous networks |
title_full |
Composite optimization with coupling constraints via dual proximal gradient method with applications to asynchronous networks |
title_fullStr |
Composite optimization with coupling constraints via dual proximal gradient method with applications to asynchronous networks |
title_full_unstemmed |
Composite optimization with coupling constraints via dual proximal gradient method with applications to asynchronous networks |
title_sort |
composite optimization with coupling constraints via dual proximal gradient method with applications to asynchronous networks |
publishDate |
2022 |
url |
https://hdl.handle.net/10356/162128 |
_version_ |
1749179226393673728 |