Composite optimization with coupling constraints via dual proximal gradient method with applications to asynchronous networks

In this article, we consider solving a composite optimization problem with affine coupling constraints in a multi-agent network based on proximal gradient method. In this problem, all the agents jointly minimize the sum of individual cost functions composed of smooth and possibly non-smooth parts. T...

Full description

Saved in:
Bibliographic Details
Main Authors: Wang, Jianzheng, Hu, Guoqiang
Other Authors: School of Electrical and Electronic Engineering
Format: Article
Language:English
Published: 2022
Subjects:
Online Access:https://hdl.handle.net/10356/162128
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-162128
record_format dspace
spelling sg-ntu-dr.10356-1621282022-10-19T04:49:43Z Composite optimization with coupling constraints via dual proximal gradient method with applications to asynchronous networks Wang, Jianzheng Hu, Guoqiang School of Electrical and Electronic Engineering Centre for system intelligence and efficiency (EXQUISITUS) Engineering::Electrical and electronic engineering::Control and instrumentation::Control engineering Asynchronous Network Dual Problem In this article, we consider solving a composite optimization problem with affine coupling constraints in a multi-agent network based on proximal gradient method. In this problem, all the agents jointly minimize the sum of individual cost functions composed of smooth and possibly non-smooth parts. To this end, we derive the dual problem by the concept of Fenchel conjugate, which gives rise to the dual proximal gradient (DPG) algorithm by allowing for the asymmetric individual interpretations of the coupling constraints. Then, an asynchronous DPG (Asyn-DPG) algorithm is proposed for the asynchronous networks with heterogeneous step-sizes and communication delays. For both the two algorithms, if the non-smooth parts of the objective functions are simple-structured, we only need to update dual variables by some simple operations, accounting for the reduction of the overall computational complexity. Analytical convergence rate of the proposed algorithms is derived and their efficacy is verified by solving a social welfare optimization problem of electricity market in the numerical simulation. Economic Development Board (EDB) National Research Foundation (NRF) Submitted/Accepted version This work was supported in part by Singapore Economic Development Board under EIRP Grant S14-1172-NRFEIRP-IHL, and in part by the Republic of Singapore’s National Research Foundation under its Campus for Research Excellence and Technological Enterprise (CREATE) Programme through a grant to the Berkeley Education Alliance for Research in Singapore (BEARS) for the Singapore-Berkeley Building Efficiency and Sustainability in the Tropics (SinBerBEST) Program. 2022-10-05T01:07:34Z 2022-10-05T01:07:34Z 2022 Journal Article Wang, J. & Hu, G. (2022). Composite optimization with coupling constraints via dual proximal gradient method with applications to asynchronous networks. International Journal of Robust and Nonlinear Control, 32(8), 4752-4770. https://dx.doi.org/10.1002/rnc.6048 1049-8923 https://hdl.handle.net/10356/162128 10.1002/rnc.6048 2-s2.0-85124459570 8 32 4752 4770 en S14-1172-NRFEIRP-IHL International Journal of Robust and Nonlinear Control © 2022 John Wiley & Sons Ltd. This is the peer reviewed version of the following article: Wang, J. & Hu, G. (2022). Composite optimization with coupling constraints via dual proximal gradient method with applications to asynchronous networks. International Journal of Robust and Nonlinear Control, 32(8), 4752-4770, which has been published in final form at https://doi.org/10.1002/rnc.6048]. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Use of Self-Archived Versions. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Electrical and electronic engineering::Control and instrumentation::Control engineering
Asynchronous Network
Dual Problem
spellingShingle Engineering::Electrical and electronic engineering::Control and instrumentation::Control engineering
Asynchronous Network
Dual Problem
Wang, Jianzheng
Hu, Guoqiang
Composite optimization with coupling constraints via dual proximal gradient method with applications to asynchronous networks
description In this article, we consider solving a composite optimization problem with affine coupling constraints in a multi-agent network based on proximal gradient method. In this problem, all the agents jointly minimize the sum of individual cost functions composed of smooth and possibly non-smooth parts. To this end, we derive the dual problem by the concept of Fenchel conjugate, which gives rise to the dual proximal gradient (DPG) algorithm by allowing for the asymmetric individual interpretations of the coupling constraints. Then, an asynchronous DPG (Asyn-DPG) algorithm is proposed for the asynchronous networks with heterogeneous step-sizes and communication delays. For both the two algorithms, if the non-smooth parts of the objective functions are simple-structured, we only need to update dual variables by some simple operations, accounting for the reduction of the overall computational complexity. Analytical convergence rate of the proposed algorithms is derived and their efficacy is verified by solving a social welfare optimization problem of electricity market in the numerical simulation.
author2 School of Electrical and Electronic Engineering
author_facet School of Electrical and Electronic Engineering
Wang, Jianzheng
Hu, Guoqiang
format Article
author Wang, Jianzheng
Hu, Guoqiang
author_sort Wang, Jianzheng
title Composite optimization with coupling constraints via dual proximal gradient method with applications to asynchronous networks
title_short Composite optimization with coupling constraints via dual proximal gradient method with applications to asynchronous networks
title_full Composite optimization with coupling constraints via dual proximal gradient method with applications to asynchronous networks
title_fullStr Composite optimization with coupling constraints via dual proximal gradient method with applications to asynchronous networks
title_full_unstemmed Composite optimization with coupling constraints via dual proximal gradient method with applications to asynchronous networks
title_sort composite optimization with coupling constraints via dual proximal gradient method with applications to asynchronous networks
publishDate 2022
url https://hdl.handle.net/10356/162128
_version_ 1749179226393673728