Randomized methods for computing optimal transport without regularization and their convergence analysis
The optimal transport (OT) problem can be reduced to a linear programming (LP) problem through discretization. In this paper, we introduced the random block coordinate descent (RBCD) methods to directly solve this LP problem. Our approach involves restricting the potentially large-scale optimization...
Saved in:
Main Authors: | , , |
---|---|
Other Authors: | |
Format: | Article |
Language: | English |
Published: |
2024
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/178997 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-178997 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1789972024-07-15T15:35:28Z Randomized methods for computing optimal transport without regularization and their convergence analysis Xie, Yue Wang, Zhongjian Zhang, Zhiwen School of Physical and Mathematical Sciences Mathematical Sciences Optimal transport Deep particle method The optimal transport (OT) problem can be reduced to a linear programming (LP) problem through discretization. In this paper, we introduced the random block coordinate descent (RBCD) methods to directly solve this LP problem. Our approach involves restricting the potentially large-scale optimization problem to small LP subproblems constructed via randomly chosen working sets. By using a random Gauss-Southwell-q rule to select these working sets, we equip the vanilla version of (RBCD0) with almost sure convergence and a linear convergence rate to solve general standard LP problems. To further improve the efficiency of the (RBCD0) method, we explore the special structure of constraints in the OT problems and leverage the theory of linear systems to propose several approaches for refining the random working set selection and accelerating the vanilla method. Inexact versions of the RBCD methods are also discussed. Our preliminary numerical experiments demonstrate that the accelerated random block coordinate descent (ARBCD) method compares well with other solvers including stabilized Sinkhorn’s algorithm when seeking solutions with relatively high accuracy, and offers the advantage of saving memory. Submitted/Accepted version The research of YX is supported by Guangdong Province Fundamental and Applied Fundamental Research Regional Joint Fund, (Project 2022B1515130009), and the start-up fund of HKU-IDS. The research of ZW is partially supported by NTU SUG 023162-00001. The research of ZZ is supported by the National Natural Science Foundation of China (Project 12171406), Hong Kong RGC grants (Projects 17300318 and 17307921), Seed Fund for Basic Research (HKU), an R&D Funding Scheme from the HKU-SCF FinTech Academy, and Seed Funding for Strategic Interdisciplinary Research Scheme 2021/22 (HKU). 2024-07-15T08:34:57Z 2024-07-15T08:34:57Z 2024 Journal Article Xie, Y., Wang, Z. & Zhang, Z. (2024). Randomized methods for computing optimal transport without regularization and their convergence analysis. Journal of Scientific Computing, 100(2), 37-. https://dx.doi.org/10.1007/s10915-024-02570-w 0885-7474 https://hdl.handle.net/10356/178997 10.1007/s10915-024-02570-w 2-s2.0-85196354717 2 100 37 en Journal of Scientific Computing © 2024 The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature. All rights reserved. This article may be downloaded for personal use only. Any other use requires prior permission of the copyright holder. The Version of Record is available online at http://doi.org/10.1007/s10915-024-02570-w. application/pdf |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Mathematical Sciences Optimal transport Deep particle method |
spellingShingle |
Mathematical Sciences Optimal transport Deep particle method Xie, Yue Wang, Zhongjian Zhang, Zhiwen Randomized methods for computing optimal transport without regularization and their convergence analysis |
description |
The optimal transport (OT) problem can be reduced to a linear programming (LP) problem through discretization. In this paper, we introduced the random block coordinate descent (RBCD) methods to directly solve this LP problem. Our approach involves restricting the potentially large-scale optimization problem to small LP subproblems constructed via randomly chosen working sets. By using a random Gauss-Southwell-q rule to select these working sets, we equip the vanilla version of (RBCD0) with almost sure convergence and a linear convergence rate to solve general standard LP problems. To further improve the efficiency of the (RBCD0) method, we explore the special structure of constraints in the OT problems and leverage the theory of linear systems to propose several approaches for refining the random working set selection and accelerating the vanilla method. Inexact versions of the RBCD methods are also discussed. Our preliminary numerical experiments demonstrate that the accelerated random block coordinate descent (ARBCD) method compares well with other solvers including stabilized Sinkhorn’s algorithm when seeking solutions with relatively high accuracy, and offers the advantage of saving memory. |
author2 |
School of Physical and Mathematical Sciences |
author_facet |
School of Physical and Mathematical Sciences Xie, Yue Wang, Zhongjian Zhang, Zhiwen |
format |
Article |
author |
Xie, Yue Wang, Zhongjian Zhang, Zhiwen |
author_sort |
Xie, Yue |
title |
Randomized methods for computing optimal transport without regularization and their convergence analysis |
title_short |
Randomized methods for computing optimal transport without regularization and their convergence analysis |
title_full |
Randomized methods for computing optimal transport without regularization and their convergence analysis |
title_fullStr |
Randomized methods for computing optimal transport without regularization and their convergence analysis |
title_full_unstemmed |
Randomized methods for computing optimal transport without regularization and their convergence analysis |
title_sort |
randomized methods for computing optimal transport without regularization and their convergence analysis |
publishDate |
2024 |
url |
https://hdl.handle.net/10356/178997 |
_version_ |
1806059853572997120 |