Randomized methods for computing optimal transport without regularization and their convergence analysis

The optimal transport (OT) problem can be reduced to a linear programming (LP) problem through discretization. In this paper, we introduced the random block coordinate descent (RBCD) methods to directly solve this LP problem. Our approach involves restricting the potentially large-scale optimization...

Full description

Saved in:
Bibliographic Details
Main Authors: Xie, Yue, Wang, Zhongjian, Zhang, Zhiwen
Other Authors: School of Physical and Mathematical Sciences
Format: Article
Language:English
Published: 2024
Subjects:
Online Access:https://hdl.handle.net/10356/178997
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-178997
record_format dspace
spelling sg-ntu-dr.10356-1789972024-07-15T15:35:28Z Randomized methods for computing optimal transport without regularization and their convergence analysis Xie, Yue Wang, Zhongjian Zhang, Zhiwen School of Physical and Mathematical Sciences Mathematical Sciences Optimal transport Deep particle method The optimal transport (OT) problem can be reduced to a linear programming (LP) problem through discretization. In this paper, we introduced the random block coordinate descent (RBCD) methods to directly solve this LP problem. Our approach involves restricting the potentially large-scale optimization problem to small LP subproblems constructed via randomly chosen working sets. By using a random Gauss-Southwell-q rule to select these working sets, we equip the vanilla version of (RBCD0) with almost sure convergence and a linear convergence rate to solve general standard LP problems. To further improve the efficiency of the (RBCD0) method, we explore the special structure of constraints in the OT problems and leverage the theory of linear systems to propose several approaches for refining the random working set selection and accelerating the vanilla method. Inexact versions of the RBCD methods are also discussed. Our preliminary numerical experiments demonstrate that the accelerated random block coordinate descent (ARBCD) method compares well with other solvers including stabilized Sinkhorn’s algorithm when seeking solutions with relatively high accuracy, and offers the advantage of saving memory. Submitted/Accepted version The research of YX is supported by Guangdong Province Fundamental and Applied Fundamental Research Regional Joint Fund, (Project 2022B1515130009), and the start-up fund of HKU-IDS. The research of ZW is partially supported by NTU SUG 023162-00001. The research of ZZ is supported by the National Natural Science Foundation of China (Project 12171406), Hong Kong RGC grants (Projects 17300318 and 17307921), Seed Fund for Basic Research (HKU), an R&D Funding Scheme from the HKU-SCF FinTech Academy, and Seed Funding for Strategic Interdisciplinary Research Scheme 2021/22 (HKU). 2024-07-15T08:34:57Z 2024-07-15T08:34:57Z 2024 Journal Article Xie, Y., Wang, Z. & Zhang, Z. (2024). Randomized methods for computing optimal transport without regularization and their convergence analysis. Journal of Scientific Computing, 100(2), 37-. https://dx.doi.org/10.1007/s10915-024-02570-w 0885-7474 https://hdl.handle.net/10356/178997 10.1007/s10915-024-02570-w 2-s2.0-85196354717 2 100 37 en Journal of Scientific Computing © 2024 The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature. All rights reserved. This article may be downloaded for personal use only. Any other use requires prior permission of the copyright holder. The Version of Record is available online at http://doi.org/10.1007/s10915-024-02570-w. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Mathematical Sciences
Optimal transport
Deep particle method
spellingShingle Mathematical Sciences
Optimal transport
Deep particle method
Xie, Yue
Wang, Zhongjian
Zhang, Zhiwen
Randomized methods for computing optimal transport without regularization and their convergence analysis
description The optimal transport (OT) problem can be reduced to a linear programming (LP) problem through discretization. In this paper, we introduced the random block coordinate descent (RBCD) methods to directly solve this LP problem. Our approach involves restricting the potentially large-scale optimization problem to small LP subproblems constructed via randomly chosen working sets. By using a random Gauss-Southwell-q rule to select these working sets, we equip the vanilla version of (RBCD0) with almost sure convergence and a linear convergence rate to solve general standard LP problems. To further improve the efficiency of the (RBCD0) method, we explore the special structure of constraints in the OT problems and leverage the theory of linear systems to propose several approaches for refining the random working set selection and accelerating the vanilla method. Inexact versions of the RBCD methods are also discussed. Our preliminary numerical experiments demonstrate that the accelerated random block coordinate descent (ARBCD) method compares well with other solvers including stabilized Sinkhorn’s algorithm when seeking solutions with relatively high accuracy, and offers the advantage of saving memory.
author2 School of Physical and Mathematical Sciences
author_facet School of Physical and Mathematical Sciences
Xie, Yue
Wang, Zhongjian
Zhang, Zhiwen
format Article
author Xie, Yue
Wang, Zhongjian
Zhang, Zhiwen
author_sort Xie, Yue
title Randomized methods for computing optimal transport without regularization and their convergence analysis
title_short Randomized methods for computing optimal transport without regularization and their convergence analysis
title_full Randomized methods for computing optimal transport without regularization and their convergence analysis
title_fullStr Randomized methods for computing optimal transport without regularization and their convergence analysis
title_full_unstemmed Randomized methods for computing optimal transport without regularization and their convergence analysis
title_sort randomized methods for computing optimal transport without regularization and their convergence analysis
publishDate 2024
url https://hdl.handle.net/10356/178997
_version_ 1806059853572997120