Adaptive dynamic bipartite graph matching : a reinforcement learning approach

Online bipartite graph matching is attracting growing research attention due to the development of dynamic task assignment in sharing economy applications, where tasks need be assigned dynamically to workers. Past studies lack practicability in terms of both problem formulation and solution framewor...

Full description

Saved in:
Bibliographic Details
Main Authors: Wang, Yansheng, Tong, Yongxin, Long, Cheng, Xu, Pan, Xu, Ke, Lv, Weifeng
Other Authors: School of Computer Science and Engineering
Format: Conference or Workshop Item
Language:English
Published: 2021
Subjects:
Online Access:https://hdl.handle.net/10356/148147
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-148147
record_format dspace
spelling sg-ntu-dr.10356-1481472021-05-06T01:47:20Z Adaptive dynamic bipartite graph matching : a reinforcement learning approach Wang, Yansheng Tong, Yongxin Long, Cheng Xu, Pan Xu, Ke Lv, Weifeng School of Computer Science and Engineering 2019 IEEE 35th International Conference on Data Engineering (ICDE) Engineering::Computer science and engineering::Information systems::Database management Online Bipartite Matching Bipartite Graph Online bipartite graph matching is attracting growing research attention due to the development of dynamic task assignment in sharing economy applications, where tasks need be assigned dynamically to workers. Past studies lack practicability in terms of both problem formulation and solution framework. On the one hand, some problem settings in prior online bipartite graph matching research are impractical for real-world applications. On the other hand, existing solutions to online bipartite graph matching are inefficient due to the unnecessary real-time decision making. In this paper, we propose the dynamic bipartite graph matching (DBGM) problem to be better aligned with real-world applications and devise a novel adaptive batch-based solution framework with a constant competitive ratio. As an effective and efficient implementation of the solution framework, we design a reinforcement learning based algorithm, called Restricted Q-learning (RQL), which makes near-optimal decisions on batch splitting. Extensive experimental results on both real and synthetic datasets show that our methods outperform the state-of-the-arts in terms of both effectiveness and efficiency. Nanyang Technological University Accepted version Cheng Long’s work is partially supported by NTU SUG M4082302.020. 2021-05-06T01:47:20Z 2021-05-06T01:47:20Z 2019 Conference Paper Wang, Y., Tong, Y., Long, C., Xu, P., Xu, K. & Lv, W. (2019). Adaptive dynamic bipartite graph matching : a reinforcement learning approach. 2019 IEEE 35th International Conference on Data Engineering (ICDE), 2019-April, 1478-1489. https://dx.doi.org/10.1109/ICDE.2019.00133 9781538674741 https://hdl.handle.net/10356/148147 10.1109/ICDE.2019.00133 2-s2.0-85067953279 2019-April 1478 1489 en START-UP GRANT © 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The published version is available at: https://doi.org/10.1109/ICDE.2019.00133 application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Computer science and engineering::Information systems::Database management
Online Bipartite Matching
Bipartite Graph
spellingShingle Engineering::Computer science and engineering::Information systems::Database management
Online Bipartite Matching
Bipartite Graph
Wang, Yansheng
Tong, Yongxin
Long, Cheng
Xu, Pan
Xu, Ke
Lv, Weifeng
Adaptive dynamic bipartite graph matching : a reinforcement learning approach
description Online bipartite graph matching is attracting growing research attention due to the development of dynamic task assignment in sharing economy applications, where tasks need be assigned dynamically to workers. Past studies lack practicability in terms of both problem formulation and solution framework. On the one hand, some problem settings in prior online bipartite graph matching research are impractical for real-world applications. On the other hand, existing solutions to online bipartite graph matching are inefficient due to the unnecessary real-time decision making. In this paper, we propose the dynamic bipartite graph matching (DBGM) problem to be better aligned with real-world applications and devise a novel adaptive batch-based solution framework with a constant competitive ratio. As an effective and efficient implementation of the solution framework, we design a reinforcement learning based algorithm, called Restricted Q-learning (RQL), which makes near-optimal decisions on batch splitting. Extensive experimental results on both real and synthetic datasets show that our methods outperform the state-of-the-arts in terms of both effectiveness and efficiency.
author2 School of Computer Science and Engineering
author_facet School of Computer Science and Engineering
Wang, Yansheng
Tong, Yongxin
Long, Cheng
Xu, Pan
Xu, Ke
Lv, Weifeng
format Conference or Workshop Item
author Wang, Yansheng
Tong, Yongxin
Long, Cheng
Xu, Pan
Xu, Ke
Lv, Weifeng
author_sort Wang, Yansheng
title Adaptive dynamic bipartite graph matching : a reinforcement learning approach
title_short Adaptive dynamic bipartite graph matching : a reinforcement learning approach
title_full Adaptive dynamic bipartite graph matching : a reinforcement learning approach
title_fullStr Adaptive dynamic bipartite graph matching : a reinforcement learning approach
title_full_unstemmed Adaptive dynamic bipartite graph matching : a reinforcement learning approach
title_sort adaptive dynamic bipartite graph matching : a reinforcement learning approach
publishDate 2021
url https://hdl.handle.net/10356/148147
_version_ 1699245885346545664