Joint device scheduling and bandwidth allocation for federated learning over wireless networks
Federated Learning (FL) has been widely used to train shared machine learning models while addressing the privacy concerns. When deployed in wireless networks, bandwidth resources limitation is a key issue, thereby necessitating device scheduling and bandwidth allocation. It is challenging to carry...
Saved in:
Main Authors: | , , , |
---|---|
Other Authors: | |
Format: | Article |
Language: | English |
Published: |
2024
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/176955 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-176955 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1769552024-05-20T01:43:56Z Joint device scheduling and bandwidth allocation for federated learning over wireless networks Zhang, Tinghao Lam, Kwok-Yan Zhao, Jun Feng, Jie College of Computing and Data Science School of Computer Science and Engineering Strategic Centre for Research in Privacy-Preserving Technologies & Systems (SCRIPTS) Computer and Information Science Bandwidth allocation Device scheduling Federated Learning (FL) has been widely used to train shared machine learning models while addressing the privacy concerns. When deployed in wireless networks, bandwidth resources limitation is a key issue, thereby necessitating device scheduling and bandwidth allocation. It is challenging to carry out device scheduling due to the large combinatorial search space. Besides, the heterogeneous computing capabilities and uncertain channel states of wireless devices complicate the design of a bandwidth allocation method. In this paper, we propose a joint device scheduling and bandwidth allocation framework for implementing FL in wireless networks. Specifically, deep reinforcement learning (DRL) is employed to conduct device scheduling. To this end, the state space, action space, and reward function of DRL are carefully defined for a typical FL system. Long short-term memory (LSTM) is adopted as the DRL agent to analyze the sequential input data. Given the scheduled devices of each global iteration, the proposed bandwidth allocation method aims to minimize the weighted sum of the time delay and energy consumption. Numerical experiments on both independent and identically distributed (IID) and non-IID datasets demonstrate that the proposed framework enables FL to reach the desired accuracy with low time delay and energy consumption. Info-communications Media Development Authority (IMDA) National Research Foundation (NRF) Submitted/Accepted version This research is supported by the National Research Foundation, Singapore and Infocomm Media Development Authority under its Trust Tech Funding Initiative and Strategic Capability Research Centres Funding Initiative 2024-05-20T01:43:56Z 2024-05-20T01:43:56Z 2023 Journal Article Zhang, T., Lam, K., Zhao, J. & Feng, J. (2023). Joint device scheduling and bandwidth allocation for federated learning over wireless networks. IEEE Transactions On Wireless Communications. https://dx.doi.org/10.1109/TWC.2023.3291701 1536-1276 https://hdl.handle.net/10356/176955 10.1109/TWC.2023.3291701 2-s2.0-85164708296 en IEEE Transactions on Wireless Communications © 2023 IEEE. All rights reserved. This article may be downloaded for personal use only. Any other use requires prior permission of the copyright holder. The Version of Record is available online at http://doi.org/10.1109/TWC.2023.3291701. application/pdf |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Computer and Information Science Bandwidth allocation Device scheduling |
spellingShingle |
Computer and Information Science Bandwidth allocation Device scheduling Zhang, Tinghao Lam, Kwok-Yan Zhao, Jun Feng, Jie Joint device scheduling and bandwidth allocation for federated learning over wireless networks |
description |
Federated Learning (FL) has been widely used to train shared machine learning models while addressing the privacy concerns. When deployed in wireless networks, bandwidth resources limitation is a key issue, thereby necessitating device scheduling and bandwidth allocation. It is challenging to carry out device scheduling due to the large combinatorial search space. Besides, the heterogeneous computing capabilities and uncertain channel states of wireless devices complicate the design of a bandwidth allocation method. In this paper, we propose a joint device scheduling and bandwidth allocation framework for implementing FL in wireless networks. Specifically, deep reinforcement learning (DRL) is employed to conduct device scheduling. To this end, the state space, action space, and reward function of DRL are carefully defined for a typical FL system. Long short-term memory (LSTM) is adopted as the DRL agent to analyze the sequential input data. Given the scheduled devices of each global iteration, the proposed bandwidth allocation method aims to minimize the weighted sum of the time delay and energy consumption. Numerical experiments on both independent and identically distributed (IID) and non-IID datasets demonstrate that the proposed framework enables FL to reach the desired accuracy with low time delay and energy consumption. |
author2 |
College of Computing and Data Science |
author_facet |
College of Computing and Data Science Zhang, Tinghao Lam, Kwok-Yan Zhao, Jun Feng, Jie |
format |
Article |
author |
Zhang, Tinghao Lam, Kwok-Yan Zhao, Jun Feng, Jie |
author_sort |
Zhang, Tinghao |
title |
Joint device scheduling and bandwidth allocation for federated learning over wireless networks |
title_short |
Joint device scheduling and bandwidth allocation for federated learning over wireless networks |
title_full |
Joint device scheduling and bandwidth allocation for federated learning over wireless networks |
title_fullStr |
Joint device scheduling and bandwidth allocation for federated learning over wireless networks |
title_full_unstemmed |
Joint device scheduling and bandwidth allocation for federated learning over wireless networks |
title_sort |
joint device scheduling and bandwidth allocation for federated learning over wireless networks |
publishDate |
2024 |
url |
https://hdl.handle.net/10356/176955 |
_version_ |
1806059923163840512 |