Joint device scheduling and bandwidth allocation for federated learning over wireless networks

Federated Learning (FL) has been widely used to train shared machine learning models while addressing the privacy concerns. When deployed in wireless networks, bandwidth resources limitation is a key issue, thereby necessitating device scheduling and bandwidth allocation. It is challenging to carry...

Full description

Saved in:
Bibliographic Details
Main Authors: Zhang, Tinghao, Lam, Kwok-Yan, Zhao, Jun, Feng, Jie
Other Authors: College of Computing and Data Science
Format: Article
Language:English
Published: 2024
Subjects:
Online Access:https://hdl.handle.net/10356/176955
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-176955
record_format dspace
spelling sg-ntu-dr.10356-1769552024-05-20T01:43:56Z Joint device scheduling and bandwidth allocation for federated learning over wireless networks Zhang, Tinghao Lam, Kwok-Yan Zhao, Jun Feng, Jie College of Computing and Data Science School of Computer Science and Engineering Strategic Centre for Research in Privacy-Preserving Technologies & Systems (SCRIPTS) Computer and Information Science Bandwidth allocation Device scheduling Federated Learning (FL) has been widely used to train shared machine learning models while addressing the privacy concerns. When deployed in wireless networks, bandwidth resources limitation is a key issue, thereby necessitating device scheduling and bandwidth allocation. It is challenging to carry out device scheduling due to the large combinatorial search space. Besides, the heterogeneous computing capabilities and uncertain channel states of wireless devices complicate the design of a bandwidth allocation method. In this paper, we propose a joint device scheduling and bandwidth allocation framework for implementing FL in wireless networks. Specifically, deep reinforcement learning (DRL) is employed to conduct device scheduling. To this end, the state space, action space, and reward function of DRL are carefully defined for a typical FL system. Long short-term memory (LSTM) is adopted as the DRL agent to analyze the sequential input data. Given the scheduled devices of each global iteration, the proposed bandwidth allocation method aims to minimize the weighted sum of the time delay and energy consumption. Numerical experiments on both independent and identically distributed (IID) and non-IID datasets demonstrate that the proposed framework enables FL to reach the desired accuracy with low time delay and energy consumption. Info-communications Media Development Authority (IMDA) National Research Foundation (NRF) Submitted/Accepted version This research is supported by the National Research Foundation, Singapore and Infocomm Media Development Authority under its Trust Tech Funding Initiative and Strategic Capability Research Centres Funding Initiative 2024-05-20T01:43:56Z 2024-05-20T01:43:56Z 2023 Journal Article Zhang, T., Lam, K., Zhao, J. & Feng, J. (2023). Joint device scheduling and bandwidth allocation for federated learning over wireless networks. IEEE Transactions On Wireless Communications. https://dx.doi.org/10.1109/TWC.2023.3291701 1536-1276 https://hdl.handle.net/10356/176955 10.1109/TWC.2023.3291701 2-s2.0-85164708296 en IEEE Transactions on Wireless Communications © 2023 IEEE. All rights reserved. This article may be downloaded for personal use only. Any other use requires prior permission of the copyright holder. The Version of Record is available online at http://doi.org/10.1109/TWC.2023.3291701. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Computer and Information Science
Bandwidth allocation
Device scheduling
spellingShingle Computer and Information Science
Bandwidth allocation
Device scheduling
Zhang, Tinghao
Lam, Kwok-Yan
Zhao, Jun
Feng, Jie
Joint device scheduling and bandwidth allocation for federated learning over wireless networks
description Federated Learning (FL) has been widely used to train shared machine learning models while addressing the privacy concerns. When deployed in wireless networks, bandwidth resources limitation is a key issue, thereby necessitating device scheduling and bandwidth allocation. It is challenging to carry out device scheduling due to the large combinatorial search space. Besides, the heterogeneous computing capabilities and uncertain channel states of wireless devices complicate the design of a bandwidth allocation method. In this paper, we propose a joint device scheduling and bandwidth allocation framework for implementing FL in wireless networks. Specifically, deep reinforcement learning (DRL) is employed to conduct device scheduling. To this end, the state space, action space, and reward function of DRL are carefully defined for a typical FL system. Long short-term memory (LSTM) is adopted as the DRL agent to analyze the sequential input data. Given the scheduled devices of each global iteration, the proposed bandwidth allocation method aims to minimize the weighted sum of the time delay and energy consumption. Numerical experiments on both independent and identically distributed (IID) and non-IID datasets demonstrate that the proposed framework enables FL to reach the desired accuracy with low time delay and energy consumption.
author2 College of Computing and Data Science
author_facet College of Computing and Data Science
Zhang, Tinghao
Lam, Kwok-Yan
Zhao, Jun
Feng, Jie
format Article
author Zhang, Tinghao
Lam, Kwok-Yan
Zhao, Jun
Feng, Jie
author_sort Zhang, Tinghao
title Joint device scheduling and bandwidth allocation for federated learning over wireless networks
title_short Joint device scheduling and bandwidth allocation for federated learning over wireless networks
title_full Joint device scheduling and bandwidth allocation for federated learning over wireless networks
title_fullStr Joint device scheduling and bandwidth allocation for federated learning over wireless networks
title_full_unstemmed Joint device scheduling and bandwidth allocation for federated learning over wireless networks
title_sort joint device scheduling and bandwidth allocation for federated learning over wireless networks
publishDate 2024
url https://hdl.handle.net/10356/176955
_version_ 1806059923163840512