When information freshness meets service latency in federated learning : a task-aware incentive scheme for smart industries

For several industrial applications, a sole data owner may lack sufficient training samples to train effective machine learning based models. As such, we propose a Federated Learning (FL) based approach to promote privacy-preserving collaborative machine learning for applications in smart industries...

Full description

Saved in:
Bibliographic Details
Main Authors: Lim, Bryan Wei Yang, Xiong, Zehui, Kang, Jiawei, Niyato, Dusit, Leung, Cyril, Miao, Chunyan, Shen, Xuemin
Other Authors: School of Computer Science and Engineering
Format: Article
Language:English
Published: 2021
Subjects:
Online Access:https://hdl.handle.net/10356/152724
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-152724
record_format dspace
spelling sg-ntu-dr.10356-1527242021-12-09T08:13:25Z When information freshness meets service latency in federated learning : a task-aware incentive scheme for smart industries Lim, Bryan Wei Yang Xiong, Zehui Kang, Jiawei Niyato, Dusit Leung, Cyril Miao, Chunyan Shen, Xuemin School of Computer Science and Engineering Alibaba-NTU Joint Research Institute Joint NTU-UBC Research Centre of Excellence in Active Living for the Elderly (LILY) Engineering::Computer science and engineering Federated Learning Age of Information For several industrial applications, a sole data owner may lack sufficient training samples to train effective machine learning based models. As such, we propose a Federated Learning (FL) based approach to promote privacy-preserving collaborative machine learning for applications in smart industries. In our system model, a model owner initiates an FL task involving a group of workers, i.e., data owners, to perform model training on their locally stored data before transmitting the model updates for aggregation. There exists a tradeoff between service latency, i.e., the time taken for the training request to be completed, and Age of Information (AoI), i.e., the time elapsed between data aggregation from the deployed IIoT devices to completion of the FL based training. On one hand, if the data is collected only upon the model owner's request, the AoI is low. On the other hand, the service latency incurred is more significant. Furthermore, given that different training tasks may have varying AoI requirements, we propose a contract-theoretic task-aware incentive scheme that can be calibrated based on the weighted preferences of the model owner towards AoI and service latency. Performance evaluation validates the incentive compatibility of our contract amid information asymmetry, and shows the flexibility of our proposed scheme towards satisfying varying preferences of AoI and service latency. AI Singapore Energy Market Authority (EMA) Ministry of Education (MOE) Nanyang Technological University National Research Foundation (NRF) Accepted version This research is supported, in part, by Alibaba Group through Alibaba Innovative Research (AIR) Program and Alibaba-NTU Singapore Joint Research Institute (JRI), National Research Foundation, Singapore, under its AI Singapore Programme (AISG Award No: AISG-GC-2019-003), Singapore Energy Market Authority (EMA), Energy Resilience, under Grant NRF2017EWT-EP003-041; and in part by the Singapore NRF2015-NRF-ISF001-2277. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not reflect the views of National Research Foundation, Singapore. This research is also supported by WASP/NTU grant M4082187 (4080) and Singapore Ministry of Education (MOE) Tier 1 (RG16/20). 2021-12-09T08:13:25Z 2021-12-09T08:13:25Z 2020 Journal Article Lim, B. W. Y., Xiong, Z., Kang, J., Niyato, D., Leung, C., Miao, C. & Shen, X. (2020). When information freshness meets service latency in federated learning : a task-aware incentive scheme for smart industries. IEEE Transactions On Industrial Informatics, 18(1), 457-466. https://dx.doi.org/10.1109/TII.2020.3046028 1551-3203 https://hdl.handle.net/10356/152724 10.1109/TII.2020.3046028 2-s2.0-85098755141 1 18 457 466 en AISG-GC-2019-003 NRF2017EWT-EP003-041 NRF2015-NRF-ISF001-2277 M4082187 (4080) RG16/20 IEEE Transactions on Industrial Informatics © 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The published version is available at: https://doi.org/10.1109/TII.2020.3046028. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Computer science and engineering
Federated Learning
Age of Information
spellingShingle Engineering::Computer science and engineering
Federated Learning
Age of Information
Lim, Bryan Wei Yang
Xiong, Zehui
Kang, Jiawei
Niyato, Dusit
Leung, Cyril
Miao, Chunyan
Shen, Xuemin
When information freshness meets service latency in federated learning : a task-aware incentive scheme for smart industries
description For several industrial applications, a sole data owner may lack sufficient training samples to train effective machine learning based models. As such, we propose a Federated Learning (FL) based approach to promote privacy-preserving collaborative machine learning for applications in smart industries. In our system model, a model owner initiates an FL task involving a group of workers, i.e., data owners, to perform model training on their locally stored data before transmitting the model updates for aggregation. There exists a tradeoff between service latency, i.e., the time taken for the training request to be completed, and Age of Information (AoI), i.e., the time elapsed between data aggregation from the deployed IIoT devices to completion of the FL based training. On one hand, if the data is collected only upon the model owner's request, the AoI is low. On the other hand, the service latency incurred is more significant. Furthermore, given that different training tasks may have varying AoI requirements, we propose a contract-theoretic task-aware incentive scheme that can be calibrated based on the weighted preferences of the model owner towards AoI and service latency. Performance evaluation validates the incentive compatibility of our contract amid information asymmetry, and shows the flexibility of our proposed scheme towards satisfying varying preferences of AoI and service latency.
author2 School of Computer Science and Engineering
author_facet School of Computer Science and Engineering
Lim, Bryan Wei Yang
Xiong, Zehui
Kang, Jiawei
Niyato, Dusit
Leung, Cyril
Miao, Chunyan
Shen, Xuemin
format Article
author Lim, Bryan Wei Yang
Xiong, Zehui
Kang, Jiawei
Niyato, Dusit
Leung, Cyril
Miao, Chunyan
Shen, Xuemin
author_sort Lim, Bryan Wei Yang
title When information freshness meets service latency in federated learning : a task-aware incentive scheme for smart industries
title_short When information freshness meets service latency in federated learning : a task-aware incentive scheme for smart industries
title_full When information freshness meets service latency in federated learning : a task-aware incentive scheme for smart industries
title_fullStr When information freshness meets service latency in federated learning : a task-aware incentive scheme for smart industries
title_full_unstemmed When information freshness meets service latency in federated learning : a task-aware incentive scheme for smart industries
title_sort when information freshness meets service latency in federated learning : a task-aware incentive scheme for smart industries
publishDate 2021
url https://hdl.handle.net/10356/152724
_version_ 1718928684258164736