When information freshness meets service latency in federated learning : a task-aware incentive scheme for smart industries
For several industrial applications, a sole data owner may lack sufficient training samples to train effective machine learning based models. As such, we propose a Federated Learning (FL) based approach to promote privacy-preserving collaborative machine learning for applications in smart industries...
Saved in:
Main Authors: | , , , , , , |
---|---|
Other Authors: | |
Format: | Article |
Language: | English |
Published: |
2021
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/152724 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-152724 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1527242021-12-09T08:13:25Z When information freshness meets service latency in federated learning : a task-aware incentive scheme for smart industries Lim, Bryan Wei Yang Xiong, Zehui Kang, Jiawei Niyato, Dusit Leung, Cyril Miao, Chunyan Shen, Xuemin School of Computer Science and Engineering Alibaba-NTU Joint Research Institute Joint NTU-UBC Research Centre of Excellence in Active Living for the Elderly (LILY) Engineering::Computer science and engineering Federated Learning Age of Information For several industrial applications, a sole data owner may lack sufficient training samples to train effective machine learning based models. As such, we propose a Federated Learning (FL) based approach to promote privacy-preserving collaborative machine learning for applications in smart industries. In our system model, a model owner initiates an FL task involving a group of workers, i.e., data owners, to perform model training on their locally stored data before transmitting the model updates for aggregation. There exists a tradeoff between service latency, i.e., the time taken for the training request to be completed, and Age of Information (AoI), i.e., the time elapsed between data aggregation from the deployed IIoT devices to completion of the FL based training. On one hand, if the data is collected only upon the model owner's request, the AoI is low. On the other hand, the service latency incurred is more significant. Furthermore, given that different training tasks may have varying AoI requirements, we propose a contract-theoretic task-aware incentive scheme that can be calibrated based on the weighted preferences of the model owner towards AoI and service latency. Performance evaluation validates the incentive compatibility of our contract amid information asymmetry, and shows the flexibility of our proposed scheme towards satisfying varying preferences of AoI and service latency. AI Singapore Energy Market Authority (EMA) Ministry of Education (MOE) Nanyang Technological University National Research Foundation (NRF) Accepted version This research is supported, in part, by Alibaba Group through Alibaba Innovative Research (AIR) Program and Alibaba-NTU Singapore Joint Research Institute (JRI), National Research Foundation, Singapore, under its AI Singapore Programme (AISG Award No: AISG-GC-2019-003), Singapore Energy Market Authority (EMA), Energy Resilience, under Grant NRF2017EWT-EP003-041; and in part by the Singapore NRF2015-NRF-ISF001-2277. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not reflect the views of National Research Foundation, Singapore. This research is also supported by WASP/NTU grant M4082187 (4080) and Singapore Ministry of Education (MOE) Tier 1 (RG16/20). 2021-12-09T08:13:25Z 2021-12-09T08:13:25Z 2020 Journal Article Lim, B. W. Y., Xiong, Z., Kang, J., Niyato, D., Leung, C., Miao, C. & Shen, X. (2020). When information freshness meets service latency in federated learning : a task-aware incentive scheme for smart industries. IEEE Transactions On Industrial Informatics, 18(1), 457-466. https://dx.doi.org/10.1109/TII.2020.3046028 1551-3203 https://hdl.handle.net/10356/152724 10.1109/TII.2020.3046028 2-s2.0-85098755141 1 18 457 466 en AISG-GC-2019-003 NRF2017EWT-EP003-041 NRF2015-NRF-ISF001-2277 M4082187 (4080) RG16/20 IEEE Transactions on Industrial Informatics © 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The published version is available at: https://doi.org/10.1109/TII.2020.3046028. application/pdf |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Engineering::Computer science and engineering Federated Learning Age of Information |
spellingShingle |
Engineering::Computer science and engineering Federated Learning Age of Information Lim, Bryan Wei Yang Xiong, Zehui Kang, Jiawei Niyato, Dusit Leung, Cyril Miao, Chunyan Shen, Xuemin When information freshness meets service latency in federated learning : a task-aware incentive scheme for smart industries |
description |
For several industrial applications, a sole data owner may lack sufficient training samples to train effective machine learning based models. As such, we propose a Federated Learning (FL) based approach to promote privacy-preserving collaborative machine learning for applications in smart industries. In our system model, a model owner initiates an FL task involving a group of workers, i.e., data owners, to perform model training on their locally stored data before transmitting the model updates for aggregation. There exists a tradeoff between service latency, i.e., the time taken for the training request to be completed, and Age of Information (AoI), i.e., the time elapsed between data aggregation from the deployed IIoT devices to completion of the FL based training. On one hand, if the data is collected only upon the model owner's request, the AoI is low. On the other hand, the service latency incurred is more significant. Furthermore, given that different training tasks may have varying AoI requirements, we propose a contract-theoretic task-aware incentive scheme that can be calibrated based on the weighted preferences of the model owner towards AoI and service latency. Performance evaluation validates the incentive compatibility of our contract amid information asymmetry, and shows the flexibility of our proposed scheme towards satisfying varying preferences of AoI and service latency. |
author2 |
School of Computer Science and Engineering |
author_facet |
School of Computer Science and Engineering Lim, Bryan Wei Yang Xiong, Zehui Kang, Jiawei Niyato, Dusit Leung, Cyril Miao, Chunyan Shen, Xuemin |
format |
Article |
author |
Lim, Bryan Wei Yang Xiong, Zehui Kang, Jiawei Niyato, Dusit Leung, Cyril Miao, Chunyan Shen, Xuemin |
author_sort |
Lim, Bryan Wei Yang |
title |
When information freshness meets service latency in federated learning : a task-aware incentive scheme for smart industries |
title_short |
When information freshness meets service latency in federated learning : a task-aware incentive scheme for smart industries |
title_full |
When information freshness meets service latency in federated learning : a task-aware incentive scheme for smart industries |
title_fullStr |
When information freshness meets service latency in federated learning : a task-aware incentive scheme for smart industries |
title_full_unstemmed |
When information freshness meets service latency in federated learning : a task-aware incentive scheme for smart industries |
title_sort |
when information freshness meets service latency in federated learning : a task-aware incentive scheme for smart industries |
publishDate |
2021 |
url |
https://hdl.handle.net/10356/152724 |
_version_ |
1718928684258164736 |