Hierarchical incentive mechanism design for federated machine learning in mobile networks

In recent years, the enhanced sensing and computation capabilities of Internet-of-Things (IoT) devices have opened the doors to several mobile crowdsensing applications. In mobile crowdsensing, a model owner announces a sensing task following which interested workers collect the required data. Howev...

Full description

Saved in:
Bibliographic Details
Main Authors: Lim, Bryan Wei Yang, Xiong, Zehui, Miao, Chunyan, Niyato, Dusit, Yang, Qiang, Leung, Cyril, Poor, H. Vincent
Other Authors: School of Computer Science and Engineering
Format: Article
Language:English
Published: 2020
Subjects:
Online Access:https://hdl.handle.net/10356/144299
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-144299
record_format dspace
spelling sg-ntu-dr.10356-1442992020-10-27T06:30:22Z Hierarchical incentive mechanism design for federated machine learning in mobile networks Lim, Bryan Wei Yang Xiong, Zehui Miao, Chunyan Niyato, Dusit Yang, Qiang Leung, Cyril Poor, H. Vincent School of Computer Science and Engineering Engineering::Computer science and engineering Data Models Artificial Intelligence In recent years, the enhanced sensing and computation capabilities of Internet-of-Things (IoT) devices have opened the doors to several mobile crowdsensing applications. In mobile crowdsensing, a model owner announces a sensing task following which interested workers collect the required data. However, in some cases, a model owner may have insufficient data samples to build an effective machine learning model. To this end, we propose a federated learning (FL)-based privacy-preserving approach to facilitate collaborative machine learning among multiple model owners in mobile crowdsensing. Our system model allows collaborative machine learning without compromising data privacy given that only the model parameters instead of the raw data are exchanged within the federation. However, there are two main challenges of incentive mismatches between workers and model owners, as well as among model owners. For the former, we leverage on the self-revealing mechanism in the contract theory under information asymmetry. For the latter, to ensure the stability of a federation through preventing free-riding attacks, we use the coalitional game theory approach that rewards model owners based on their marginal contributions. Considering the inherent hierarchical structure of the involved entities, we propose a hierarchical incentive mechanism framework. Using the backward induction, we first solve the contract formulation and then proceed to solve the coalitional game with the merge and split algorithm. The numerical results validate the performance efficiency of our proposed hierarchical incentive mechanism design, in terms of incentive compatibility of our contract design and fair payoffs of model owners in stable federation formation. Agency for Science, Technology and Research (A*STAR) Ministry of Education (MOE) National Research Foundation (NRF) Accepted version This research is supported, in part, by the National Research Foundation (NRF), Singapore, under Singapore Energy Market Authority (EMA), Energy Resilience, NRF2017EWTEP003- 041, NRF2015-NRF-ISF001-2277, Singapore NRF National Satellite of Excellence, Design Science and Technology for Secure Critical Infrastructure NSoE DeSTSCI2019- 0007, A*STAR-NTU-SUTD Joint Research Grant Call on Artificial Intelligence for the Future of Manufacturing RGANS1906, WASP/NTU M4082187 (4080), AI Singapore Programme AISG-GC-2019-003, NRF-NRFI05-2019- 0002, Singapore MOE Tier 2 MOE2014-T2-2-015 ARC4/15, MOE Tier 1 2017-T1-002-007 RG122/17 and U.S. National Science Foundation under Grant CCF-1908308. This research is also supported, in part, by the Alibaba-NTU JRI (Alibaba- NTU-AIR2019B1), NTU, Singapore. Qiang Yang also thanks the support of Hong Kong CERG grants 16209715 and 16244616. 2020-10-27T06:30:21Z 2020-10-27T06:30:21Z 2020 Journal Article Lim, B. W. Y., Xiong, Z., Miao, C., Niyato, D., Yang, Q., Leung, C., & Poor, H. V. (2020). Hierarchical incentive mechanism design for federated machine learning in mobile networks. IEEE Internet of Things Journal, 7(10), 9575-9588. doi:10.1109/JIOT.2020.2985694 2327-4662 https://hdl.handle.net/10356/144299 10.1109/JIOT.2020.2985694 10 7 9575 9588 en IEEE Internet of Things Journal © 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The published version is available at: https://doi.org/10.1109/JIOT.2020.2985694 application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Computer science and engineering
Data Models
Artificial Intelligence
spellingShingle Engineering::Computer science and engineering
Data Models
Artificial Intelligence
Lim, Bryan Wei Yang
Xiong, Zehui
Miao, Chunyan
Niyato, Dusit
Yang, Qiang
Leung, Cyril
Poor, H. Vincent
Hierarchical incentive mechanism design for federated machine learning in mobile networks
description In recent years, the enhanced sensing and computation capabilities of Internet-of-Things (IoT) devices have opened the doors to several mobile crowdsensing applications. In mobile crowdsensing, a model owner announces a sensing task following which interested workers collect the required data. However, in some cases, a model owner may have insufficient data samples to build an effective machine learning model. To this end, we propose a federated learning (FL)-based privacy-preserving approach to facilitate collaborative machine learning among multiple model owners in mobile crowdsensing. Our system model allows collaborative machine learning without compromising data privacy given that only the model parameters instead of the raw data are exchanged within the federation. However, there are two main challenges of incentive mismatches between workers and model owners, as well as among model owners. For the former, we leverage on the self-revealing mechanism in the contract theory under information asymmetry. For the latter, to ensure the stability of a federation through preventing free-riding attacks, we use the coalitional game theory approach that rewards model owners based on their marginal contributions. Considering the inherent hierarchical structure of the involved entities, we propose a hierarchical incentive mechanism framework. Using the backward induction, we first solve the contract formulation and then proceed to solve the coalitional game with the merge and split algorithm. The numerical results validate the performance efficiency of our proposed hierarchical incentive mechanism design, in terms of incentive compatibility of our contract design and fair payoffs of model owners in stable federation formation.
author2 School of Computer Science and Engineering
author_facet School of Computer Science and Engineering
Lim, Bryan Wei Yang
Xiong, Zehui
Miao, Chunyan
Niyato, Dusit
Yang, Qiang
Leung, Cyril
Poor, H. Vincent
format Article
author Lim, Bryan Wei Yang
Xiong, Zehui
Miao, Chunyan
Niyato, Dusit
Yang, Qiang
Leung, Cyril
Poor, H. Vincent
author_sort Lim, Bryan Wei Yang
title Hierarchical incentive mechanism design for federated machine learning in mobile networks
title_short Hierarchical incentive mechanism design for federated machine learning in mobile networks
title_full Hierarchical incentive mechanism design for federated machine learning in mobile networks
title_fullStr Hierarchical incentive mechanism design for federated machine learning in mobile networks
title_full_unstemmed Hierarchical incentive mechanism design for federated machine learning in mobile networks
title_sort hierarchical incentive mechanism design for federated machine learning in mobile networks
publishDate 2020
url https://hdl.handle.net/10356/144299
_version_ 1683494348464848896