Robust incentive mechanisms for efficient and secure coded edge intelligence
Coupled with reliable wireless communication technologies, the IoT devices can serve as important sources of sensor data for data-driven Artificial Intelligence (AI) applications. Instead of a single cloud server handling the large-scale datasets individually, distributed edge computing emerges as a...
Saved in:
Main Author: | |
---|---|
Other Authors: | |
Format: | Thesis-Doctor of Philosophy |
Language: | English |
Published: |
Nanyang Technological University
2023
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/164596 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-164596 |
---|---|
record_format |
dspace |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Engineering::Computer science and engineering |
spellingShingle |
Engineering::Computer science and engineering Ng, Jer Shyuan Robust incentive mechanisms for efficient and secure coded edge intelligence |
description |
Coupled with reliable wireless communication technologies, the IoT devices can serve as important sources of sensor data for data-driven Artificial Intelligence (AI) applications. Instead of a single cloud server handling the large-scale datasets individually, distributed edge computing emerges as a more viable solution. The confluence of edge computing and AI technologies is known as \emph{edge intelligence}. To mitigate the challenges of distributed computing, coded distributed computing (CDC), i.e., a combination of coding theoretic techniques and distributed computing, has been proposed. In particular, CDC systems reduce communication load and alleviate the straggler effects. The implementation of CDC schemes in the distributed edge computing networks is essential in providing us with regular streams of valuable insights in the delivery of experiences, products and services. While the implementation of CDC schemes in the distributed edge computing networks is envisioned to enable a scalable and efficient edge intelligence environment that captures insights provided by the large number of heterogeneous edge nodes, the willingness to participate in the CDC tasks and the amount of resources (computation, communication, data, etc.) differ among the edge nodes.
In this thesis, I first introduce the concept of CDC and provide a comprehensive survey of the development and state-of-the-art of CDC schemes. Although coding techniques have shown their effectiveness in solving the challenges of traditional distributed computing systems, there are several challenges that need to be addressed for large-scale implementations over the distributed edge computing networks that involves millions of heterogeneous edge nodes. One of the important issues is the incentive mismatch among the different entities in the networks. The different entities aim to maximize their own utilities and thus may not facilitate the completion of the CDC tasks.
In consideration of the heterogeneity of the edge nodes, i.e., computational and communication capabilities as well as storage capacities, I propose incentive mechanism designs to encourage the edge nodes to facilitate the CDC tasks over the distributed edge computing networks. One of the research works is the implementation of a double auction mechanism in the coded vehicular edge computing network. While the double auction mechanism matches the edge servers with the required resources to the vehicles and determines the prices that the vehicles need to pay for the resources of the edge servers, the simulation results show that the double auction mechanism also satisfies the properties of individual rationality, incentive compatibility and budget-balance. In addition, I propose a Serverless Hierarchical Federated Learning (SHFL) framework that capitalizes the benefits of improving the reliability of the Federated Learning (FL) network and reducing the risk of single point of failure. To improve the network efficiency, I introduce a reputation aware hedonic coalition formation scheme to model the cluster formation in the SHFL network. Simulation results show that the FL workers make decisions to maximize their own utilities, regardless of the effect of their decisions on other FL workers. The hedonic coalition formation algorithm converges to a Nash-stable partition. By considering the resource inefficiency and utilization rate of the various edge nodes, effective resource allocation frameworks and incentive mechanisms can be designed to ensure successful implementation of the coding schemes in practical distributed edge computing networks. Finally, I discuss several research directions for future works. |
author2 |
Miao Chun Yan |
author_facet |
Miao Chun Yan Ng, Jer Shyuan |
format |
Thesis-Doctor of Philosophy |
author |
Ng, Jer Shyuan |
author_sort |
Ng, Jer Shyuan |
title |
Robust incentive mechanisms for efficient and secure coded edge intelligence |
title_short |
Robust incentive mechanisms for efficient and secure coded edge intelligence |
title_full |
Robust incentive mechanisms for efficient and secure coded edge intelligence |
title_fullStr |
Robust incentive mechanisms for efficient and secure coded edge intelligence |
title_full_unstemmed |
Robust incentive mechanisms for efficient and secure coded edge intelligence |
title_sort |
robust incentive mechanisms for efficient and secure coded edge intelligence |
publisher |
Nanyang Technological University |
publishDate |
2023 |
url |
https://hdl.handle.net/10356/164596 |
_version_ |
1759858087487864832 |
spelling |
sg-ntu-dr.10356-1645962023-03-06T07:30:04Z Robust incentive mechanisms for efficient and secure coded edge intelligence Ng, Jer Shyuan Miao Chun Yan School of Computer Science and Engineering Alibaba-NTU Joint Research Institute ASCYMiao@ntu.edu.sg Engineering::Computer science and engineering Coupled with reliable wireless communication technologies, the IoT devices can serve as important sources of sensor data for data-driven Artificial Intelligence (AI) applications. Instead of a single cloud server handling the large-scale datasets individually, distributed edge computing emerges as a more viable solution. The confluence of edge computing and AI technologies is known as \emph{edge intelligence}. To mitigate the challenges of distributed computing, coded distributed computing (CDC), i.e., a combination of coding theoretic techniques and distributed computing, has been proposed. In particular, CDC systems reduce communication load and alleviate the straggler effects. The implementation of CDC schemes in the distributed edge computing networks is essential in providing us with regular streams of valuable insights in the delivery of experiences, products and services. While the implementation of CDC schemes in the distributed edge computing networks is envisioned to enable a scalable and efficient edge intelligence environment that captures insights provided by the large number of heterogeneous edge nodes, the willingness to participate in the CDC tasks and the amount of resources (computation, communication, data, etc.) differ among the edge nodes. In this thesis, I first introduce the concept of CDC and provide a comprehensive survey of the development and state-of-the-art of CDC schemes. Although coding techniques have shown their effectiveness in solving the challenges of traditional distributed computing systems, there are several challenges that need to be addressed for large-scale implementations over the distributed edge computing networks that involves millions of heterogeneous edge nodes. One of the important issues is the incentive mismatch among the different entities in the networks. The different entities aim to maximize their own utilities and thus may not facilitate the completion of the CDC tasks. In consideration of the heterogeneity of the edge nodes, i.e., computational and communication capabilities as well as storage capacities, I propose incentive mechanism designs to encourage the edge nodes to facilitate the CDC tasks over the distributed edge computing networks. One of the research works is the implementation of a double auction mechanism in the coded vehicular edge computing network. While the double auction mechanism matches the edge servers with the required resources to the vehicles and determines the prices that the vehicles need to pay for the resources of the edge servers, the simulation results show that the double auction mechanism also satisfies the properties of individual rationality, incentive compatibility and budget-balance. In addition, I propose a Serverless Hierarchical Federated Learning (SHFL) framework that capitalizes the benefits of improving the reliability of the Federated Learning (FL) network and reducing the risk of single point of failure. To improve the network efficiency, I introduce a reputation aware hedonic coalition formation scheme to model the cluster formation in the SHFL network. Simulation results show that the FL workers make decisions to maximize their own utilities, regardless of the effect of their decisions on other FL workers. The hedonic coalition formation algorithm converges to a Nash-stable partition. By considering the resource inefficiency and utilization rate of the various edge nodes, effective resource allocation frameworks and incentive mechanisms can be designed to ensure successful implementation of the coding schemes in practical distributed edge computing networks. Finally, I discuss several research directions for future works. Doctor of Philosophy 2023-02-06T07:37:48Z 2023-02-06T07:37:48Z 2023 Thesis-Doctor of Philosophy Ng, J. S. (2023). Robust incentive mechanisms for efficient and secure coded edge intelligence. Doctoral thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/164596 https://hdl.handle.net/10356/164596 10.32657/10356/164596 en This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0). application/pdf Nanyang Technological University |