FlGan: GAN-based unbiased federated learning under non-IID settings
Federated Learning (FL) suffers from low convergence and significant accuracy loss due to local biases caused by non-Independent and Identically Distributed (non-IID) data. To enhance the non-IID FL performance, a straightforward idea is to leverage the Generative Adversarial Network (GAN) to mitiga...
Saved in:
Main Authors: | , , , , , , |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2024
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/9639 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
id |
sg-smu-ink.sis_research-10639 |
---|---|
record_format |
dspace |
spelling |
sg-smu-ink.sis_research-106392024-11-23T15:18:03Z FlGan: GAN-based unbiased federated learning under non-IID settings MA, Zhuoran LIU, Yang MIAO, Yinbin XU, Guowen LIU, Ximeng MA, Jianfeng DENG, Robert H. Federated Learning (FL) suffers from low convergence and significant accuracy loss due to local biases caused by non-Independent and Identically Distributed (non-IID) data. To enhance the non-IID FL performance, a straightforward idea is to leverage the Generative Adversarial Network (GAN) to mitigate local biases using synthesized samples. Unfortunately, existing GAN-based solutions have inherent limitations, which do not support non-IID data and even compromise user privacy. To tackle the above issues, we propose a GAN-based unbiased FL scheme, called FlGan , to mitigate local biases using synthesized samples generated by GAN while preserving user-level privacy in the FL setting. Specifically, FlGan first presents a federated GAN algorithm using the divide-and-conquer strategy that eliminates the problem of model collapse in non-IID settings. To guarantee user-level privacy, FlGan then exploits Fully Homomorphic Encryption (FHE) to design the privacy-preserving GAN augmentation method for the unbiased FL. Extensive experiments show that FlGan achieves unbiased FL with 10%−60% accuracy improvement compared with two state-of-the-art FL baselines (i.e., FedAvg and FedSGD) trained under different non-IID settings. The FHE-based privacy guarantees only cost about 0.53% of the total overhead in FlGan. 2024-04-02T07:00:00Z text https://ink.library.smu.edu.sg/sis_research/9639 info:doi/10.1109/TKDE.2023.3309858 Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University Federated learning fully homomorphic encryption GAN non-IID user-level privacy Databases and Information Systems Information Security |
institution |
Singapore Management University |
building |
SMU Libraries |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
SMU Libraries |
collection |
InK@SMU |
language |
English |
topic |
Federated learning fully homomorphic encryption GAN non-IID user-level privacy Databases and Information Systems Information Security |
spellingShingle |
Federated learning fully homomorphic encryption GAN non-IID user-level privacy Databases and Information Systems Information Security MA, Zhuoran LIU, Yang MIAO, Yinbin XU, Guowen LIU, Ximeng MA, Jianfeng DENG, Robert H. FlGan: GAN-based unbiased federated learning under non-IID settings |
description |
Federated Learning (FL) suffers from low convergence and significant accuracy loss due to local biases caused by non-Independent and Identically Distributed (non-IID) data. To enhance the non-IID FL performance, a straightforward idea is to leverage the Generative Adversarial Network (GAN) to mitigate local biases using synthesized samples. Unfortunately, existing GAN-based solutions have inherent limitations, which do not support non-IID data and even compromise user privacy. To tackle the above issues, we propose a GAN-based unbiased FL scheme, called FlGan , to mitigate local biases using synthesized samples generated by GAN while preserving user-level privacy in the FL setting. Specifically, FlGan first presents a federated GAN algorithm using the divide-and-conquer strategy that eliminates the problem of model collapse in non-IID settings. To guarantee user-level privacy, FlGan then exploits Fully Homomorphic Encryption (FHE) to design the privacy-preserving GAN augmentation method for the unbiased FL. Extensive experiments show that FlGan achieves unbiased FL with 10%−60% accuracy improvement compared with two state-of-the-art FL baselines (i.e., FedAvg and FedSGD) trained under different non-IID settings. The FHE-based privacy guarantees only cost about 0.53% of the total overhead in FlGan. |
format |
text |
author |
MA, Zhuoran LIU, Yang MIAO, Yinbin XU, Guowen LIU, Ximeng MA, Jianfeng DENG, Robert H. |
author_facet |
MA, Zhuoran LIU, Yang MIAO, Yinbin XU, Guowen LIU, Ximeng MA, Jianfeng DENG, Robert H. |
author_sort |
MA, Zhuoran |
title |
FlGan: GAN-based unbiased federated learning under non-IID settings |
title_short |
FlGan: GAN-based unbiased federated learning under non-IID settings |
title_full |
FlGan: GAN-based unbiased federated learning under non-IID settings |
title_fullStr |
FlGan: GAN-based unbiased federated learning under non-IID settings |
title_full_unstemmed |
FlGan: GAN-based unbiased federated learning under non-IID settings |
title_sort |
flgan: gan-based unbiased federated learning under non-iid settings |
publisher |
Institutional Knowledge at Singapore Management University |
publishDate |
2024 |
url |
https://ink.library.smu.edu.sg/sis_research/9639 |
_version_ |
1816859174911344640 |