FlGan: GAN-based unbiased federated learning under non-IID settings

Federated Learning (FL) suffers from low convergence and significant accuracy loss due to local biases caused by non-Independent and Identically Distributed (non-IID) data. To enhance the non-IID FL performance, a straightforward idea is to leverage the Generative Adversarial Network (GAN) to mitiga...

Full description

Saved in:
Bibliographic Details
Main Authors: MA, Zhuoran, LIU, Yang, MIAO, Yinbin, XU, Guowen, LIU, Ximeng, MA, Jianfeng, DENG, Robert H.
Format: text
Language:English
Published: Institutional Knowledge at Singapore Management University 2024
Subjects:
GAN
Online Access:https://ink.library.smu.edu.sg/sis_research/9639
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Singapore Management University
Language: English
id sg-smu-ink.sis_research-10639
record_format dspace
spelling sg-smu-ink.sis_research-106392024-11-23T15:18:03Z FlGan: GAN-based unbiased federated learning under non-IID settings MA, Zhuoran LIU, Yang MIAO, Yinbin XU, Guowen LIU, Ximeng MA, Jianfeng DENG, Robert H. Federated Learning (FL) suffers from low convergence and significant accuracy loss due to local biases caused by non-Independent and Identically Distributed (non-IID) data. To enhance the non-IID FL performance, a straightforward idea is to leverage the Generative Adversarial Network (GAN) to mitigate local biases using synthesized samples. Unfortunately, existing GAN-based solutions have inherent limitations, which do not support non-IID data and even compromise user privacy. To tackle the above issues, we propose a GAN-based unbiased FL scheme, called FlGan , to mitigate local biases using synthesized samples generated by GAN while preserving user-level privacy in the FL setting. Specifically, FlGan first presents a federated GAN algorithm using the divide-and-conquer strategy that eliminates the problem of model collapse in non-IID settings. To guarantee user-level privacy, FlGan then exploits Fully Homomorphic Encryption (FHE) to design the privacy-preserving GAN augmentation method for the unbiased FL. Extensive experiments show that FlGan achieves unbiased FL with 10%−60% accuracy improvement compared with two state-of-the-art FL baselines (i.e., FedAvg and FedSGD) trained under different non-IID settings. The FHE-based privacy guarantees only cost about 0.53% of the total overhead in FlGan. 2024-04-02T07:00:00Z text https://ink.library.smu.edu.sg/sis_research/9639 info:doi/10.1109/TKDE.2023.3309858 Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University Federated learning fully homomorphic encryption GAN non-IID user-level privacy Databases and Information Systems Information Security
institution Singapore Management University
building SMU Libraries
continent Asia
country Singapore
Singapore
content_provider SMU Libraries
collection InK@SMU
language English
topic Federated learning
fully homomorphic encryption
GAN
non-IID
user-level privacy
Databases and Information Systems
Information Security
spellingShingle Federated learning
fully homomorphic encryption
GAN
non-IID
user-level privacy
Databases and Information Systems
Information Security
MA, Zhuoran
LIU, Yang
MIAO, Yinbin
XU, Guowen
LIU, Ximeng
MA, Jianfeng
DENG, Robert H.
FlGan: GAN-based unbiased federated learning under non-IID settings
description Federated Learning (FL) suffers from low convergence and significant accuracy loss due to local biases caused by non-Independent and Identically Distributed (non-IID) data. To enhance the non-IID FL performance, a straightforward idea is to leverage the Generative Adversarial Network (GAN) to mitigate local biases using synthesized samples. Unfortunately, existing GAN-based solutions have inherent limitations, which do not support non-IID data and even compromise user privacy. To tackle the above issues, we propose a GAN-based unbiased FL scheme, called FlGan , to mitigate local biases using synthesized samples generated by GAN while preserving user-level privacy in the FL setting. Specifically, FlGan first presents a federated GAN algorithm using the divide-and-conquer strategy that eliminates the problem of model collapse in non-IID settings. To guarantee user-level privacy, FlGan then exploits Fully Homomorphic Encryption (FHE) to design the privacy-preserving GAN augmentation method for the unbiased FL. Extensive experiments show that FlGan achieves unbiased FL with 10%−60% accuracy improvement compared with two state-of-the-art FL baselines (i.e., FedAvg and FedSGD) trained under different non-IID settings. The FHE-based privacy guarantees only cost about 0.53% of the total overhead in FlGan.
format text
author MA, Zhuoran
LIU, Yang
MIAO, Yinbin
XU, Guowen
LIU, Ximeng
MA, Jianfeng
DENG, Robert H.
author_facet MA, Zhuoran
LIU, Yang
MIAO, Yinbin
XU, Guowen
LIU, Ximeng
MA, Jianfeng
DENG, Robert H.
author_sort MA, Zhuoran
title FlGan: GAN-based unbiased federated learning under non-IID settings
title_short FlGan: GAN-based unbiased federated learning under non-IID settings
title_full FlGan: GAN-based unbiased federated learning under non-IID settings
title_fullStr FlGan: GAN-based unbiased federated learning under non-IID settings
title_full_unstemmed FlGan: GAN-based unbiased federated learning under non-IID settings
title_sort flgan: gan-based unbiased federated learning under non-iid settings
publisher Institutional Knowledge at Singapore Management University
publishDate 2024
url https://ink.library.smu.edu.sg/sis_research/9639
_version_ 1816859174911344640