Privacy-preserving asynchronous federated learning under non-IID settings

• Main Authors: MIAO, Yinbin, KUANG, Da, LI, Xinghua, XU, Shujiang, LI, Hongwei, CHOO, Kim-Kwang Raymond, DENG, Robert H.
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2024
• Subjects: Adaptation models; asynchronous; Computational modeling; Data models; Federated learning; Non-IID; Optimization; Privacy; Privacy-preserving; Vectors; Information Security
• Online Access: https://ink.library.smu.edu.sg/sis_research/8819
• Institution: Singapore Management University

To address the challenges posed by data silos and heterogeneity in distributed machine learning, privacy-preserving asynchronous Federated Learning (FL) has been extensively explored in academic and industrial fields. However, existing privacy-preserving asynchronous FL schemes still suffer from the problem of low model accuracy caused by inconsistency between delayed model updates and current model updates, and even cannot adapt well to Non-Independent and Identically Distributed (Non-IID) settings. To address these issues, we propose a Privacy-preserving Asynchronous Federated Learning based on the alternating direction multiplier method (PAFed), which is able to achieve high-accuracy models in Non-IID settings. Specifically, we utilize vector projection techniques to correct the inconsistency between delayed model updates and current model updates, thereby reducing the impact of delayed model updates on the aggregation of current model updates. Additionally, we employ an optimization method based on alternating direction multipliers to adapt the Non-IID settings to further enhance the global model accuracy. Finally, through extensive experiments, we demonstrate that our scheme improves the model accuracy by up to 12.53% when compared with current state-of-the-art solution FedADMM.