FedART: A neural model integrating federated learning and adaptive resonance theory

Federated Learning (FL) has emerged as a promising paradigm for collaborative model training across distributed clients while preserving data privacy. However, prevailing FL approaches aggregate the clients’ local models into a global model through multi-round iterative parameter averaging. This lea...

Full description

Saved in:
Bibliographic Details
Main Authors: PATERIA, Shubham, SUBAGDJA, Budhitama, TAN, Ah-hwee
Format: text
Language:English
Published: Institutional Knowledge at Singapore Management University 2025
Subjects:
Online Access:https://ink.library.smu.edu.sg/sis_research/9623
https://ink.library.smu.edu.sg/context/sis_research/article/10623/viewcontent/FedART_av.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Singapore Management University
Language: English
id sg-smu-ink.sis_research-10623
record_format dspace
spelling sg-smu-ink.sis_research-106232024-11-23T15:36:23Z FedART: A neural model integrating federated learning and adaptive resonance theory PATERIA, Shubham SUBAGDJA, Budhitama TAN, Ah-hwee Federated Learning (FL) has emerged as a promising paradigm for collaborative model training across distributed clients while preserving data privacy. However, prevailing FL approaches aggregate the clients’ local models into a global model through multi-round iterative parameter averaging. This leads to the undesirable bias of the aggregated model towards certain clients in the presence of heterogeneous data distributions among the clients. Moreover, such approaches are restricted to supervised classification tasks and do not support unsupervised clustering. To address these limitations, we propose a novel one-shot FL approach called Federated Adaptive Resonance Theory (FedART) which leverages self-organizing Adaptive Resonance Theory (ART) models to learn category codes, where each code represents a cluster of similar data samples. In FedART, the clients learn to associate their private data with various local category codes. Under heterogeneity, the local codes across different clients represent heterogeneous data. In turn, a global model takes these local codes as inputs and aggregates them into global category codes, wherein heterogeneous client data is indirectly represented by distinctly encoded global codes, in contrast to the averaging out of parameters in the existing approaches. This enables the learned global model to handle heterogeneous data. In addition, FedART employs a universal learning mechanism to support both federated classification and clustering tasks. Our experiments conducted on various federated classification and clustering tasks show that FedART consistently outperforms state-of-the-art FL methods on data with heterogeneous distribution across clients. 2025-01-01T08:00:00Z text application/pdf https://ink.library.smu.edu.sg/sis_research/9623 info:doi/10.1016/j.neunet.2024.106845 https://ink.library.smu.edu.sg/context/sis_research/article/10623/viewcontent/FedART_av.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University Federated Learning Machine Learning Federated Clustering Adaptive Resonance Theory Artificial Intelligence and Robotics Databases and Information Systems
institution Singapore Management University
building SMU Libraries
continent Asia
country Singapore
Singapore
content_provider SMU Libraries
collection InK@SMU
language English
topic Federated Learning
Machine Learning
Federated Clustering
Adaptive Resonance Theory
Artificial Intelligence and Robotics
Databases and Information Systems
spellingShingle Federated Learning
Machine Learning
Federated Clustering
Adaptive Resonance Theory
Artificial Intelligence and Robotics
Databases and Information Systems
PATERIA, Shubham
SUBAGDJA, Budhitama
TAN, Ah-hwee
FedART: A neural model integrating federated learning and adaptive resonance theory
description Federated Learning (FL) has emerged as a promising paradigm for collaborative model training across distributed clients while preserving data privacy. However, prevailing FL approaches aggregate the clients’ local models into a global model through multi-round iterative parameter averaging. This leads to the undesirable bias of the aggregated model towards certain clients in the presence of heterogeneous data distributions among the clients. Moreover, such approaches are restricted to supervised classification tasks and do not support unsupervised clustering. To address these limitations, we propose a novel one-shot FL approach called Federated Adaptive Resonance Theory (FedART) which leverages self-organizing Adaptive Resonance Theory (ART) models to learn category codes, where each code represents a cluster of similar data samples. In FedART, the clients learn to associate their private data with various local category codes. Under heterogeneity, the local codes across different clients represent heterogeneous data. In turn, a global model takes these local codes as inputs and aggregates them into global category codes, wherein heterogeneous client data is indirectly represented by distinctly encoded global codes, in contrast to the averaging out of parameters in the existing approaches. This enables the learned global model to handle heterogeneous data. In addition, FedART employs a universal learning mechanism to support both federated classification and clustering tasks. Our experiments conducted on various federated classification and clustering tasks show that FedART consistently outperforms state-of-the-art FL methods on data with heterogeneous distribution across clients.
format text
author PATERIA, Shubham
SUBAGDJA, Budhitama
TAN, Ah-hwee
author_facet PATERIA, Shubham
SUBAGDJA, Budhitama
TAN, Ah-hwee
author_sort PATERIA, Shubham
title FedART: A neural model integrating federated learning and adaptive resonance theory
title_short FedART: A neural model integrating federated learning and adaptive resonance theory
title_full FedART: A neural model integrating federated learning and adaptive resonance theory
title_fullStr FedART: A neural model integrating federated learning and adaptive resonance theory
title_full_unstemmed FedART: A neural model integrating federated learning and adaptive resonance theory
title_sort fedart: a neural model integrating federated learning and adaptive resonance theory
publisher Institutional Knowledge at Singapore Management University
publishDate 2025
url https://ink.library.smu.edu.sg/sis_research/9623
https://ink.library.smu.edu.sg/context/sis_research/article/10623/viewcontent/FedART_av.pdf
_version_ 1816859170203238400