FedART: A neural model integrating federated learning and adaptive resonance theory
Federated Learning (FL) has emerged as a promising paradigm for collaborative model training across distributed clients while preserving data privacy. However, prevailing FL approaches aggregate the clients’ local models into a global model through multi-round iterative parameter averaging. This lea...
Saved in:
Main Authors: | , , |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2025
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/9623 https://ink.library.smu.edu.sg/context/sis_research/article/10623/viewcontent/FedART_av.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
id |
sg-smu-ink.sis_research-10623 |
---|---|
record_format |
dspace |
spelling |
sg-smu-ink.sis_research-106232024-11-23T15:36:23Z FedART: A neural model integrating federated learning and adaptive resonance theory PATERIA, Shubham SUBAGDJA, Budhitama TAN, Ah-hwee Federated Learning (FL) has emerged as a promising paradigm for collaborative model training across distributed clients while preserving data privacy. However, prevailing FL approaches aggregate the clients’ local models into a global model through multi-round iterative parameter averaging. This leads to the undesirable bias of the aggregated model towards certain clients in the presence of heterogeneous data distributions among the clients. Moreover, such approaches are restricted to supervised classification tasks and do not support unsupervised clustering. To address these limitations, we propose a novel one-shot FL approach called Federated Adaptive Resonance Theory (FedART) which leverages self-organizing Adaptive Resonance Theory (ART) models to learn category codes, where each code represents a cluster of similar data samples. In FedART, the clients learn to associate their private data with various local category codes. Under heterogeneity, the local codes across different clients represent heterogeneous data. In turn, a global model takes these local codes as inputs and aggregates them into global category codes, wherein heterogeneous client data is indirectly represented by distinctly encoded global codes, in contrast to the averaging out of parameters in the existing approaches. This enables the learned global model to handle heterogeneous data. In addition, FedART employs a universal learning mechanism to support both federated classification and clustering tasks. Our experiments conducted on various federated classification and clustering tasks show that FedART consistently outperforms state-of-the-art FL methods on data with heterogeneous distribution across clients. 2025-01-01T08:00:00Z text application/pdf https://ink.library.smu.edu.sg/sis_research/9623 info:doi/10.1016/j.neunet.2024.106845 https://ink.library.smu.edu.sg/context/sis_research/article/10623/viewcontent/FedART_av.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University Federated Learning Machine Learning Federated Clustering Adaptive Resonance Theory Artificial Intelligence and Robotics Databases and Information Systems |
institution |
Singapore Management University |
building |
SMU Libraries |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
SMU Libraries |
collection |
InK@SMU |
language |
English |
topic |
Federated Learning Machine Learning Federated Clustering Adaptive Resonance Theory Artificial Intelligence and Robotics Databases and Information Systems |
spellingShingle |
Federated Learning Machine Learning Federated Clustering Adaptive Resonance Theory Artificial Intelligence and Robotics Databases and Information Systems PATERIA, Shubham SUBAGDJA, Budhitama TAN, Ah-hwee FedART: A neural model integrating federated learning and adaptive resonance theory |
description |
Federated Learning (FL) has emerged as a promising paradigm for collaborative model training across distributed clients while preserving data privacy. However, prevailing FL approaches aggregate the clients’ local models into a global model through multi-round iterative parameter averaging. This leads to the undesirable bias of the aggregated model towards certain clients in the presence of heterogeneous data distributions among the clients. Moreover, such approaches are restricted to supervised classification tasks and do not support unsupervised clustering. To address these limitations, we propose a novel one-shot FL approach called Federated Adaptive Resonance Theory (FedART) which leverages self-organizing Adaptive Resonance Theory (ART) models to learn category codes, where each code represents a cluster of similar data samples. In FedART, the clients learn to associate their private data with various local category codes. Under heterogeneity, the local codes across different clients represent heterogeneous data. In turn, a global model takes these local codes as inputs and aggregates them into global category codes, wherein heterogeneous client data is indirectly represented by distinctly encoded global codes, in contrast to the averaging out of parameters in the existing approaches. This enables the learned global model to handle heterogeneous data. In addition, FedART employs a universal learning mechanism to support both federated classification and clustering tasks. Our experiments conducted on various federated classification and clustering tasks show that FedART consistently outperforms state-of-the-art FL methods on data with heterogeneous distribution across clients. |
format |
text |
author |
PATERIA, Shubham SUBAGDJA, Budhitama TAN, Ah-hwee |
author_facet |
PATERIA, Shubham SUBAGDJA, Budhitama TAN, Ah-hwee |
author_sort |
PATERIA, Shubham |
title |
FedART: A neural model integrating federated learning and adaptive resonance theory |
title_short |
FedART: A neural model integrating federated learning and adaptive resonance theory |
title_full |
FedART: A neural model integrating federated learning and adaptive resonance theory |
title_fullStr |
FedART: A neural model integrating federated learning and adaptive resonance theory |
title_full_unstemmed |
FedART: A neural model integrating federated learning and adaptive resonance theory |
title_sort |
fedart: a neural model integrating federated learning and adaptive resonance theory |
publisher |
Institutional Knowledge at Singapore Management University |
publishDate |
2025 |
url |
https://ink.library.smu.edu.sg/sis_research/9623 https://ink.library.smu.edu.sg/context/sis_research/article/10623/viewcontent/FedART_av.pdf |
_version_ |
1816859170203238400 |