Lead federated neuromorphic learning for wireless edge artificial intelligence
In order to realize the full potential of wireless edge artificial intelligence (AI), very large and diverse datasets will often be required for energy-demanding model training on resource-constrained edge devices. This paper proposes a lead federated neuromorphic learning (LFNL) technique, which is...
Saved in:
Main Authors: | , , , , , , |
---|---|
Other Authors: | |
Format: | Article |
Language: | English |
Published: |
2023
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/167993 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-167993 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1679932023-05-19T15:36:21Z Lead federated neuromorphic learning for wireless edge artificial intelligence Yang, Helin Lam, Kwok-Yan Xiao, Liang Xiong, Zehui Hu, Hao Niyato, Dusit Poor, H. Vincent School of Computer Science and Engineering School of Electrical and Electronic Engineering Strategic Centre for Research in Privacy-Preserving Technologies and Systems Engineering::Computer science and engineering Artificial Intelligence Brain In order to realize the full potential of wireless edge artificial intelligence (AI), very large and diverse datasets will often be required for energy-demanding model training on resource-constrained edge devices. This paper proposes a lead federated neuromorphic learning (LFNL) technique, which is a decentralized energy-efficient brain-inspired computing method based on spiking neural networks. The proposed technique will enable edge devices to exploit brain-like biophysiological structure to collaboratively train a global model while helping preserve privacy. Experimental results show that, under the situation of uneven dataset distribution among edge devices, LFNL achieves a comparable recognition accuracy to existing edge AI techniques, while substantially reducing data traffic by >3.5× and computational latency by >2.0×. Furthermore, LFNL significantly reduces energy consumption by >4.5× compared to standard federated learning with a slight accuracy loss up to 1.5%. Therefore, the proposed LFNL can facilitate the development of brain-inspired computing and edge AI. Ministry of Education (MOE) Nanyang Technological University National Research Foundation (NRF) Published version This research is supported by the National Research Foundation, Singapore under its Strategic Capability Research Centres Funding Initiative: Strategic Centre for Research in Privacy-Preserving Technologies & Systems; Nanyang Technological University (NTU) Startup Grant, Singapore Ministry of Education Academic Research Fund; the National Research Foundation, Singapore and Infocomm Media Development Authority under its Future Communications Research & Development Programme; the SUTD SRG-ISTD-2021-165; U.S. National Science Foundation under Grant CCF-1908308; Singapore Ministry of Education (MOE) Tier 1 (RG16/20); and National Natural Science Foundation of China under Grant U21A20444 and 61971366. 2023-05-18T08:48:33Z 2023-05-18T08:48:33Z 2022 Journal Article Yang, H., Lam, K., Xiao, L., Xiong, Z., Hu, H., Niyato, D. & Poor, H. V. (2022). Lead federated neuromorphic learning for wireless edge artificial intelligence. Nature Communications, 13(1), 4269-. https://dx.doi.org/10.1038/s41467-022-32020-w 2041-1723 https://hdl.handle.net/10356/167993 10.1038/s41467-022-32020-w 35879326 2-s2.0-85134730774 1 13 4269 en RG16/20 NTU-SUG Nature Communications © 2022 The Author(s). This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/ licenses/by/4.0/. application/pdf |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Engineering::Computer science and engineering Artificial Intelligence Brain |
spellingShingle |
Engineering::Computer science and engineering Artificial Intelligence Brain Yang, Helin Lam, Kwok-Yan Xiao, Liang Xiong, Zehui Hu, Hao Niyato, Dusit Poor, H. Vincent Lead federated neuromorphic learning for wireless edge artificial intelligence |
description |
In order to realize the full potential of wireless edge artificial intelligence (AI), very large and diverse datasets will often be required for energy-demanding model training on resource-constrained edge devices. This paper proposes a lead federated neuromorphic learning (LFNL) technique, which is a decentralized energy-efficient brain-inspired computing method based on spiking neural networks. The proposed technique will enable edge devices to exploit brain-like biophysiological structure to collaboratively train a global model while helping preserve privacy. Experimental results show that, under the situation of uneven dataset distribution among edge devices, LFNL achieves a comparable recognition accuracy to existing edge AI techniques, while substantially reducing data traffic by >3.5× and computational latency by >2.0×. Furthermore, LFNL significantly reduces energy consumption by >4.5× compared to standard federated learning with a slight accuracy loss up to 1.5%. Therefore, the proposed LFNL can facilitate the development of brain-inspired computing and edge AI. |
author2 |
School of Computer Science and Engineering |
author_facet |
School of Computer Science and Engineering Yang, Helin Lam, Kwok-Yan Xiao, Liang Xiong, Zehui Hu, Hao Niyato, Dusit Poor, H. Vincent |
format |
Article |
author |
Yang, Helin Lam, Kwok-Yan Xiao, Liang Xiong, Zehui Hu, Hao Niyato, Dusit Poor, H. Vincent |
author_sort |
Yang, Helin |
title |
Lead federated neuromorphic learning for wireless edge artificial intelligence |
title_short |
Lead federated neuromorphic learning for wireless edge artificial intelligence |
title_full |
Lead federated neuromorphic learning for wireless edge artificial intelligence |
title_fullStr |
Lead federated neuromorphic learning for wireless edge artificial intelligence |
title_full_unstemmed |
Lead federated neuromorphic learning for wireless edge artificial intelligence |
title_sort |
lead federated neuromorphic learning for wireless edge artificial intelligence |
publishDate |
2023 |
url |
https://hdl.handle.net/10356/167993 |
_version_ |
1772828985283051520 |