Lead federated neuromorphic learning for wireless edge artificial intelligence

In order to realize the full potential of wireless edge artificial intelligence (AI), very large and diverse datasets will often be required for energy-demanding model training on resource-constrained edge devices. This paper proposes a lead federated neuromorphic learning (LFNL) technique, which is...

Full description

Saved in:
Bibliographic Details
Main Authors: Yang, Helin, Lam, Kwok-Yan, Xiao, Liang, Xiong, Zehui, Hu, Hao, Niyato, Dusit, Poor, H. Vincent
Other Authors: School of Computer Science and Engineering
Format: Article
Language:English
Published: 2023
Subjects:
Online Access:https://hdl.handle.net/10356/167993
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-167993
record_format dspace
spelling sg-ntu-dr.10356-1679932023-05-19T15:36:21Z Lead federated neuromorphic learning for wireless edge artificial intelligence Yang, Helin Lam, Kwok-Yan Xiao, Liang Xiong, Zehui Hu, Hao Niyato, Dusit Poor, H. Vincent School of Computer Science and Engineering School of Electrical and Electronic Engineering Strategic Centre for Research in Privacy-Preserving Technologies and Systems Engineering::Computer science and engineering Artificial Intelligence Brain In order to realize the full potential of wireless edge artificial intelligence (AI), very large and diverse datasets will often be required for energy-demanding model training on resource-constrained edge devices. This paper proposes a lead federated neuromorphic learning (LFNL) technique, which is a decentralized energy-efficient brain-inspired computing method based on spiking neural networks. The proposed technique will enable edge devices to exploit brain-like biophysiological structure to collaboratively train a global model while helping preserve privacy. Experimental results show that, under the situation of uneven dataset distribution among edge devices, LFNL achieves a comparable recognition accuracy to existing edge AI techniques, while substantially reducing data traffic by >3.5× and computational latency by >2.0×. Furthermore, LFNL significantly reduces energy consumption by >4.5× compared to standard federated learning with a slight accuracy loss up to 1.5%. Therefore, the proposed LFNL can facilitate the development of brain-inspired computing and edge AI. Ministry of Education (MOE) Nanyang Technological University National Research Foundation (NRF) Published version This research is supported by the National Research Foundation, Singapore under its Strategic Capability Research Centres Funding Initiative: Strategic Centre for Research in Privacy-Preserving Technologies & Systems; Nanyang Technological University (NTU) Startup Grant, Singapore Ministry of Education Academic Research Fund; the National Research Foundation, Singapore and Infocomm Media Development Authority under its Future Communications Research & Development Programme; the SUTD SRG-ISTD-2021-165; U.S. National Science Foundation under Grant CCF-1908308; Singapore Ministry of Education (MOE) Tier 1 (RG16/20); and National Natural Science Foundation of China under Grant U21A20444 and 61971366. 2023-05-18T08:48:33Z 2023-05-18T08:48:33Z 2022 Journal Article Yang, H., Lam, K., Xiao, L., Xiong, Z., Hu, H., Niyato, D. & Poor, H. V. (2022). Lead federated neuromorphic learning for wireless edge artificial intelligence. Nature Communications, 13(1), 4269-. https://dx.doi.org/10.1038/s41467-022-32020-w 2041-1723 https://hdl.handle.net/10356/167993 10.1038/s41467-022-32020-w 35879326 2-s2.0-85134730774 1 13 4269 en RG16/20 NTU-SUG Nature Communications © 2022 The Author(s). This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/ licenses/by/4.0/. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Computer science and engineering
Artificial Intelligence
Brain
spellingShingle Engineering::Computer science and engineering
Artificial Intelligence
Brain
Yang, Helin
Lam, Kwok-Yan
Xiao, Liang
Xiong, Zehui
Hu, Hao
Niyato, Dusit
Poor, H. Vincent
Lead federated neuromorphic learning for wireless edge artificial intelligence
description In order to realize the full potential of wireless edge artificial intelligence (AI), very large and diverse datasets will often be required for energy-demanding model training on resource-constrained edge devices. This paper proposes a lead federated neuromorphic learning (LFNL) technique, which is a decentralized energy-efficient brain-inspired computing method based on spiking neural networks. The proposed technique will enable edge devices to exploit brain-like biophysiological structure to collaboratively train a global model while helping preserve privacy. Experimental results show that, under the situation of uneven dataset distribution among edge devices, LFNL achieves a comparable recognition accuracy to existing edge AI techniques, while substantially reducing data traffic by >3.5× and computational latency by >2.0×. Furthermore, LFNL significantly reduces energy consumption by >4.5× compared to standard federated learning with a slight accuracy loss up to 1.5%. Therefore, the proposed LFNL can facilitate the development of brain-inspired computing and edge AI.
author2 School of Computer Science and Engineering
author_facet School of Computer Science and Engineering
Yang, Helin
Lam, Kwok-Yan
Xiao, Liang
Xiong, Zehui
Hu, Hao
Niyato, Dusit
Poor, H. Vincent
format Article
author Yang, Helin
Lam, Kwok-Yan
Xiao, Liang
Xiong, Zehui
Hu, Hao
Niyato, Dusit
Poor, H. Vincent
author_sort Yang, Helin
title Lead federated neuromorphic learning for wireless edge artificial intelligence
title_short Lead federated neuromorphic learning for wireless edge artificial intelligence
title_full Lead federated neuromorphic learning for wireless edge artificial intelligence
title_fullStr Lead federated neuromorphic learning for wireless edge artificial intelligence
title_full_unstemmed Lead federated neuromorphic learning for wireless edge artificial intelligence
title_sort lead federated neuromorphic learning for wireless edge artificial intelligence
publishDate 2023
url https://hdl.handle.net/10356/167993
_version_ 1772828985283051520