A neuromorphic-hardware oriented bio-plausible online-learning spiking neural network model
Neuromorphic hardware inspired by the brain has attracted much attention for its advanced information processing concept. However, implementing online learning in the neuromorphic chip is still challenging. In this paper, we present a bio-plausible online-learning spiking neural network (SNN) model...
Saved in:
Main Authors: | , , , , , , , |
---|---|
Other Authors: | |
Format: | Article |
Language: | English |
Published: |
2019
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/90044 http://hdl.handle.net/10220/49348 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-90044 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-900442020-03-07T14:02:38Z A neuromorphic-hardware oriented bio-plausible online-learning spiking neural network model Qiao, G. C. Hu, S. G. Wang, J. J. Zhang, C. M. Ning, N. Yu, Q. Liu, Y. Chen, Tu Pei School of Electrical and Electronic Engineering Neuromorphic Hardware Online Learning Engineering::Electrical and electronic engineering Neuromorphic hardware inspired by the brain has attracted much attention for its advanced information processing concept. However, implementing online learning in the neuromorphic chip is still challenging. In this paper, we present a bio-plausible online-learning spiking neural network (SNN) model for hardware implementation. The SNN consists of an input layer, an excitatory layer, and an inhibitory layer. To save resource cost and accelerate information processing speed during hardware implementation, online learning based on the spiking neural model is realized by trace-based spiking-timing-dependent plasticity (STDP). Neuron and synapse activities are digitalized, and decay behaviors of neuron and synapse parameters are realized by the bit-shift operation. After learning training set from the Modified National Institute of Standards and Technology (MNIST), the spiking neural model successfully recognizes the digits from the MNIST test set, showing the feasibility and capability of the model. The recognition accuracy increases significantly from 90.0% to 94.5% with the number of the excitatory/inhibitory neurons rising from 400 to 3,500, which provides a guide to make a trade-off between the recognition accuracy and the resource cost during hardware implementation. Encouragingly, compared to its corresponding floating-point model, the proposed model reduces the hardware resources and power consumption by 40.7% and 36.3%, respectively (under 55-nm CMOS process). Published version 2019-07-16T02:01:40Z 2019-12-06T17:39:26Z 2019-07-16T02:01:40Z 2019-12-06T17:39:26Z 2019 Journal Article Qiao, G. C., Hu, S. G., Wang, J. J., Zhang, C. M., Chen, T. P., Ning, N., . . . Liu, Y. (2019). A neuromorphic-hardware oriented bio-plausible online-learning spiking neural network model. IEEE Access, 7, 71730-71740. doi:10.1109/ACCESS.2019.2919163 https://hdl.handle.net/10356/90044 http://hdl.handle.net/10220/49348 10.1109/ACCESS.2019.2919163 en IEEE Access Articles accepted before 12 June 2019 were published under a CC BY 3.0 or the IEEE Open Access Publishing Agreement license. Questions about copyright policies or reuse rights may be directed to the IEEE Intellectual Property Rights Office at +1-732-562-3966 or copyrights@ieee.org. 11 p. application/pdf |
institution |
Nanyang Technological University |
building |
NTU Library |
country |
Singapore |
collection |
DR-NTU |
language |
English |
topic |
Neuromorphic Hardware Online Learning Engineering::Electrical and electronic engineering |
spellingShingle |
Neuromorphic Hardware Online Learning Engineering::Electrical and electronic engineering Qiao, G. C. Hu, S. G. Wang, J. J. Zhang, C. M. Ning, N. Yu, Q. Liu, Y. Chen, Tu Pei A neuromorphic-hardware oriented bio-plausible online-learning spiking neural network model |
description |
Neuromorphic hardware inspired by the brain has attracted much attention for its advanced information processing concept. However, implementing online learning in the neuromorphic chip is still challenging. In this paper, we present a bio-plausible online-learning spiking neural network (SNN) model for hardware implementation. The SNN consists of an input layer, an excitatory layer, and an inhibitory layer. To save resource cost and accelerate information processing speed during hardware implementation, online learning based on the spiking neural model is realized by trace-based spiking-timing-dependent plasticity (STDP). Neuron and synapse activities are digitalized, and decay behaviors of neuron and synapse parameters are realized by the bit-shift operation. After learning training set from the Modified National Institute of Standards and Technology (MNIST), the spiking neural model successfully recognizes the digits from the MNIST test set, showing the feasibility and capability of the model. The recognition accuracy increases significantly from 90.0% to 94.5% with the number of the excitatory/inhibitory neurons rising from 400 to 3,500, which provides a guide to make a trade-off between the recognition accuracy and the resource cost during hardware implementation. Encouragingly, compared to its corresponding floating-point model, the proposed model reduces the hardware resources and power consumption by 40.7% and 36.3%, respectively (under 55-nm CMOS process). |
author2 |
School of Electrical and Electronic Engineering |
author_facet |
School of Electrical and Electronic Engineering Qiao, G. C. Hu, S. G. Wang, J. J. Zhang, C. M. Ning, N. Yu, Q. Liu, Y. Chen, Tu Pei |
format |
Article |
author |
Qiao, G. C. Hu, S. G. Wang, J. J. Zhang, C. M. Ning, N. Yu, Q. Liu, Y. Chen, Tu Pei |
author_sort |
Qiao, G. C. |
title |
A neuromorphic-hardware oriented bio-plausible online-learning spiking neural network model |
title_short |
A neuromorphic-hardware oriented bio-plausible online-learning spiking neural network model |
title_full |
A neuromorphic-hardware oriented bio-plausible online-learning spiking neural network model |
title_fullStr |
A neuromorphic-hardware oriented bio-plausible online-learning spiking neural network model |
title_full_unstemmed |
A neuromorphic-hardware oriented bio-plausible online-learning spiking neural network model |
title_sort |
neuromorphic-hardware oriented bio-plausible online-learning spiking neural network model |
publishDate |
2019 |
url |
https://hdl.handle.net/10356/90044 http://hdl.handle.net/10220/49348 |
_version_ |
1681044826935525376 |