A neuromorphic-hardware oriented bio-plausible online-learning spiking neural network model

Neuromorphic hardware inspired by the brain has attracted much attention for its advanced information processing concept. However, implementing online learning in the neuromorphic chip is still challenging. In this paper, we present a bio-plausible online-learning spiking neural network (SNN) model...

Full description

Saved in:
Bibliographic Details
Main Authors: Qiao, G. C., Hu, S. G., Wang, J. J., Zhang, C. M., Ning, N., Yu, Q., Liu, Y., Chen, Tu Pei
Other Authors: School of Electrical and Electronic Engineering
Format: Article
Language:English
Published: 2019
Subjects:
Online Access:https://hdl.handle.net/10356/90044
http://hdl.handle.net/10220/49348
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-90044
record_format dspace
spelling sg-ntu-dr.10356-900442020-03-07T14:02:38Z A neuromorphic-hardware oriented bio-plausible online-learning spiking neural network model Qiao, G. C. Hu, S. G. Wang, J. J. Zhang, C. M. Ning, N. Yu, Q. Liu, Y. Chen, Tu Pei School of Electrical and Electronic Engineering Neuromorphic Hardware Online Learning Engineering::Electrical and electronic engineering Neuromorphic hardware inspired by the brain has attracted much attention for its advanced information processing concept. However, implementing online learning in the neuromorphic chip is still challenging. In this paper, we present a bio-plausible online-learning spiking neural network (SNN) model for hardware implementation. The SNN consists of an input layer, an excitatory layer, and an inhibitory layer. To save resource cost and accelerate information processing speed during hardware implementation, online learning based on the spiking neural model is realized by trace-based spiking-timing-dependent plasticity (STDP). Neuron and synapse activities are digitalized, and decay behaviors of neuron and synapse parameters are realized by the bit-shift operation. After learning training set from the Modified National Institute of Standards and Technology (MNIST), the spiking neural model successfully recognizes the digits from the MNIST test set, showing the feasibility and capability of the model. The recognition accuracy increases significantly from 90.0% to 94.5% with the number of the excitatory/inhibitory neurons rising from 400 to 3,500, which provides a guide to make a trade-off between the recognition accuracy and the resource cost during hardware implementation. Encouragingly, compared to its corresponding floating-point model, the proposed model reduces the hardware resources and power consumption by 40.7% and 36.3%, respectively (under 55-nm CMOS process). Published version 2019-07-16T02:01:40Z 2019-12-06T17:39:26Z 2019-07-16T02:01:40Z 2019-12-06T17:39:26Z 2019 Journal Article Qiao, G. C., Hu, S. G., Wang, J. J., Zhang, C. M., Chen, T. P., Ning, N., . . . Liu, Y. (2019). A neuromorphic-hardware oriented bio-plausible online-learning spiking neural network model. IEEE Access, 7, 71730-71740. doi:10.1109/ACCESS.2019.2919163 https://hdl.handle.net/10356/90044 http://hdl.handle.net/10220/49348 10.1109/ACCESS.2019.2919163 en IEEE Access Articles accepted before 12 June 2019 were published under a CC BY 3.0 or the IEEE Open Access Publishing Agreement license. Questions about copyright policies or reuse rights may be directed to the IEEE Intellectual Property Rights Office at +1-732-562-3966 or copyrights@ieee.org. 11 p. application/pdf
institution Nanyang Technological University
building NTU Library
country Singapore
collection DR-NTU
language English
topic Neuromorphic Hardware
Online Learning
Engineering::Electrical and electronic engineering
spellingShingle Neuromorphic Hardware
Online Learning
Engineering::Electrical and electronic engineering
Qiao, G. C.
Hu, S. G.
Wang, J. J.
Zhang, C. M.
Ning, N.
Yu, Q.
Liu, Y.
Chen, Tu Pei
A neuromorphic-hardware oriented bio-plausible online-learning spiking neural network model
description Neuromorphic hardware inspired by the brain has attracted much attention for its advanced information processing concept. However, implementing online learning in the neuromorphic chip is still challenging. In this paper, we present a bio-plausible online-learning spiking neural network (SNN) model for hardware implementation. The SNN consists of an input layer, an excitatory layer, and an inhibitory layer. To save resource cost and accelerate information processing speed during hardware implementation, online learning based on the spiking neural model is realized by trace-based spiking-timing-dependent plasticity (STDP). Neuron and synapse activities are digitalized, and decay behaviors of neuron and synapse parameters are realized by the bit-shift operation. After learning training set from the Modified National Institute of Standards and Technology (MNIST), the spiking neural model successfully recognizes the digits from the MNIST test set, showing the feasibility and capability of the model. The recognition accuracy increases significantly from 90.0% to 94.5% with the number of the excitatory/inhibitory neurons rising from 400 to 3,500, which provides a guide to make a trade-off between the recognition accuracy and the resource cost during hardware implementation. Encouragingly, compared to its corresponding floating-point model, the proposed model reduces the hardware resources and power consumption by 40.7% and 36.3%, respectively (under 55-nm CMOS process).
author2 School of Electrical and Electronic Engineering
author_facet School of Electrical and Electronic Engineering
Qiao, G. C.
Hu, S. G.
Wang, J. J.
Zhang, C. M.
Ning, N.
Yu, Q.
Liu, Y.
Chen, Tu Pei
format Article
author Qiao, G. C.
Hu, S. G.
Wang, J. J.
Zhang, C. M.
Ning, N.
Yu, Q.
Liu, Y.
Chen, Tu Pei
author_sort Qiao, G. C.
title A neuromorphic-hardware oriented bio-plausible online-learning spiking neural network model
title_short A neuromorphic-hardware oriented bio-plausible online-learning spiking neural network model
title_full A neuromorphic-hardware oriented bio-plausible online-learning spiking neural network model
title_fullStr A neuromorphic-hardware oriented bio-plausible online-learning spiking neural network model
title_full_unstemmed A neuromorphic-hardware oriented bio-plausible online-learning spiking neural network model
title_sort neuromorphic-hardware oriented bio-plausible online-learning spiking neural network model
publishDate 2019
url https://hdl.handle.net/10356/90044
http://hdl.handle.net/10220/49348
_version_ 1681044826935525376