A high-accuracy and energy-efficient spiking neural network with On-FPGA STDP learning based on asynchronous CORDIC
During the last few decades, Moore's law has propelled the anticipation of exponential growth in computing capabilities, primarily associated with silicon-based processing devices. However, as we approach the culmination of this trend, there is a compelling motivation to explore avenues...
Saved in:
Main Author: | |
---|---|
Other Authors: | |
Format: | Thesis-Master by Coursework |
Language: | English |
Published: |
Nanyang Technological University
2024
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/173705 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-173705 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1737052024-03-01T15:44:28Z A high-accuracy and energy-efficient spiking neural network with On-FPGA STDP learning based on asynchronous CORDIC Sheng, Shirui Lin Zhiping School of Electrical and Electronic Engineering EZPLin@ntu.edu.sg Engineering During the last few decades, Moore's law has propelled the anticipation of exponential growth in computing capabilities, primarily associated with silicon-based processing devices. However, as we approach the culmination of this trend, there is a compelling motivation to explore avenues toward embedded cognition. This exploration extends beyond merely augmenting computing power and encompasses a broader scope, including the reevaluation of computational organization and information representation. The pursuit of a paradigm shift in neuromorphic engineering is grounded in a dual objective: gaining deeper insights into the functioning of the human brain and fostering the development of more streamlined silicon processing devices. In emerging Spiking Neural Network (SNN) based hardware designs for neuromorphic systems, energy conservation and real-time learning stand out as appealing benefits. This dissertation introduces an efficient hardware design for biological neuron models, specifically the Leaky Integrate and Fire (LIF) neuron, using the COordinate Rotation DIgital Computer (CORDIC) algorithm. The asynchronous CORDIC (async-CORDIC) based design significantly improves accuracy and energy efficiency, outperforming conventional CORDIC approaches. We integrate CORDIC iterative pipelines with dual-rail logic using handshaking control, reducing switching activity and power dissipation by approximately 23%. Async-CORDIC design improves hardware efficiency, Spike-Timing Dependent Plasticity (STDP) based learning, and energy efficiency on FPGA, enhancing switching cycle utilization by 21% through fewer iteration stages. Our design reduces the average error in STDP exponentiation calculations by 5.4%. In real-world tasks, such as digit classification using the MNIST dataset, our implementation achieves up to approximately 95% accuracy. Master's degree 2024-02-26T00:27:27Z 2024-02-26T00:27:27Z 2024 Thesis-Master by Coursework Sheng, S. (2024). A high-accuracy and energy-efficient spiking neural network with On-FPGA STDP learning based on asynchronous CORDIC. Master's thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/173705 https://hdl.handle.net/10356/173705 en application/pdf Nanyang Technological University |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Engineering |
spellingShingle |
Engineering Sheng, Shirui A high-accuracy and energy-efficient spiking neural network with On-FPGA STDP learning based on asynchronous CORDIC |
description |
During the last few decades, Moore's law has propelled the anticipation of exponential growth in computing capabilities, primarily associated with silicon-based processing devices. However, as we approach the culmination of this trend, there is a compelling motivation to explore avenues toward embedded cognition. This exploration extends beyond merely augmenting computing power and encompasses a broader scope, including the reevaluation of computational organization and information representation. The pursuit of a paradigm shift in neuromorphic engineering is grounded in a dual objective: gaining deeper insights into the functioning of the human brain and fostering the development of more streamlined silicon processing devices.
In emerging Spiking Neural Network (SNN) based hardware designs for neuromorphic systems, energy conservation and real-time learning stand out as appealing benefits. This dissertation introduces an efficient hardware design for biological neuron models, specifically the Leaky Integrate and Fire (LIF) neuron, using the COordinate Rotation DIgital Computer (CORDIC) algorithm.
The asynchronous CORDIC (async-CORDIC) based design significantly improves accuracy and energy efficiency, outperforming conventional CORDIC approaches. We integrate CORDIC iterative pipelines with dual-rail logic using handshaking control, reducing switching activity and power dissipation by approximately 23%. Async-CORDIC design improves hardware efficiency, Spike-Timing Dependent Plasticity (STDP) based learning, and energy efficiency on FPGA, enhancing switching cycle utilization by 21% through fewer iteration stages. Our design reduces the average error in STDP exponentiation calculations by 5.4%. In real-world tasks, such as digit classification using the MNIST dataset, our implementation achieves up to approximately 95% accuracy. |
author2 |
Lin Zhiping |
author_facet |
Lin Zhiping Sheng, Shirui |
format |
Thesis-Master by Coursework |
author |
Sheng, Shirui |
author_sort |
Sheng, Shirui |
title |
A high-accuracy and energy-efficient spiking neural network with On-FPGA STDP learning based on asynchronous CORDIC |
title_short |
A high-accuracy and energy-efficient spiking neural network with On-FPGA STDP learning based on asynchronous CORDIC |
title_full |
A high-accuracy and energy-efficient spiking neural network with On-FPGA STDP learning based on asynchronous CORDIC |
title_fullStr |
A high-accuracy and energy-efficient spiking neural network with On-FPGA STDP learning based on asynchronous CORDIC |
title_full_unstemmed |
A high-accuracy and energy-efficient spiking neural network with On-FPGA STDP learning based on asynchronous CORDIC |
title_sort |
high-accuracy and energy-efficient spiking neural network with on-fpga stdp learning based on asynchronous cordic |
publisher |
Nanyang Technological University |
publishDate |
2024 |
url |
https://hdl.handle.net/10356/173705 |
_version_ |
1794549376547291136 |