Fast prototyping of neural network on hardware accelerator

This project aims to implement Convolutional Neural Network (CNN) and Spiking Neural Network (SNN) in FPGA using Vivado High Level Synthesis (HLS), followed by analyzing and comparing the performance based on the speed, accuracy, utilization, and power consumption. The goal is to have a neural netwo...

Full description

Saved in:
Bibliographic Details
Main Author: Agus, Hans Kevin
Other Authors: Goh Wang Ling
Format: Final Year Project
Language:English
Published: Nanyang Technological University 2021
Subjects:
Online Access:https://hdl.handle.net/10356/149144
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-149144
record_format dspace
spelling sg-ntu-dr.10356-1491442023-07-07T18:16:06Z Fast prototyping of neural network on hardware accelerator Agus, Hans Kevin Goh Wang Ling School of Electrical and Electronic Engineering Institute of Microelectronics (IME) Do Anh Tuan Koh Eng Kiat EWLGOH@ntu.edu.sg, doat@ime.a-star.edu.sg, Koh_Eng_Kiat@ime.a-star.edu.sg Engineering::Electrical and electronic engineering::Integrated circuits Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence This project aims to implement Convolutional Neural Network (CNN) and Spiking Neural Network (SNN) in FPGA using Vivado High Level Synthesis (HLS), followed by analyzing and comparing the performance based on the speed, accuracy, utilization, and power consumption. The goal is to have a neural network running on FPGA with low latency, low resources, and low power so that the neural network can be implemented in low power and low resource environment to do real-time recognition tasks. This would be done by using the optimizations available in Vivado HLS. Furthermore, two learning rules of Spiking Neural Network, namely Spike Timing Dependent Plasticity (STDP) and Deep Belief Network (DBN) with Restricted Boltzmann Machine (RBM), were also simulated to obtain the trained weights before implementing the SNN on FPGA. The FPGA-implemented CNN in this project achieved 97.39% accuracy, which is equal to software-based implementation with the same network configuration. Furthermore, the latency of the network was 0.687 ms, which is comparable to the software-based implementation running on CPU. The SNNs were also implemented on FPGA with two different types of operation, which are time-step based and event-driven. The time-step based SNN by utilizing Siegert neurons achieved 92.19% accuracy with 20.35 ms latency, while the event-driven SNN achieved 86.8% accuracy with 3.72 s latency. Furthermore, this project had shown that the event-driven operation was better for low resources and low power, while the time-step operation was better for latency and accuracy. Bachelor of Engineering (Electrical and Electronic Engineering) 2021-05-27T09:07:47Z 2021-05-27T09:07:47Z 2021 Final Year Project (FYP) Agus, H. K. (2021). Fast prototyping of neural network on hardware accelerator. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/149144 https://hdl.handle.net/10356/149144 en application/pdf Nanyang Technological University
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Electrical and electronic engineering::Integrated circuits
Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence
spellingShingle Engineering::Electrical and electronic engineering::Integrated circuits
Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence
Agus, Hans Kevin
Fast prototyping of neural network on hardware accelerator
description This project aims to implement Convolutional Neural Network (CNN) and Spiking Neural Network (SNN) in FPGA using Vivado High Level Synthesis (HLS), followed by analyzing and comparing the performance based on the speed, accuracy, utilization, and power consumption. The goal is to have a neural network running on FPGA with low latency, low resources, and low power so that the neural network can be implemented in low power and low resource environment to do real-time recognition tasks. This would be done by using the optimizations available in Vivado HLS. Furthermore, two learning rules of Spiking Neural Network, namely Spike Timing Dependent Plasticity (STDP) and Deep Belief Network (DBN) with Restricted Boltzmann Machine (RBM), were also simulated to obtain the trained weights before implementing the SNN on FPGA. The FPGA-implemented CNN in this project achieved 97.39% accuracy, which is equal to software-based implementation with the same network configuration. Furthermore, the latency of the network was 0.687 ms, which is comparable to the software-based implementation running on CPU. The SNNs were also implemented on FPGA with two different types of operation, which are time-step based and event-driven. The time-step based SNN by utilizing Siegert neurons achieved 92.19% accuracy with 20.35 ms latency, while the event-driven SNN achieved 86.8% accuracy with 3.72 s latency. Furthermore, this project had shown that the event-driven operation was better for low resources and low power, while the time-step operation was better for latency and accuracy.
author2 Goh Wang Ling
author_facet Goh Wang Ling
Agus, Hans Kevin
format Final Year Project
author Agus, Hans Kevin
author_sort Agus, Hans Kevin
title Fast prototyping of neural network on hardware accelerator
title_short Fast prototyping of neural network on hardware accelerator
title_full Fast prototyping of neural network on hardware accelerator
title_fullStr Fast prototyping of neural network on hardware accelerator
title_full_unstemmed Fast prototyping of neural network on hardware accelerator
title_sort fast prototyping of neural network on hardware accelerator
publisher Nanyang Technological University
publishDate 2021
url https://hdl.handle.net/10356/149144
_version_ 1772827011868262400