Memristor-based in-memory computing for multilayer artificial neural networks
Analogue in-memory computing and brain-inspired computing based on the emerging memory technology such as Resistive RAM (RRAM) and Phase Change RAM (PRAM), integrates the logic module into the storage module and has a much higher energy efficiency, providing a feasible alternative method to fu...
Saved in:
Main Author: | |
---|---|
Other Authors: | |
Format: | Thesis-Master by Coursework |
Language: | English |
Published: |
Nanyang Technological University
2020
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/140815 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-140815 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1408152023-07-04T16:29:52Z Memristor-based in-memory computing for multilayer artificial neural networks Zhao, Guangchao Tay Beng Kang School of Electrical and Electronic Engineering EBKTAY@ntu.edu.sg Engineering::Electrical and electronic engineering::Nanoelectronics Engineering::Electrical and electronic engineering::Computer hardware, software and systems Analogue in-memory computing and brain-inspired computing based on the emerging memory technology such as Resistive RAM (RRAM) and Phase Change RAM (PRAM), integrates the logic module into the storage module and has a much higher energy efficiency, providing a feasible alternative method to further improve the computing performance beyond CMOS technology. Among the devices, memristor also called ReRAM, is considered to be the most promising candidate due to its ultra-low switching voltage (less than 3V) and power consumption (~0.1pJ), fast switch speed (~10 ns), compatibility with CMOS technology, and ultra-high integration capability (~4 F2, F is the feature size of process technology). It is found that the resistance of a memristor simply depends on the applied voltage. Therefore, a memristor can mimic the work mechanism of the human brain and function as a synapse. Memristor crossbar, in which a single memristor serves as an element in the weight matrix in the forward propagation in the neural network, provide great advantages to perform as a hardware platform for both digital logic circuit application and analogue neuromorphic computing due to the programmability, non-volatility, fast write/read speed and excellent scalability of array. In this thesis, a series of work related with memristor have been illustrated and discussed. The basic physical principle of the memristor will be first explained and the electronic characteristics will be simulated with PSpice. Oxide-material based memristors are fabricated and the device characteristics are extracted for the simulation of deep learning. A multilayer Deep Neural Network (DNN) based on the memristors is established and the accuracy performance was tested on Modified National Institute of Standards and Technology data base (MNIST). The Simulation results show high accuracy (over 90%). Additionally, based on the properties of memristors, ternary and binary neural networks were proposed. Both of these networks achieved high accuracy around 90% and high noise robustness. Master of Science (Electronics) 2020-06-02T05:36:21Z 2020-06-02T05:36:21Z 2020 Thesis-Master by Coursework https://hdl.handle.net/10356/140815 en application/pdf Nanyang Technological University |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Engineering::Electrical and electronic engineering::Nanoelectronics Engineering::Electrical and electronic engineering::Computer hardware, software and systems |
spellingShingle |
Engineering::Electrical and electronic engineering::Nanoelectronics Engineering::Electrical and electronic engineering::Computer hardware, software and systems Zhao, Guangchao Memristor-based in-memory computing for multilayer artificial neural networks |
description |
Analogue in-memory computing and brain-inspired computing based on the emerging
memory technology such as Resistive RAM (RRAM) and Phase Change RAM (PRAM),
integrates the logic module into the storage module and has a much higher energy
efficiency, providing a feasible alternative method to further improve the computing
performance beyond CMOS technology. Among the devices, memristor also called
ReRAM, is considered to be the most promising candidate due to its ultra-low switching
voltage (less than 3V) and power consumption (~0.1pJ), fast switch speed (~10 ns),
compatibility with CMOS technology, and ultra-high integration capability (~4 F2, F is the
feature size of process technology).
It is found that the resistance of a memristor simply depends on the applied voltage.
Therefore, a memristor can mimic the work mechanism of the human brain and function
as a synapse. Memristor crossbar, in which a single memristor serves as an element in the
weight matrix in the forward propagation in the neural network, provide great advantages
to perform as a hardware platform for both digital logic circuit application and analogue
neuromorphic computing due to the programmability, non-volatility, fast write/read speed
and excellent scalability of array.
In this thesis, a series of work related with memristor have been illustrated and discussed.
The basic physical principle of the memristor will be first explained and the electronic
characteristics will be simulated with PSpice. Oxide-material based memristors are
fabricated and the device characteristics are extracted for the simulation of deep learning.
A multilayer Deep Neural Network (DNN) based on the memristors is established and the
accuracy performance was tested on Modified National Institute of Standards and
Technology data base (MNIST). The Simulation results show high accuracy (over 90%).
Additionally, based on the properties of memristors, ternary and binary neural networks
were proposed. Both of these networks achieved high accuracy around 90% and high noise
robustness. |
author2 |
Tay Beng Kang |
author_facet |
Tay Beng Kang Zhao, Guangchao |
format |
Thesis-Master by Coursework |
author |
Zhao, Guangchao |
author_sort |
Zhao, Guangchao |
title |
Memristor-based in-memory computing for multilayer artificial neural networks |
title_short |
Memristor-based in-memory computing for multilayer artificial neural networks |
title_full |
Memristor-based in-memory computing for multilayer artificial neural networks |
title_fullStr |
Memristor-based in-memory computing for multilayer artificial neural networks |
title_full_unstemmed |
Memristor-based in-memory computing for multilayer artificial neural networks |
title_sort |
memristor-based in-memory computing for multilayer artificial neural networks |
publisher |
Nanyang Technological University |
publishDate |
2020 |
url |
https://hdl.handle.net/10356/140815 |
_version_ |
1772827400723234816 |