Memristor-based in-memory computing for multilayer artificial neural networks

Analogue in-memory computing and brain-inspired computing based on the emerging memory technology such as Resistive RAM (RRAM) and Phase Change RAM (PRAM), integrates the logic module into the storage module and has a much higher energy efficiency, providing a feasible alternative method to fu...

Full description

Saved in:
Bibliographic Details
Main Author: Zhao, Guangchao
Other Authors: Tay Beng Kang
Format: Thesis-Master by Coursework
Language:English
Published: Nanyang Technological University 2020
Subjects:
Online Access:https://hdl.handle.net/10356/140815
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-140815
record_format dspace
spelling sg-ntu-dr.10356-1408152023-07-04T16:29:52Z Memristor-based in-memory computing for multilayer artificial neural networks Zhao, Guangchao Tay Beng Kang School of Electrical and Electronic Engineering EBKTAY@ntu.edu.sg Engineering::Electrical and electronic engineering::Nanoelectronics Engineering::Electrical and electronic engineering::Computer hardware, software and systems Analogue in-memory computing and brain-inspired computing based on the emerging memory technology such as Resistive RAM (RRAM) and Phase Change RAM (PRAM), integrates the logic module into the storage module and has a much higher energy efficiency, providing a feasible alternative method to further improve the computing performance beyond CMOS technology. Among the devices, memristor also called ReRAM, is considered to be the most promising candidate due to its ultra-low switching voltage (less than 3V) and power consumption (~0.1pJ), fast switch speed (~10 ns), compatibility with CMOS technology, and ultra-high integration capability (~4 F2, F is the feature size of process technology). It is found that the resistance of a memristor simply depends on the applied voltage. Therefore, a memristor can mimic the work mechanism of the human brain and function as a synapse. Memristor crossbar, in which a single memristor serves as an element in the weight matrix in the forward propagation in the neural network, provide great advantages to perform as a hardware platform for both digital logic circuit application and analogue neuromorphic computing due to the programmability, non-volatility, fast write/read speed and excellent scalability of array. In this thesis, a series of work related with memristor have been illustrated and discussed. The basic physical principle of the memristor will be first explained and the electronic characteristics will be simulated with PSpice. Oxide-material based memristors are fabricated and the device characteristics are extracted for the simulation of deep learning. A multilayer Deep Neural Network (DNN) based on the memristors is established and the accuracy performance was tested on Modified National Institute of Standards and Technology data base (MNIST). The Simulation results show high accuracy (over 90%). Additionally, based on the properties of memristors, ternary and binary neural networks were proposed. Both of these networks achieved high accuracy around 90% and high noise robustness. Master of Science (Electronics) 2020-06-02T05:36:21Z 2020-06-02T05:36:21Z 2020 Thesis-Master by Coursework https://hdl.handle.net/10356/140815 en application/pdf Nanyang Technological University
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Electrical and electronic engineering::Nanoelectronics
Engineering::Electrical and electronic engineering::Computer hardware, software and systems
spellingShingle Engineering::Electrical and electronic engineering::Nanoelectronics
Engineering::Electrical and electronic engineering::Computer hardware, software and systems
Zhao, Guangchao
Memristor-based in-memory computing for multilayer artificial neural networks
description Analogue in-memory computing and brain-inspired computing based on the emerging memory technology such as Resistive RAM (RRAM) and Phase Change RAM (PRAM), integrates the logic module into the storage module and has a much higher energy efficiency, providing a feasible alternative method to further improve the computing performance beyond CMOS technology. Among the devices, memristor also called ReRAM, is considered to be the most promising candidate due to its ultra-low switching voltage (less than 3V) and power consumption (~0.1pJ), fast switch speed (~10 ns), compatibility with CMOS technology, and ultra-high integration capability (~4 F2, F is the feature size of process technology). It is found that the resistance of a memristor simply depends on the applied voltage. Therefore, a memristor can mimic the work mechanism of the human brain and function as a synapse. Memristor crossbar, in which a single memristor serves as an element in the weight matrix in the forward propagation in the neural network, provide great advantages to perform as a hardware platform for both digital logic circuit application and analogue neuromorphic computing due to the programmability, non-volatility, fast write/read speed and excellent scalability of array. In this thesis, a series of work related with memristor have been illustrated and discussed. The basic physical principle of the memristor will be first explained and the electronic characteristics will be simulated with PSpice. Oxide-material based memristors are fabricated and the device characteristics are extracted for the simulation of deep learning. A multilayer Deep Neural Network (DNN) based on the memristors is established and the accuracy performance was tested on Modified National Institute of Standards and Technology data base (MNIST). The Simulation results show high accuracy (over 90%). Additionally, based on the properties of memristors, ternary and binary neural networks were proposed. Both of these networks achieved high accuracy around 90% and high noise robustness.
author2 Tay Beng Kang
author_facet Tay Beng Kang
Zhao, Guangchao
format Thesis-Master by Coursework
author Zhao, Guangchao
author_sort Zhao, Guangchao
title Memristor-based in-memory computing for multilayer artificial neural networks
title_short Memristor-based in-memory computing for multilayer artificial neural networks
title_full Memristor-based in-memory computing for multilayer artificial neural networks
title_fullStr Memristor-based in-memory computing for multilayer artificial neural networks
title_full_unstemmed Memristor-based in-memory computing for multilayer artificial neural networks
title_sort memristor-based in-memory computing for multilayer artificial neural networks
publisher Nanyang Technological University
publishDate 2020
url https://hdl.handle.net/10356/140815
_version_ 1772827400723234816