Transposable 9T-SRAM computation-in-memory for on-chip learning with probability-based single-slope SAR hybrid ADC for edge devices

This letter proposes a two-way transposable SRAM computation-in-memory (CIM) macro for inference and training in convolutional neural networks (CNNs). A novel 9T SRAM bit-cell conducts local two-way computing without shared processing units, achieving higher-processing throughput from every bit-cell...

Full description

Saved in:
Bibliographic Details
Main Authors: Jo, Yong-Jun, Zhang, Xin, Liu, Jiahao, Zhou, Jun, Zheng, Yuanjin, Kim, Tony Tae-Hyoung
Other Authors: School of Electrical and Electronic Engineering
Format: Article
Language:English
Published: 2023
Subjects:
Online Access:https://hdl.handle.net/10356/170098
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-170098
record_format dspace
spelling sg-ntu-dr.10356-1700982023-08-28T04:20:10Z Transposable 9T-SRAM computation-in-memory for on-chip learning with probability-based single-slope SAR hybrid ADC for edge devices Jo, Yong-Jun Zhang, Xin Liu, Jiahao Zhou, Jun Zheng, Yuanjin Kim, Tony Tae-Hyoung School of Electrical and Electronic Engineering Engineering::Electrical and electronic engineering On-Chip Learning Zero-Skip This letter proposes a two-way transposable SRAM computation-in-memory (CIM) macro for inference and training in convolutional neural networks (CNNs). A novel 9T SRAM bit-cell conducts local two-way computing without shared processing units, achieving higher-processing throughput from every bit-cell operating in one CIM cycle. This letter also proposes a probability-based single-slope (SS) and successive approximation (SAR) hybrid analog-to-digital converter (ADC) for energy efficiency improvement by utilizing the probability density function of multiply and accumulation (MAC). The proposed ADC also supports the ReLU-based zero skip function without additional circuitry. The prototype was fabricated in 180-nm CMOS technology and achieved an energy efficiency of 6.61 (1.65) TOPS/W for inference (training). Agency for Science, Technology and Research (A*STAR) This work was supported in part by the National Key Research and Development Program of China under Grant 2019YFB2204500; in part by the Natural Science Foundation of China (NSAF) under Grant U2030204; in part by the Competitive Research Programme (CRP) under Grant NRFCRP25-2020-0002; and in part by A*STAR SERC AME Program “NanoSystems at the Edge” under Grant A18A4b0055. 2023-08-28T04:20:10Z 2023-08-28T04:20:10Z 2023 Journal Article Jo, Y., Zhang, X., Liu, J., Zhou, J., Zheng, Y. & Kim, T. T. (2023). Transposable 9T-SRAM computation-in-memory for on-chip learning with probability-based single-slope SAR hybrid ADC for edge devices. IEEE Solid-State Circuits Letters, 6, 81-84. https://dx.doi.org/10.1109/LSSC.2023.3260090 2573-9603 https://hdl.handle.net/10356/170098 10.1109/LSSC.2023.3260090 2-s2.0-85151497731 6 81 84 en A18A4b0055 IEEE Solid-State Circuits Letters © 2023 IEEE. All rights reserved.
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Electrical and electronic engineering
On-Chip Learning
Zero-Skip
spellingShingle Engineering::Electrical and electronic engineering
On-Chip Learning
Zero-Skip
Jo, Yong-Jun
Zhang, Xin
Liu, Jiahao
Zhou, Jun
Zheng, Yuanjin
Kim, Tony Tae-Hyoung
Transposable 9T-SRAM computation-in-memory for on-chip learning with probability-based single-slope SAR hybrid ADC for edge devices
description This letter proposes a two-way transposable SRAM computation-in-memory (CIM) macro for inference and training in convolutional neural networks (CNNs). A novel 9T SRAM bit-cell conducts local two-way computing without shared processing units, achieving higher-processing throughput from every bit-cell operating in one CIM cycle. This letter also proposes a probability-based single-slope (SS) and successive approximation (SAR) hybrid analog-to-digital converter (ADC) for energy efficiency improvement by utilizing the probability density function of multiply and accumulation (MAC). The proposed ADC also supports the ReLU-based zero skip function without additional circuitry. The prototype was fabricated in 180-nm CMOS technology and achieved an energy efficiency of 6.61 (1.65) TOPS/W for inference (training).
author2 School of Electrical and Electronic Engineering
author_facet School of Electrical and Electronic Engineering
Jo, Yong-Jun
Zhang, Xin
Liu, Jiahao
Zhou, Jun
Zheng, Yuanjin
Kim, Tony Tae-Hyoung
format Article
author Jo, Yong-Jun
Zhang, Xin
Liu, Jiahao
Zhou, Jun
Zheng, Yuanjin
Kim, Tony Tae-Hyoung
author_sort Jo, Yong-Jun
title Transposable 9T-SRAM computation-in-memory for on-chip learning with probability-based single-slope SAR hybrid ADC for edge devices
title_short Transposable 9T-SRAM computation-in-memory for on-chip learning with probability-based single-slope SAR hybrid ADC for edge devices
title_full Transposable 9T-SRAM computation-in-memory for on-chip learning with probability-based single-slope SAR hybrid ADC for edge devices
title_fullStr Transposable 9T-SRAM computation-in-memory for on-chip learning with probability-based single-slope SAR hybrid ADC for edge devices
title_full_unstemmed Transposable 9T-SRAM computation-in-memory for on-chip learning with probability-based single-slope SAR hybrid ADC for edge devices
title_sort transposable 9t-sram computation-in-memory for on-chip learning with probability-based single-slope sar hybrid adc for edge devices
publishDate 2023
url https://hdl.handle.net/10356/170098
_version_ 1779156659348701184