國立虎尾科技大學 |

Energy-Efficient Capacitor-Based Analog In-Memory Computing Macros.

Record Type:	Language materials, manuscript : Monograph/item
Title/Author:	Energy-Efficient Capacitor-Based Analog In-Memory Computing Macros./
Author:	Lee, Jinseok.
Description:	1 online resource (140 pages)
Notes:	Source: Dissertations Abstracts International, Volume: 85-12, Section: B.
Contained By:	Dissertations Abstracts International85-12B.
Subject:	Electrical engineering. -
Online resource:	click for full text (PQDT)
ISBN:	9798382810461

Energy-Efficient Capacitor-Based Analog In-Memory Computing Macros.
Lee, Jinseok.

Energy-Efficient Capacitor-Based Analog In-Memory Computing Macros. - 1 online resource (140 pages)

Source: Dissertations Abstracts International, Volume: 85-12, Section: B.

Thesis (Ph.D.)--Princeton University, 2024.

Includes bibliographical references

In recent years, artificial intelligence (AI) has rapidly gained prominence and has transformed various sectors. Neural network-based AI applications have become common in our daily lives, from self-driving cars and AI speakers recognizing individual voices, to chatbots solving mathematical problems. As AI performs more complex tasks, neural network (NN) models have become extremely complex as well, demanding a huge amount of computations. This prompts development of specialized hardware solutions such as neural processing units (NPUs), designed to cater to these needs. As a future component in NPUs, in-memory compute (IMC) is specialized for matrix-vector multiplication (MVM) computation in AI tasks. IMC distinguishes itself by integrating computation within memory, minimizing the traditional approach of moving data between the data memory and arithmetic logic units (ALUs) in graphics processing units (GPUs) or central processing units (CPUs). This innovation positions IMC as a highly efficient computing solution, particularly in terms of performance and energy consumption for MVMs, with analog in-memory compute (AIMC) demonstrating notable advantages in energy efficiency and processing speed.This work presents multiple designs and analyses for an energy-efficient and high-SNR capacitor-based AIMC macro. These AIMC designs feature a configuration of 1152 rows by 256 columns and are fabricated in 28 nm CMOS technology. First, we introduce a fully row/column-parallel AIMC macro capable of single-shot MVM processing with 5-bit inputs by adopting the dynamic range doubling (DRD) concept, which reduces the circuit complexity needed for generating multi-level signals for one-shot 5-bit processing. With DRD and back-end-of-line (BEOL) capacitors in a memory array of multiplying bit cells (MBCs), the AIMC macro achieves highly-linear MVM computations. Prototype chip measurements demonstrate that 5-bit DRD enhances IMC energy efficiency by 16 times and throughput by 5 times compared to prior 1-bit input designs. This chip was also tested in a neural network demonstration using 5-bit input activations (IAs) and weights for CIFAR-10 classification tests. Furthermore, we provide a systematic analysis of noise performance of AIMC macros. Despite claims in the literature about the importance of output bit-width ratio, the impact of noise in AIMC macros is often overlooked. Our analysis begins at the macro level, examining the effects of bit precision and number format of inputs and weights. This analysis is then extended to the NN layer level, which ultimately needs to be computed. The findings offer macro design insights into the systematic gains determined by macro configuration of input/weight/output bit precision and inner dimension of accumulation. Then, we introduce a bit-reconfigurable AIMC macro design. Different layers in a NN have varying noise sensitivity requirements, typically with the first and last layers being particularly noise-sensitive, whereas other layers are less so. Therefore, there is a demand for reconfigurable noise performance, and this can be done by adjusting the bit precision in the macro configuration. The prototype demonstrates adjustable noise performance based on bit configuration, and the measured results validate the systematic noise analysis provided in this work. Finally, we address the need for higher analog-to-digital converter (ADC) bit precision to mitigate systematic noise amplification. While previous single-ended accumulation systems are limited in increasing ADC bit precision due to the fundamental noise of the analog circuit approaching the least significant bit (LSB) amplitude, this challenge is overcome in our work through a fully differential design. A combination of a differential input activation (IA) and a multiplier forms a multiplying unit (MU), which contains two MBCs. This setup enables differential accumulation at compute line (CL) and ADC, and as a consequence, the doubled voltage swing at the CL offers an opportunity to increase ADC bit precision. The increased ADC bit precision significantly improves the signal-to-noise ratio (SNR) of the AIMC system. The prototype chip exhibits the transfer curves with an error at sub-LSB level and nearly equivalent accuracy in the inference task of ImageNet with the ResNet-18 NN model.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2024

Mode of access: World Wide Web

ISBN: 9798382810461Subjects--Topical Terms:

596380
Electrical engineering.
Subjects--Index Terms:

Hardware acceleratorIndex Terms--Genre/Form:

554714
Electronic books.

Energy-Efficient Capacitor-Based Analog In-Memory Computing Macros.
LDR:05693ntm a22003857 4500 001 1151275
005 20241104055844.5
006 m o d
007 cr bn ---uuuuu
008 250605s2024 xx obm 000 0 eng d
020 $a 9798382810461
035 $a (MiAaPQ)AAI31294351
035 $a AAI31294351
040 $a MiAaPQ $b eng $c MiAaPQ $d NTU
100 1 $a Lee, Jinseok. $3 1478009
245 1 0 $a Energy-Efficient Capacitor-Based Analog In-Memory Computing Macros.
264 0 $c 2024
300 $a 1 online resource (140 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertations Abstracts International, Volume: 85-12, Section: B.
500 $a Advisor: Verma, Naveen.
502 $a Thesis (Ph.D.)--Princeton University, 2024.
504 $a Includes bibliographical references
520 $a In recent years, artificial intelligence (AI) has rapidly gained prominence and has transformed various sectors. Neural network-based AI applications have become common in our daily lives, from self-driving cars and AI speakers recognizing individual voices, to chatbots solving mathematical problems. As AI performs more complex tasks, neural network (NN) models have become extremely complex as well, demanding a huge amount of computations. This prompts development of specialized hardware solutions such as neural processing units (NPUs), designed to cater to these needs. As a future component in NPUs, in-memory compute (IMC) is specialized for matrix-vector multiplication (MVM) computation in AI tasks. IMC distinguishes itself by integrating computation within memory, minimizing the traditional approach of moving data between the data memory and arithmetic logic units (ALUs) in graphics processing units (GPUs) or central processing units (CPUs). This innovation positions IMC as a highly efficient computing solution, particularly in terms of performance and energy consumption for MVMs, with analog in-memory compute (AIMC) demonstrating notable advantages in energy efficiency and processing speed.This work presents multiple designs and analyses for an energy-efficient and high-SNR capacitor-based AIMC macro. These AIMC designs feature a configuration of 1152 rows by 256 columns and are fabricated in 28 nm CMOS technology. First, we introduce a fully row/column-parallel AIMC macro capable of single-shot MVM processing with 5-bit inputs by adopting the dynamic range doubling (DRD) concept, which reduces the circuit complexity needed for generating multi-level signals for one-shot 5-bit processing. With DRD and back-end-of-line (BEOL) capacitors in a memory array of multiplying bit cells (MBCs), the AIMC macro achieves highly-linear MVM computations. Prototype chip measurements demonstrate that 5-bit DRD enhances IMC energy efficiency by 16 times and throughput by 5 times compared to prior 1-bit input designs. This chip was also tested in a neural network demonstration using 5-bit input activations (IAs) and weights for CIFAR-10 classification tests. Furthermore, we provide a systematic analysis of noise performance of AIMC macros. Despite claims in the literature about the importance of output bit-width ratio, the impact of noise in AIMC macros is often overlooked. Our analysis begins at the macro level, examining the effects of bit precision and number format of inputs and weights. This analysis is then extended to the NN layer level, which ultimately needs to be computed. The findings offer macro design insights into the systematic gains determined by macro configuration of input/weight/output bit precision and inner dimension of accumulation. Then, we introduce a bit-reconfigurable AIMC macro design. Different layers in a NN have varying noise sensitivity requirements, typically with the first and last layers being particularly noise-sensitive, whereas other layers are less so. Therefore, there is a demand for reconfigurable noise performance, and this can be done by adjusting the bit precision in the macro configuration. The prototype demonstrates adjustable noise performance based on bit configuration, and the measured results validate the systematic noise analysis provided in this work. Finally, we address the need for higher analog-to-digital converter (ADC) bit precision to mitigate systematic noise amplification. While previous single-ended accumulation systems are limited in increasing ADC bit precision due to the fundamental noise of the analog circuit approaching the least significant bit (LSB) amplitude, this challenge is overcome in our work through a fully differential design. A combination of a differential input activation (IA) and a multiplier forms a multiplying unit (MU), which contains two MBCs. This setup enables differential accumulation at compute line (CL) and ADC, and as a consequence, the doubled voltage swing at the CL offers an opportunity to increase ADC bit precision. The increased ADC bit precision significantly improves the signal-to-noise ratio (SNR) of the AIMC system. The prototype chip exhibits the transfer curves with an error at sub-LSB level and nearly equivalent accuracy in the inference task of ImageNet with the ResNet-18 NN model.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2024
538 $a Mode of access: World Wide Web
650 4 $a Electrical engineering. $3 596380
650 4 $a Computer engineering. $3 569006
653 $a Hardware accelerator
653 $a In-memory computing
653 $a Neural network
653 $a Analog-to-digital converter
655 7 $a Electronic books. $2 local $3 554714
690 $a 0544
690 $a 0464
690 $a 0800
710 2 $a ProQuest Information and Learning Co. $3 1178819
710 2 $a Princeton University. $b Electrical and Computer Engineering. $3 1413580
773 0 $t Dissertations Abstracts International $g 85-12B.
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=31294351 $z click for full text (PQDT)