Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Compute in‐Memory with Non‐Volatile Elements for Neural Networks: A Review from a Co‐Design Perspective

Journal Article · · Advanced Materials
 [1];  [2];  [2];  [3];  [1];  [2];  [4]
  1. Materials Science Division Argonne National Laboratory Lemont IL 60439 USA
  2. Department of Electrical Engineering Purdue University West Lafayette IN 47907 USA
  3. Department of Electrical Engineering Indian Institute of Technology Madras Chennai Tamil Nadu 600036 India
  4. Materials Science Division Argonne National Laboratory Lemont IL 60439 USA, Pritzker School of Molecular Engineering University of Chicago Chicago IL 60637 USA
Abstract

Deep learning has become ubiquitous, touching daily lives across the globe. Today, traditional computer architectures are stressed to their limits in efficiently executing the growing complexity of data and models. Compute‐in‐memory (CIM) can potentially play an important role in developing efficient hardware solutions that reduce data movement from compute‐unit to memory, known as the von Neumann bottleneck. At its heart is a cross‐bar architecture with nodal non‐volatile‐memory elements that performs an analog multiply‐and‐accumulate operation, enabling the matrix‐vector‐multiplications repeatedly used in all neural network workloads. The memory materials can significantly influence final system‐level characteristics and chip performance, including speed, power, and classification accuracy. With an over‐arching co‐design viewpoint, this review assesses the use of cross‐bar based CIM for neural networks, connecting the material properties and the associated design constraints and demands to application, architecture, and performance. Both digital and analog memory are considered, assessing the status for training and inference, and providing metrics for the collective set of properties non‐volatile memory materials will need to demonstrate for a successful CIM technology.

Research Organization:
Argonne National Laboratory (ANL), Argonne, IL (United States)
Sponsoring Organization:
USDOE; USDOE Office of Science (SC), Basic Energy Sciences (BES). Materials Sciences & Engineering Division (MSE)
Grant/Contract Number:
AC02-06CH11357
OSTI ID:
1959387
Alternate ID(s):
OSTI ID: 2378592
OSTI ID: 1959389
Journal Information:
Advanced Materials, Journal Name: Advanced Materials Journal Issue: 37 Vol. 35; ISSN 0935-9648
Publisher:
Wiley Blackwell (John Wiley & Sons)Copyright Statement
Country of Publication:
Germany
Language:
English

References (139)

32 × 32 Crossbar Array Resistive Memory Composed of a Stacked Schottky Diode and Unipolar Resistive Memory journal October 2012
Demonstration of Neuromodulation‐inspired Stashing System for Energy‐efficient Learning of Spiking Neural Network using a Self‐Rectifying Memristor Array journal March 2022
Polymer-Based Resistive Memory Materials and Devices journal December 2013
Resistive Switching Behavior in Organic-Inorganic Hybrid CH 3 NH 3 PbI 3 −x Cl x Perovskite for Resistive Random Access Memory Devices journal August 2015
Li-Ion Synaptic Transistor for Low Power Analog Computing journal November 2016
Atomically Thin Femtojoule Memristive Device journal October 2017
Memristor-Based Analog Computation and Neural Network Classification with a Dot Product Engine journal January 2018
Graphene and Related Materials for Resistive Random Access Memories journal May 2017
Recent advances in resistive random access memory based on lead halide perovskite journal November 2020
Nonvolatile bipolar resistance switching effects in multiferroic BiFeO3 thin films on LaNiO3-electrodized Si substrates journal July 2010
Interface-type resistive switching in perovskite materials journal May 2017
Resistance switching memory in perovskite oxides journal July 2015
Two-Dimensional Near-Atom-Thickness Materials for Emerging Neuromorphic Devices and Applications journal November 2020
Spintronics based random access memory: a review journal November 2017
Causes and consequences of the stochastic aspect of filamentary RRAM journal November 2015
Energy-Efficient Phase-Change Memory with Graphene as a Thermal Barrier journal September 2015
Low-Power, Self-Rectifying, and Forming-Free Memristor with an Asymmetric Programing Voltage for a High-Density Crossbar Application journal October 2016
Magnetic Domain Wall Based Synaptic and Activation Function Generator for Neuromorphic Accelerators journal December 2019
Hafnia-Based Double-Layer Ferroelectric Tunnel Junctions as Artificial Synapses for Neuromorphic Computing journal November 2020
Switching Kinetics in Nanoscale Hafnium Oxide Based Ferroelectric Field-Effect Transistors journal January 2017
Complementary Charge Trapping and Ionic Migration in Resistive Switching of Rare-Earth Manganite TbMnO 3 journal February 2013
A Functional Hybrid Memristor Crossbar-Array/CMOS System for Data Storage and Neuromorphic Applications journal December 2011
Self-Aligned Nanotube–Nanowire Phase Change Memory journal January 2013
Nanoscale Memristor Device as Synapse in Neuromorphic Systems journal April 2010
Learning representations by back-propagating errors journal October 1986
Synaptic plasticity in a cerebellum-like structure depends on temporal order journal May 1997
Training and operation of an integrated neuromorphic network based on metal-oxide memristors journal May 2015
Mastering the game of Go with deep neural networks and tree search journal January 2016
Face classification using electronic synapses journal May 2017
Observation of conducting filament growth in nanoscale resistive memories journal January 2012
Ferroelectric tunnel junctions for information storage and processing journal July 2014
Nanoionics-based resistive switching memories journal November 2007
A ferroelectric memristor journal September 2012
Atomic structure of conducting nanofilaments in TiO2 resistive switching memory journal January 2010
Memristive devices for computing journal January 2013
Stochastic phase-change neurons journal May 2016
Integrated all-photonic non-volatile multi-level memory journal September 2015
Deep learning with coherent nanophotonic circuits journal June 2017
Efficient and self-adaptive in-situ learning in multilayer memristor neural networks journal June 2018
Neuroinspired unsupervised learning and pruning with subquantum CBRAM arrays journal December 2018
Accurate deep neural network inference using computational phase-change memory journal May 2020
4K-memristor analog-grade passive crossbar circuit journal August 2021
Optimised weight programming for analogue memory-based deep neural networks journal June 2022
Memristive crossbar arrays for brain-inspired computing journal March 2019
Memristor crossbar arrays with 6-nm half-pitch and 2-nm critical dimension journal November 2018
Resistive switching materials for information processing journal January 2020
Equivalent-accuracy accelerated neural-network training using analogue memory journal June 2018
Fully hardware-implemented memristor convolutional neural network journal January 2020
A crossbar array of magnetoresistive memory devices for in-memory computing journal January 2022
A compute-in-memory chip based on resistive random-access memory journal August 2022
Multibit memory operation of metal-oxide bi-layer memristors journal December 2017
Author Correction: Directional Exosome Proteomes Reflect Polarity-Specific Functions in Retinal Pigmented Epithelium Monolayers journal November 2018
Fully memristive neural networks for pattern classification with unsupervised learning journal February 2018
In-memory computing with resistive switching devices journal June 2018
A fully integrated reprogrammable memristor–CMOS system for efficient multiply–accumulate operations journal July 2019
The future of ferroelectric field-effect transistor technology journal October 2020
A magnetic synapse: multilevel spin-torque memristor with perpendicular anisotropy journal August 2016
Silicon compatible Sn-based resistive switching memory journal January 2018
Ultra-low power Hf 0.5 Zr 0.5 O 2 based ferroelectric tunnel junction synapses for hardware neural network applications journal January 2018
The strategies of filament control for improving the resistive switching performance journal January 2020
Tunnel magnetoresistance of 604% at 300K by suppression of Ta diffusion in CoFeB∕MgO∕CoFeB pseudo-spin-valves annealed at high temperature journal August 2008
Probing Cu doped Ge0.3Se0.7 based resistance switching memory devices with random telegraph noise journal January 2010
Comprehensive study of the resistance switching in SrTiO3 and Nb-doped SrTiO3 journal March 2011
Ferroelectricity in hafnium oxide thin films journal September 2011
The origin of ferroelectricity in Hf 1−x Zr x O 2 : A computational investigation and a surface energy model journal April 2015
On the structural origins of ferroelectricity in HfO 2 thin films journal April 2015
Tutorial: Brain-inspired computing using phase-change memory devices journal September 2018
Pathways to efficient neuromorphic computing with non-volatile memory technologies journal June 2020
Neuromorphic computing using non-volatile memory journal October 2016
High precision tuning of state for memristive devices by adaptable variation-tolerant algorithm journal January 2012
Fully parallel write/read in resistive synaptic array for accelerating on-chip learning journal October 2015
A ferroelectric field effect transistor based synaptic weight cell journal August 2018
Nanoscale resistive switching memory devices: a review journal June 2019
Ferroelectric field-effect transistors based on HfO2: a review journal September 2021
Colossal electroresistance of a Pr 0.7 Ca 0.3 Mn O 3 thin film at room temperature journal December 2004
Characterization of low-frequency noise in the resistive switching of transition metal oxide HfO 2 journal January 2012
Reversible Electrical Switching Phenomena in Disordered Structures journal November 1968
ImageNet: A large-scale hierarchical image database
  • Deng, Jia; Dong, Wei; Socher, Richard
  • 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPR Workshops), 2009 IEEE Conference on Computer Vision and Pattern Recognition https://doi.org/10.1109/CVPR.2009.5206848
conference June 2009
A Nonvolatile Associative Memory-Based Context-Driven Search Engine Using 90 nm CMOS/MTJ-Hybrid Logic-in-Memory Architecture journal December 2014
CASH-RAM: Enabling In-Memory Computations for Edge Inference Using Charge Accumulation and Sharing in Standard 8T-SRAM Arrays journal September 2020
Phase Change Memory journal December 2010
Metal–Oxide RRAM journal June 2012
Neuro-Inspired Computing With Emerging Nonvolatile Memorys journal February 2018
The Next Generation of Deep Learning Hardware: Analog Computing journal January 2019
Resistive Crossbars as Approximate Hardware Building Blocks for Machine Learning: Opportunities and Challenges journal December 2020
A Broadband Switched-Transformer Digital Power Amplifier for Deep Back-Off Efficiency Enhancement journal November 2020
Benchmark of Ferroelectric Transistor-Based Hybrid Precision Synapse for Neural Network Accelerator journal December 2019
Nonlinear Switching With Ultralow Reset Power in Graphene-Insulator-Graphene Forming-Free Resistive Memories journal July 2014
Demonstration of Low Power 3-bit Multilevel Cell Characteristics in a TaOx-Based RRAM by Stack Engineering journal January 2015
Optimization of Conductance Change in Pr 1– x Ca x MnO 3 -Based Synaptic Devices for Neuromorphic Systems journal May 2015
Improved Synaptic Behavior Under Identical Pulses Using AlO x /HfO 2 Bilayer RRAM Array for Neuromorphic Systems journal August 2016
Improving Analog Switching in HfOx-Based Resistive Memory With a Thermal Enhanced Layer journal August 2017
Self-Aligned, Gate Last, FDSOI, Ferroelectric Gate Memory Device With 5.5-nm Hf0.8Zr0.2O2, High Endurance and Breakdown Recovery journal October 2017
Performance Prospects of Deeply Scaled Spin-Transfer Torque Magnetic Random-Access Memory for In-Memory Computing journal July 2020
Spatial Confinement Effects of Embedded Nanocrystals on Multibit and Synaptic Properties of Forming Free SiO2-Based Conductive Bridge Random Access Memory journal July 2020
Highly Scaled, High Endurance, Ω-Gate, Nanowire Ferroelectric FET Memory Transistors journal November 2020
High Speed and Large Memory Window Ferroelectric HfZrO₂ FinFET for High-Density Nonvolatile Memory journal September 2021
2-Bit-Per-Cell RRAM-Based In-Memory Computing for Area-/Energy-Efficient Deep Learning journal January 2020
A 35.5-127.2 TOPS/W Dynamic Sparsity-Aware Reconfigurable-Precision Compute-in-Memory SRAM Macro for Machine Learning journal January 2021
Computing beyond Moore's Law journal December 2015
STT-MRAM memory cells with enhanced on/off ratio conference September 2012
Proposal for an All-Spin Artificial Neural Network: Emulating Neural and Synaptic Functionalities Through Domain Wall Motion in Ferromagnets journal December 2016
SPARE: Spiking Neural Network Acceleration Using ROM-Embedded RAMs as In-Memory-Computation Primitives journal August 2019
Efficient Pipelined Execution of CNNs Based on In-Memory Computing and Graph Homomorphism Verification journal June 2021
RxNN: A Framework for Evaluating Deep Neural Networks on Resistive Crossbars journal February 2021
X-SRAM: Enabling In-Memory Boolean Computations in CMOS Static Random Access Memories journal December 2018
Xcel-RAM: Accelerating Binary Neural Networks in High-Throughput SRAM Compute Arrays journal August 2019
IMAC: In-Memory Multi-Bit Multiplication and ACcumulation in 6T SRAM Array journal August 2020
Impact of Interface Layer on Device Characteristics of Si:HfO2-Based FeFET’s journal June 2021
Statistics of Resistance Drift Due to Structural Relaxation in Phase-Change Memory Arrays journal October 2010
Visual Pattern Extraction Using Energy-Efficient “2-PCM Synapse” Neuromorphic Architecture journal August 2012
Phase-Change Memory—Towards a Storage-Class Memory journal November 2017
High-Throughput In-Memory Computing for Binary Deep Neural Networks With Monolithically Integrated RRAM and 90-nm CMOS journal October 2020
Fully On-Chip MAC at 14 nm Enabled by Accurate Row-Wise Programming of PCM-Based Weights and Parallel Vector-Transport in Duration-Format journal December 2021
BEOL-Compatible Superlattice FEFET Analog Synapse With Improved Linearity and Symmetry of Weight Update journal April 2022
Development of Embedded STT-MRAM for Mobile System-on-Chips journal January 2011
A Fully Functional 64 Mb DDR3 ST-MRAM Built on 90 nm CMOS Technology journal July 2013
Cross-Point Architecture for Spin-Transfer Torque Magnetic Random Access Memory journal September 2012
The Graph Neural Network Model journal December 2008
Computing in Memory With Spin-Transfer Torque Magnetic RAM journal March 2018
8T SRAM Cell as a Multibit Dot-Product Engine for Beyond Von Neumann Computing journal November 2019
Phase change memory technology
  • Burr, Geoffrey W.; Breitwisch, Matthew J.; Franceschini, Michele
  • Journal of Vacuum Science & Technology B, Nanotechnology and Microelectronics: Materials, Processing, Measurement, and Phenomena, Vol. 28, Issue 2 https://doi.org/10.1116/1.3301579
journal March 2010
Low-Power Switching of Phase-Change Materials with Carbon Nanotube Electrodes journal March 2011
Understanding of the Switching Mechanism of a Pt/Ni-Doped SrTiO 3 Junction via Current–Voltage and Capacitance–Voltage Measurements journal December 2008
Performance-optimized gate-first 22-nm SOI technology with embedded DRAM journal January 2015
Ferroelectric Hafnium Oxide Based Materials and Devices: Assessment of Current Status and Future Prospects journal January 2015
Backpropagation Applied to Handwritten Zip Code Recognition journal December 1989
Long Short-Term Memory journal November 1997
Conductive-bridging random access memory: challenges and opportunity for 3D architecture journal April 2015
Review and perspective on ferroelectric HfO2-based thin films for memory applications journal August 2018
Ferroelectric devices and circuits for neuro-inspired computing journal December 2020
Phase-change memory cycling endurance journal September 2019
Acceleration of Deep Neural Network Training with Resistive Cross-Point Devices: Design Considerations journal July 2016
Training Deep Convolutional Neural Networks with Resistive Cross-Point Devices journal October 2017
Training LSTM Networks With Resistive Cross-Point Devices journal October 2018
RAPA-ConvNets: Modified Convolutional Networks for Accelerated Training on Architectures With Analog Arrays journal July 2019
Mixed-Precision Deep Learning Based on Computational Memory journal May 2020
Enabling Training of Neural Networks on Noisy Hardware journal September 2021
Neural Network Training With Asymmetric Crosspoint Elements journal May 2022