Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Abisko: Deep codesign of an architecture for spiking neural networks using novel neuromorphic materials

Journal Article · · International Journal of High Performance Computing Applications
The Abisko project aims to develop an energy-efficient spiking neural network (SNN) computing architecture and software system capable of autonomous learning and operation. The SNN architecture explores novel neuromorphic devices that are based on resistive-switching materials, such as memristors and electrochemical RAM. Equally important, Abisko uses a deep codesign approach to pursue this goal by engaging experts from across the entire range of disciplines: materials, devices and circuits, architectures and integration, software, and algorithms. Here, the key objectives of our Abisko project are threefold. First, we are designing an energy-optimized high-performance neuromorphic accelerator based on SNNs. This architecture is being designed as a chiplet that can be deployed in contemporary computer architectures and we are investigating novel neuromorphic materials to improve its design. Second, we are concurrently developing a productive software stack for the neuromorphic accelerator that will also be portable to other architectures, such as field-programmable gate arrays and GPUs. Third, we are creating a new deep codesign methodology and framework for developing clear interfaces, requirements, and metrics between each level of abstraction to enable the system design to be explored and implemented interchangeably with execution, measurement, a model, or simulation. As a motivating application for this codesign effort, we target the use of SNNs for an analog event detector for a high-energy physics sensor.
Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
Sponsoring Organization:
USDOE National Nuclear Security Administration (NNSA)
Grant/Contract Number:
AC05-00OR22725; NA0003525
OSTI ID:
1987763
Alternate ID(s):
OSTI ID: 2311543
Journal Information:
International Journal of High Performance Computing Applications, Journal Name: International Journal of High Performance Computing Applications Journal Issue: 3-4 Vol. 37; ISSN 1094-3420
Publisher:
SAGECopyright Statement
Country of Publication:
United States
Language:
English

References (100)

Origin of the Ultra-nonlinear Switching Kinetics in Oxide-Based Resistive Switches journal September 2011
Memory Devices: Filament‐Free Bulk Resistive Memory Enables Deterministic Analogue Switching (Adv. Mater. 45/2020) journal November 2020
ECRAM Materials, Devices, Circuits and Architectures: A Perspective journal November 2022
Tunable Microwave Conductance of Nanodomains in Ferroelectric PbZr 0.2 Ti 0.8 O 3 Thin Film journal December 2021
Nonvolatile Electrochemical Random‐Access Memory under Short Circuit journal November 2022
Physical Compact Model for Three‐Terminal SONOS Synaptic Circuit Element journal May 2022
Exponential ionic drift: fast switching and low volatility of thin-film memristors journal November 2008
Large-scale cognitive model design using the Nengo neural simulator journal July 2016
Deep learning in spiking neural networks journal March 2019
Observation of a new particle in the search for the Standard Model Higgs boson with the ATLAS detector at the LHC journal September 2012
Observation of a new boson at a mass of 125 GeV with the CMS experiment at the LHC journal September 2012
Structural and Electrical Response of Emerging Memories Exposed to Heavy Ion Radiation journal September 2022
Correlated Materials Characterization via Multimodal Chemical and Functional Imaging journal November 2018
Analog Memristors Based on Thickening/Thinning of Ag Nanofilaments in Amorphous Manganite Thin Films journal October 2013
Filamentary Switching: Synaptic Plasticity through Device Volatility journal January 2015
Microwave a.c. conductivity of domain walls in ferroelectric thin films journal May 2016
A ferroelectric memristor journal September 2012
Memristive devices for computing journal January 2013
Encoding integers and rationals on neuromorphic computers using virtual neuron journal July 2023
Microwave impedance microscopy and its application to quantum materials journal November 2021
Memristor modeling: challenges in theories, simulations, and device variability journal January 2021
Cathodoluminescence for the 21st century: Learning more from light journal September 2017
Perspective: Memcomputing: Leveraging memory and physics to compute efficiently journal May 2018
Physics-based compact modeling of electro-thermal memristors: Negative differential resistance, local activity, and non-local dynamical bifurcations journal March 2022
Benchmarking energy consumption and latency for neuromorphic computing in condensed matter and particle physics journal March 2023
Electrochemical metallization memories—fundamentals, applications, prospects journal May 2011
Status of the Phase-2 Tracker Upgrade of the CMS experiment at the HL-LHC journal December 2020
A review of non-cognitive applications for neuromorphic computing journal September 2022
A Review of Spiking Neuromorphic Hardware Communication Systems journal January 2019
Multi-Objective Hyperparameter Optimization for Spiking Neural Network Neuroevolution conference June 2021
MLIR: Scaling Compiler Infrastructure for Domain Specific Computation conference February 2021
Achieving Accurate In-Memory Neural Network Inference with Highly Overlapping Nonvolatile Memory State Distributions conference March 2022
Arbor — A Morphologically-Detailed Neural Network Simulation Library for Contemporary High-Performance Computing Architectures conference February 2019
Bunch of Wires: An Open Die-to-Die Interface conference August 2020
Mitigating effects of non-ideal synaptic device characteristics for on-chip learning conference November 2015
Memristor-based Reconfigurable Circuits: Challenges in Implementation conference January 2020
Low power operating bipolar TMO ReRAM for sub 10 nm era conference December 2010
Device, circuit and system-level analysis of noise in multi-bit phase-change memory conference December 2010
Biologically realizable reward-modulated hebbian training for spiking neural networks conference June 2008
Are probabilistic spiking neural networks suitable for reservoir computing? conference July 2011
An evolutionary optimization framework for neural networks and neuromorphic architectures conference July 2016
Spiking Neural Algorithms for Markov Process Random Walk conference July 2018
TensorFlow Doing HPC conference May 2019
Sparse Binary Matrix-Vector Multiplication on Neuromorphic Computers conference June 2021
A wafer-scale neuromorphic hardware system for large-scale neural modeling
  • Schemmel, Johannes; Briiderle, Daniel; Griibl, Andreas
  • 2010 IEEE International Symposium on Circuits and Systems - ISCAS 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems https://doi.org/10.1109/ISCAS.2010.5536970
conference May 2010
Multilevel-Cell Phase-Change Memory: A Viable Technology journal March 2016
Phase Change Memory journal December 2010
Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations journal May 2014
Braindrop: A Mixed-Signal Neuromorphic Architecture With a Dynamical Systems-Based Programming Model journal January 2019
Using Floating-Gate Memory to Train Ideal Accuracy Neural Networks journal June 2019
Resistance Controllability of $\hbox{Ta}_{2} \hbox{O}_{5}/\hbox{TiO}_{2}$ Stack ReRAM for Low-Voltage and Multilevel Operation journal March 2010
Achieving Exascale Capabilities through Heterogeneous Computing journal July 2015
Loihi: A Neuromorphic Manycore Processor with On-Chip Learning journal January 2018
A MLIR Dialect for Quantum Assembly Languages conference October 2021
Aspen: A domain specific language for performance modeling
  • Spafford, Kyle L.; Vetter, Jeffrey S.
  • 2012 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2012.20
conference November 2012
Efficient Classification of Supercomputer Failures Using Neuromorphic Computing conference November 2018
TrueNorth: Design and Tool Flow of a 65 mW 1 Million Neuron Programmable Neurosynaptic Chip journal October 2015
A Data-Driven Verilog-A ReRAM Model journal December 2018
An Accurate, Error-Tolerant, and Energy-Efficient Neural Network Inference Engine Based on SONOS Analog Memory journal April 2022
Experimental Demonstration and Tolerancing of a Large-Scale Neural Network (165 000 Synapses) Using Phase-Change Memory as the Synaptic Weight Element journal November 2015
Industrial TCAD: Modeling Atoms to Chips journal November 2021
Comprehensive Compact Phenomenological Modeling of Integrated Metal-Oxide Memristors journal January 2020
Initial Assessment of the Effects of Radiation on the Electrical Characteristics of ${\rm TaO}_{\rm x}$ Memristive Memories journal December 2012
Training a Neural Network on Analog TaOx ReRAM Devices Irradiated With Heavy Ions: Effects on Classification Accuracy Demonstrated With CrossSim journal January 2019
Radiation Effects in Advanced and Emerging Nonvolatile Memories journal May 2021
Multiscale Co-Design Analysis of Energy, Latency, Area, and Accuracy of a ReRAM Analog Neural Training Accelerator journal March 2018
Ionizing Radiation Effects in SONOS-Based Neuromorphic Inference Accelerators journal May 2021
Single-Event Effects Induced by Heavy Ions in SONOS Charge Trapping Memory Arrays journal March 2022
Phase change memory technology
  • Burr, Geoffrey W.; Breitwisch, Matthew J.; Franceschini, Michele
  • Journal of Vacuum Science & Technology B, Nanotechnology and Microelectronics: Materials, Processing, Measurement, and Phenomena, Vol. 28, Issue 2 https://doi.org/10.1116/1.3301579
journal March 2010
COMPASS: A Framework for Automated Performance Modeling and Prediction conference January 2015
A new golden age for computer architecture journal January 2019
Shortest Path and Neighborhood Subgraph Extraction on a Spiking Memristive Neuromorphic Implementation conference January 2019
Provable Neuromorphic Advantages for Computing Shortest Paths conference July 2020
Domain-specific hardware accelerators journal June 2020
Pseudo-3D Approaches for Commercial-Grade RTL-to-GDS Tool Flow Targeting Monolithic 3D ICs conference March 2020
Evolutionary Optimization for Neuromorphic Systems
  • Schuman, Catherine D.; Mitchell, J. Parker; Patton, Robert M.
  • NICE '20: Neuro-inspired Computational Elements Workshop, Proceedings of the Neuro-inspired Computational Elements Workshop https://doi.org/10.1145/3381755.3381758
conference June 2020
On the computational power and complexity of Spiking Neural Networks conference March 2020
Neuromorphic Graph Algorithms conference March 2020
Spike-based graph centrality measures conference July 2020
Modeling epidemic spread with spike-based models conference July 2020
SIAM: Chiplet-based Scalable In-Memory Acceleration with Mesh for Deep Neural Networks journal September 2021
Computational Complexity of Neuromorphic Algorithms conference July 2021
Neuromorphic Computing for Autonomous Racing conference October 2021
Neuromorphic Graph Algorithms: Cycle Detection, Odd Cycle Detection, and Max Flow conference July 2021
Neuromorphic Computing is Turing-Complete conference July 2022
Semi-Supervised Graph Structure Learning on Neuromorphic Computers conference July 2022
Microwave Microscopy and Its Applications journal July 2020
Spike Timing–Dependent Plasticity: A Hebbian Learning Rule journal July 2008
Phase-change random access memory: A scalable technology journal July 2008
Automated Design Space Exploration with Aspen journal January 2015
Modeling synthetic aperture radar computation with Aspen journal July 2013
Extreme Heterogeneity 2018 - Productive Computational Science in the Era of Extreme Heterogeneity: Report for DOE ASCR Workshop on Extreme Heterogeneity report December 2018
Memristor for computing: Myth or reality? conference March 2017
FLAME: Graph-based hardware representations for rapid and precise performance modeling conference March 2019
Solving Constraint Satisfaction Problems Using the Loihi Spiking Neuromorphic Processor conference March 2020
An Ultrascalable Solution to Large-scale Neural Tissue Simulation journal January 2011
Chiplet Heterogeneous Integration Technology—Status and Challenges journal April 2020
NEST (NEural Simulation Tool) journal January 2007
Brian 2, an intuitive and efficient neural simulator journal August 2019
Technology-design Co-optimization of Resistive Cross-point Array for Accelerating Learning Algorithms on Chip conference January 2015

Similar Records

Design of a Robust Memristive Spiking Neuromorphic System with Unsupervised Learning in Hardware
Journal Article · Wed Jun 30 00:00:00 EDT 2021 · ACM Journal on Emerging Technologies in Computing Systems · OSTI ID:1814330

A Hardware and Software Co-design Framework for Energy Efficient Neuromorphic Systems
Technical Report · Wed Jul 05 00:00:00 EDT 2023 · OSTI ID:1985762