DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Opportunities for neuromorphic computing algorithms and applications

Journal Article · · Nature Computational Science
ORCiD logo [1]; ORCiD logo [2];  [3];  [2]; ORCiD logo [2];  [2]
  1. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Univ. of Tennessee, Knoxville, TN (United States)
  2. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
  3. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); George Mason Univ., Fairfax, VA (United States)

Neuromorphic computing technologies will be important for the future of computing, but much of the work in neuromorphic computing has focused on hardware development. In this study, we review recent results in neuromorphic computing algorithms and applications. We highlight characteristics of neuromorphic computing technologies that make them attractive for the future of computing and we discuss opportunities for future development of algorithms and applications on these systems.

Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States); Univ. of Tennessee, Knoxville, TN (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
Grant/Contract Number:
AC05-00OR22725; SC0022566
OSTI ID:
1881146
Journal Information:
Nature Computational Science, Journal Name: Nature Computational Science Journal Issue: 1 Vol. 2; ISSN 2662-8457
Publisher:
Springer NatureCopyright Statement
Country of Publication:
United States
Language:
English

References (108)

A Roadmap for Reaching the Potential of Brain‐Derived Computing journal November 2020
Evolving spiking neural network—a survey journal February 2013
An optimal approximation algorithm for Bayesian inference journal June 1997
Error-backpropagation in temporally encoded networks of spiking neurons journal October 2002
Systematic evaluation of convolution neural network advances on the Imagenet journal August 2017
EqSpike: Spike-driven equilibrium propagation for neuromorphic implementations journal March 2021
Training multi-layer spiking neural networks using NormAD based spatio-temporal error backpropagation journal March 2020
Benchmarking the performance of neuromorphic and spiking neural network simulators journal August 2021
NeuCube: A spiking neural network architecture for mapping, learning and understanding of spatio-temporal brain data journal April 2014
Spiking neural networks for handwritten digit recognition—Supervised learning and network optimization journal July 2018
Recent advances in physical reservoir computing: A review journal July 2019
Memristive Ion Channel-Doped Biomembranes as Synaptic Mimics journal March 2018
Nanoscale Memristor Device as Synapse in Neuromorphic Systems journal April 2010
An event-based architecture for solving constraint satisfaction problems journal December 2015
The tempotron: a neuron that learns spike timing–based decisions journal February 2006
In situ click chemistry generation of cyclooxygenase-2 inhibitors journal February 2017
Reservoir computing using dynamic memristors for temporal information processing journal December 2017
A solution to the learning dilemma for recurrent networks of spiking neurons journal July 2020
Towards artificial general intelligence with hybrid Tianjic chip architecture journal July 2019
How we created neuromorphic engineering journal July 2020
Training deep neural networks for binary communication with the Whetstone method journal January 2019
Optimized spiking neurons can classify images with high accuracy through temporal coding with two spikes journal March 2021
Review of memristor devices in neuromorphic computing: materials sciences and device challenges journal September 2018
Device and materials requirements for neuromorphic computing journal January 2019
Deep medical image analysis with representation learning and neuromorphic computing journal December 2020
Neuromorphic electronic systems journal January 1990
Algorithm and hardware design of discrete-time spiking neural networks based on back propagation with binary activations conference October 2017
Bayesian-based Hyperparameter Optimization for Spiking Neuromorphic Systems conference December 2019
Hardware for machine learning: Challenges and opportunities conference April 2017
A Low Power, Fully Event-Based Gesture Recognition System conference July 2017
Training Probabilistic Spiking Neural Networks with First- To-Spike Decoding conference April 2018
PABO: Pseudo Agent-Based Multi-Objective Bayesian Hyperparameter Optimization for Efficient Neural Accelerator Design conference November 2019
FaNeuRobot: A Framework for Robot and Prosthetics Control Using the NeuCube Spiking Neural Network Architecture and Finite Automata Theory conference May 2018
Conversion of artificial recurrent neural networks to spiking neural networks for low-power neuromorphic hardware conference October 2016
Stable spike-timing dependent plasticity rule for multilayer unsupervised and supervised learning conference May 2017
Quadratic Unconstrained Binary Optimization (QUBO) on neuromorphic computing system conference May 2017
Spiking Neural Algorithms for Markov Process Random Walk conference July 2018
Non-Traditional Input Encoding Schemes for Spiking Neuromorphic Systems conference July 2019
Sleep Stage Classification using NeuCube on SpiNNaker: a Preliminary Study conference July 2020
NeoN: Neuromorphic control for autonomous robotic navigation conference October 2017
A wafer-scale neuromorphic hardware system for large-scale neural modeling
  • Schemmel, Johannes; Briiderle, Daniel; Griibl, Andreas
  • 2010 IEEE International Symposium on Circuits and Systems - ISCAS 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems https://doi.org/10.1109/ISCAS.2010.5536970
conference May 2010
Solving Vertex Cover via Ising Model on a Neuromorphic Processor conference May 2018
The SpiNNaker Project journal May 2014
Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations journal May 2014
Brain-Inspired Learning on Neuromorphic Substrates journal May 2021
Advancing Neuromorphic Computing With Loihi: A Survey of Results and Outlook journal May 2021
Loihi: A Neuromorphic Manycore Processor with On-Chip Learning journal January 2018
Building Brain-Inspired Computing Systems: Examining the Role of Nanoscale Devices journal September 2018
Surrogate Gradient Learning in Spiking Neural Networks: Bringing the Power of Gradient-Based Optimization to Spiking Neural Networks journal November 2019
An Astrocyte Neuromorphic Circuit That Influences Neuronal Phase Synchrony journal April 2015
A Scalable Multicore Architecture With Heterogeneous Memory Structures for Dynamic Neuromorphic Asynchronous Processors (DYNAPs) journal February 2018
First-Spike-Based Visual Categorization Using Reward-Modulated STDP journal December 2018
Selection and Optimization of Temporal Spike Encoding Methods for Spiking Neural Networks journal February 2020
The Heidelberg Spiking Data Sets for the Systematic Evaluation of Spiking Neural Networks journal July 2022
A million spiking-neuron integrated circuit with a scalable communication network and interface journal August 2014
Acquisition and Representation of Spatio-Temporal Signals in Polychronizing Spiking Neural Networks conference January 2019
Benchmarking Keyword Spotting Efficiency on Neuromorphic Hardware conference January 2019
Provable Neuromorphic Advantages for Computing Shortest Paths conference July 2020
Graph Partitioning as Quadratic Unconstrained Binary Optimization (QUBO) on Spiking Neuromorphic Hardware conference July 2019
Evolving Spiking Neural Networks for Robot Sensory-motor Decision Tasks of Varying Difficulty conference March 2020
Evolutionary Optimization for Neuromorphic Systems
  • Schuman, Catherine D.; Mitchell, J. Parker; Patton, Robert M.
  • NICE '20: Neuro-inspired Computational Elements Workshop, Proceedings of the Neuro-inspired Computational Elements Workshop https://doi.org/10.1145/3381755.3381758
conference June 2020
Neuromorphic Graph Algorithms conference March 2020
Fast and deep neuromorphic learning with first-spike coding conference March 2020
Solving a steady-state PDE using spiking networks and neuromorphic hardware conference July 2020
An Astrocyte-Modulated Neuromorphic Central Pattern Generator for Hexapod Robot Locomotion on Intel’s Loihi conference July 2020
Modeling epidemic spread with spike-based models conference July 2020
Power-efficient Spike Sorting Scheme Using Analog Spiking Neural Network Classifier
  • Mukhopadhyay, Anand Kumar; Sharma, Atul; Chakrabarti, Indrajit
  • ACM Journal on Emerging Technologies in Computing Systems, Vol. 17, Issue 2 https://doi.org/10.1145/3432814
journal April 2021
Spiking Neuromorphic Networks for Binary Tasks conference July 2021
Neuromorphic Analogue VLSI journal March 1995
On the Computational Power of Winner-Take-All journal November 2000
Polychronization: Computation with Spikes journal February 2006
Rhythmic Inhibition Allows Neural Networks to Search for Maximally Consistent States journal December 2015
Computation with Spikes in a Winner-Take-All Network journal September 2009
SuperSpike: Supervised Learning in Multilayer Spiking Neural Networks journal June 2018
Probabilistic Inference in General Graphical Models through Sampling in Stochastic Networks of Spiking Neurons journal December 2011
Bayesian Computation Emerges in Generic Cortical Microcircuits through Spike-Timing-Dependent Plasticity journal April 2013
STDP Installs in Winner-Take-All Circuits an Online Approximation to Hidden Markov Model Learning journal March 2014
A model of human motor sequence learning explains facilitation and interference effects based on spike-timing dependent plasticity journal August 2017
Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type journal December 1998
Learning Nonlinear Dynamics in Efficient, Balanced Spiking Networks Using Local Plasticity Rules journal April 2018
New Efficient Multi-Spike Learning for Fast Processing and Robust Learning journal April 2020
Extreme Heterogeneity 2018 - Productive Computational Science in the Era of Extreme Heterogeneity: Report for DOE ASCR Workshop on Extreme Heterogeneity report December 2018
Solving Constraint Satisfaction Problems Using the Loihi Spiking Neuromorphic Processor conference March 2020
Is it enough to optimize CNN architectures on ImageNet? journal November 2022
Unsupervised learning of digit recognition using spike-timing-dependent plasticity journal August 2015
Nengo: a Python tool for building large-scale functional brain models journal January 2014
Neuromorphic Silicon Neuron Circuits journal January 2011
Dynamic neural fields as a step toward cognitive neuromorphic architectures journal January 2014
Converting Static Image Datasets to Spiking Neuromorphic Datasets Using Saccades journal November 2015
Comparing Neuromorphic Solutions in Action: Implementing a Bio-Inspired Solution to a Benchmark Classification Task on Three Parallel-Computing Platforms journal January 2016
Design and Analysis of a Neuromemristive Reservoir Computing Architecture for Biosignal Processing journal February 2016
Training Deep Spiking Neural Networks Using Backpropagation journal November 2016
Conversion of Continuous-Valued Deep Networks to Efficient Event-Driven Networks for Image Classification journal December 2017
Using Stochastic Spiking Neural Networks on SpiNNaker to Solve Constraint Satisfaction Problems journal December 2017
Spatio-Temporal Backpropagation for Training High-Performance Spiking Neural Networks journal May 2018
Training Deep Spiking Convolutional Neural Networks With STDP-Based Unsupervised Pre-training Followed by Supervised Fine-Tuning journal August 2018
Large-Scale Neuromorphic Spiking Array Processors: A Quest to Mimic the Brain journal December 2018
GPUs Outperform Current HPC and Neuromorphic Solutions in Terms of Speed and Energy When Simulating a Highly-Connected Cortical Model journal December 2018
REMODEL: Rethinking Deep CNN Models to Detect and Count on a NeuroSynaptic System journal February 2019
Going Deeper in Spiking Neural Networks: VGG and Residual Architectures journal March 2019
Neuromorphic Hardware Learns to Learn journal May 2019
Analysis of Liquid Ensembles for Enhancing the Performance and Accuracy of Liquid State Machines journal May 2019
Deep Liquid State Machines With Neural Plasticity for Video Activity Recognition journal July 2019
Enabling Spike-Based Backpropagation for Training Deep Neural Network Architectures journal February 2020
Synaptic Plasticity Dynamics for Deep Continuous Local Learning (DECOLLE) journal May 2020
Bayesian Multi-objective Hyperparameter Optimization for Accurate, Fast, and Efficient Neural Network Accelerator Design journal July 2020
Brian: a simulator for spiking neural networks in Python journal January 2008
NEST (NEural Simulation Tool) journal January 2007

Similar Records

Neuromorphic Computing for Scientific Applications
Conference · 2022 · OSTI ID:1928928

Quantum neuromorphic computing
Journal Article · 2020 · Applied Physics Letters · OSTI ID:1852977

A review of non-cognitive applications for neuromorphic computing
Journal Article · 2022 · Neuromorphic Computing and Engineering · OSTI ID:1886076

Related Subjects