Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Leveraging dendritic complexity for neuromorphic computing

Journal Article · · Neuromorphic Computing and Engineering
Abstract

Beyond-von Neumann computing approaches are necessary to sustain the growth of microelectronics and the increasing appetite for artificial intelligence/machine learning algorithms. Neuromorphic computing is an emerging paradigm that takes inspiration from the brain to provide a path forward to improve the computational efficiency and computational density of next-generation computing architectures. In nature, we observe brains performing complex computations with a much smaller energy footprint than conventional computing approaches. Current neuromorphic systems are focused primarily on scalability, namely, increasing the number of computational units (neurons) and connections between units (synapses). However, for brain-like cognition and efficiency in next-generation computing hardware, we need increased complexity in function, as well as improved connection density for scalability. Here, we present our work that aims to incorporate dendrites for ‘compute-on-wire’ in neuromorphic architectures to increase the computational complexity (e.g. number of programmable parameters, nonlinear dynamics) as well as computational efficiency (energy/compute) of artificial neural networks (ANNs). We do this by showcasing neuromorphic dendrite elements that can be leveraged for various applications. We will present examples of neuroscience-inspired direction-selective circuits and an ANN with active dendrites leveraging shunting inhibition. We also demonstrate the benefits of using dendrites in deep neural networks. To conclude, we discuss how we can utilize emerging hardware devices in these systems and design next-generation neuromorphic architectures with dendrites.

Sponsoring Organization:
USDOE; USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
OSTI ID:
2566609
Alternate ID(s):
OSTI ID: 2563446
Journal Information:
Neuromorphic Computing and Engineering, Journal Name: Neuromorphic Computing and Engineering Journal Issue: 2 Vol. 5; ISSN 2634-4386
Publisher:
IOP PublishingCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (107)

A Memristors‐Based Dendritic Neuron for High‐Efficiency Spatial‐Temporal Information Processing journal July 2022
Truly Heterogeneous HPC: Co-design to Achieve What Science Needs from HPC book January 2020
Frameworks for SNNs: A Review of Data Science-Oriented Software and an Expansion of SpykeTorch book January 2023
Excitable dendrites and spines: earlier theoretical insights elucidate recent direct observations journal November 1998
Dendrites: bug or feature? journal June 2003
Drawing inspiration from biological dendrites to empower artificial neural networks journal October 2021
Arthropod neurons and nervous system journal October 2016
Deep learning in spiking neural networks journal March 2019
The hardware is the software journal January 2024
Emulating Dendritic Computing Paradigms on Analog Neuromorphic Hardware journal May 2022
Active Dendrites and Local Field Potentials: Biophysical Mechanisms and Computational Explorations journal May 2022
Dendritic Computing: Branching Deeper into Machine Learning journal May 2022
Simulation Tool for Asynchronous Cortical Streams (STACS): Interfacing with Spiking Neural Networks journal January 2015
Feature-based attention influences motion processing gain in macaque visual cortex journal June 1999
Sound grounds for computing dendrites journal May 1998
The role of dendrites in auditory coincidence detection journal May 1998
Head position signals used by parietal neurons to encode locations of visual stimuli journal May 1995
Internal models direct dragonfly interception steering journal December 2014
The functional asymmetry of auditory cortex is reflected in the organization of local cortical circuits journal October 2010
Putting big data to good use in neuroscience journal October 2014
DenRAM: neuromorphic dendritic architecture with RRAM for efficient temporal processing with delays journal April 2024
Power-efficient neural network with artificial dendrites journal June 2020
Photonics for artificial intelligence and neuromorphic computing journal January 2021
Illuminating dendritic function with computational models journal May 2020
Third-order nanocircuit elements for neuromorphic engineering journal September 2020
A biophysical account of multiplication by a single neuron journal February 2022
A compute-in-memory chip based on resistive random-access memory journal August 2022
Dendrocentric learning for synthetic intelligence journal November 2022
Neuromorphic computing at scale journal January 2025
Central gating of fly optomotor response journal November 2010
Cozzarelli Prize Winner: Eight pairs of descending visual neurons in the dragonfly give wing motor centers accurate population vector of prey direction journal December 2012
Nonlinear interactions in a dendritic tree: localization, timing, and role in information processing. journal May 1983
Fundamental Properties of Intensity, Form, and Motion Perception in the Visual Nervous Systems of Calliphora phaenicia and Musca domestica journal April 1969
Interception by two predatory fly species is explained by a proportional navigation feedback controller journal October 2018
Language Modeling on a SpiNNaker2 Neuromorphic Chip conference April 2024
From Words to Watts: Benchmarking the Energy Costs of Large Language Model Inference conference September 2023
Efficient Video and Audio Processing with Loihi 2 conference April 2024
Bio-Inspired Active Silicon Dendrite for Direction Selectivity conference July 2024
Probabilistic Neural Circuits leveraging AI-Enhanced Codesign for Random Number Generation conference December 2022
Recurrently connected silicon neurons with active dendrites for one-shot learning conference July 2004
An accelerated analog neuromorphic hardware system emulating NMDA- and calcium-based non-linear dendrites conference May 2017
Programmable Floating Gate FPAA Switches Are Not Dead Weight conference May 2007
A biophysically based dendrite model using programmable floating-gate devices conference May 2008
Hardware and software infrastructure for a family of floating-gate based FPAAs conference May 2010
Neural-Inspired Dendritic Multiplication Using a Reconfigurable Analog Integrated Circuit conference May 2024
Device Codesign using Reinforcement Learning conference May 2024
The SpiNNaker Project journal May 2014
Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations journal May 2014
Training Spiking Neural Networks Using Lessons From Deep Learning journal September 2023
What the Frog's Eye Tells the Frog's Brain journal November 1959
A Digitally Enhanced Dynamically Reconfigurable Analog Platform for Low-Power Signal Processing journal September 2012
SPAIC: A Spike-Based Artificial Intelligence Computing Framework journal February 2024
A New Golden Age in Computer Architecture: Empowering the Machine-Learning Revolution journal March 2018
Loihi: A Neuromorphic Manycore Processor with On-Chip Learning journal January 2018
Emerging Memory Technologies: Recent Trends and Prospects journal April 2016
AI-Enhanced Codesign of Neuromorphic Circuits conference August 2023
Expressive Dendrites in Spiking Networks conference April 2024
Efficient Neuromorphic Signal Processing with Loihi 2 conference October 2021
Modeling and Implementation of Voltage-Mode CMOS Dendrites on a Reconfigurable Analog Platform journal February 2012
A Learning-Enabled Neuron Array IC Based Upon Transistor Channel Models of Biological Phenomena journal February 2013
Neuron Array With Plastic Synapses and Programmable Dendrites journal October 2013
A Scalable Multicore Architecture With Heterogeneous Memory Structures for Dynamic Neuromorphic Asynchronous Processors (DYNAPs) journal February 2018
Hardware Implementation of Deep Network Accelerators Towards Healthcare and Biomedical Applications journal December 2020
Angel-Eye: A Complete Design Flow for Mapping CNN Onto Embedded FPGA journal January 2018
SANA-FE: Simulating Advanced Neuromorphic Architectures for Fast Exploration journal January 2025
Mismatch Characterization and Calibration for Accurate and Automated Analog Design journal March 2013
A Programmable and Configurable Mixed-Mode FPAA SoC journal January 2016
The effect of inhibitory nerve impulses on a crustacean muscle fibre journal August 1953
Receptive fields of single neurones in the cat's striate cortex journal October 1959
Receptive fields, binocular interaction and functional architecture in the cat's visual cortex journal January 1962
Retinal ganglion cells responding selectively to direction and speed of image motion in the rabbit journal September 1964
SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligence journal October 2023
A million spiking-neuron integrated circuit with a scalable communication network and interface journal August 2014
Selective Sensitivity to Direction of Movement in Ganglion Cells of the Rabbit Retina journal February 1963
Encoding of Spatial Location by Posterior Parietal Neurons journal October 1985
Dendritic action potentials and computation in human layer 2/3 cortical neurons journal January 2020
Neural inference at the frontier of energy, space, and time journal October 2023
Programming parallel algorithms journal March 1996
Composing neural algorithms with Fugu
  • Aimone, James B.; Severa, William; Vineyard, Craig M.
  • ICONS '19: International Conference on Neuromorphic Systems, Proceedings of the International Conference on Neuromorphic Systems https://doi.org/10.1145/3354265.3354268
conference July 2019
Interception from a Dragonfly Neural Network Model conference July 2020
Shunting Inhibition as a Neural-Inspired Mechanism for Multiplication in Neuromorphic Architectures conference April 2023
Performance and Energy Simulation of Spiking Neuromorphic Architectures for Fast Exploration conference August 2023
Dendritic Computation for Neuromorphic Applications conference August 2023
Power Hungry Processing: Watts Driving the Cost of AI Deployment? conference June 2024
Visual Circuits for Direction Selectivity journal July 2017
Dendritic Computation journal July 2005
Motion detection by interneurons of optic lobes and brain of the flies Calliphora phaenicia and Musca domestica. journal July 1968
Theoretical reconstruction of field potentials and dendrodendritic synaptic interactions in olfactory bulb. journal November 1968
Systemtheoretische Analyse der Zeit-, Reihenfolgen- und Vorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers Chlorophanus journal October 1956
The influence of the angle of gaze upon the excitability of the light- sensitive neurons of the posterior parietal cortex journal March 1983
Effects of Attention on Orientation-Tuning Functions of Single Neurons in Macaque Cortical Area V4 journal January 1999
Nonlinear Integration of Visual and Haltere Inputs in Fly Neck Motor Neurons journal October 2009
SpiNNaker 2: A 10 Million Core Processor System for Brain Simulation and Machine Learning book January 2019
Diversity of Axonal and Dendritic Contributions to Neuronal Output journal January 2020
Nengo: a Python tool for building large-scale functional brain models journal January 2014
Converting Static Image Datasets to Spiking Neuromorphic Datasets Using Saccades journal November 2015
Large-Scale Neuromorphic Spiking Array Processors: A Quest to Mimic the Brain journal December 2018
In situ Parallel Training of Analog Neural Network Using Electrochemical Random-Access Memory journal April 2021
Low Power Dendritic Computation for Wordspotting journal May 2013
A Heterogeneous Hardware Accelerator for Image Classification in Embedded Systems journal April 2021
NEST (NEural Simulation Tool) journal January 2007
The SpiNNaker 2 Processing Element Architecture for Hybrid Digital Neuromorphic Computing preprint January 2021
LaMDA: Language Models for Dialog Applications preprint January 2022
Training Compute-Optimal Large Language Models preprint January 2022
SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks preprint January 2023
A Bibliometric Review of Neuromorphic Computing and Spiking Neural Networks preprint January 2023
Brian 2, an intuitive and efficient neural simulator journal August 2019

Similar Records

Dendritic Computing with Multigate Ferroelectric Field-Effect Transistors
Journal Article · Sun Oct 26 20:00:00 EDT 2025 · Nano Letters · OSTI ID:3000228

Real-Time Neuromorphic Processing of Spatiotemporal Data for Scientific Discovery
Technical Report · Wed Jan 17 23:00:00 EST 2024 · OSTI ID:2281801

Related Subjects