Combining Spike Time Dependent Plasticity (STDP) and Backpropagation (BP) for Robust and Data Efficient Spiking Neural Networks (SNN)
- Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
National security applications require artificial neural networks (ANNs) that consume less power, are fast and dynamic online learners, are fault tolerant, and can learn from unlabeled and imbalanced data. We explore whether two fundamentally different, traditional learning algorithms from artificial intelligence and the biological brain can be merged. We tackle this problem from two directions. First, we start from a theoretical point of view and show that the spike time dependent plasticity (STDP) learning curve observed in biological networks can be derived using the mathematical framework of backpropagation through time. Second, we show that transmission delays, as observed in biological networks, improve the ability of spiking networks to perform classification when trained using a backpropagation of error (BP) method. These results provide evidence that STDP could be compatible with a BP learning rule. Combining these learning algorithms will likely lead to networks more capable of meeting our national security missions.
- Research Organization:
- Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States)
- Sponsoring Organization:
- USDOE National Nuclear Security Administration (NNSA); USDOE Laboratory Directed Research and Development (LDRD) Program
- DOE Contract Number:
- NA0003525;
- OSTI ID:
- 1902866
- Report Number(s):
- SAND2022-16962; 712578
- Country of Publication:
- United States
- Language:
- English
Similar Records
Training Spiking Neural Networks Using Combined Learning Approaches
Backpropagation-based learning with local derivative approximation and memory replay in biologically plausible neural systems
A dynamic node architecture scheme for backpropagation neural networks
Conference
·
2020
·
OSTI ID:1760122
Backpropagation-based learning with local derivative approximation and memory replay in biologically plausible neural systems
Journal Article
·
2025
· Neurocomputing
·
OSTI ID:2543087
A dynamic node architecture scheme for backpropagation neural networks
Conference
·
1990
·
OSTI ID:6603686