Deep unsupervised learning using spike-timing-dependent plasticity
Abstract Spike-timing-dependent plasticity (STDP) is an unsupervised learning mechanism for spiking neural networks that has received significant attention from the neuromorphic hardware community. However, scaling such local learning techniques to deeper networks and large-scale tasks has remained elusive. In this work, we investigate a Deep-STDP framework where a rate-based convolutional network, that can be deployed in a neuromorphic setting, is trained in tandem with pseudo-labels generated by the STDP clustering process on the network outputs. We achieve 24.56% higher accuracy and 3.5 × faster convergence speed at iso-accuracy on a 10-class subset of the Tiny ImageNet dataset in contrast to a k -means clustering approach.
- Sponsoring Organization:
- USDOE
- Grant/Contract Number:
- SC0021562
- OSTI ID:
- 2345948
- Alternate ID(s):
- OSTI ID: 2333701
- Journal Information:
- Neuromorphic Computing and Engineering, Journal Name: Neuromorphic Computing and Engineering Journal Issue: 2 Vol. 4; ISSN 2634-4386
- Publisher:
- IOP PublishingCopyright Statement
- Country of Publication:
- United Kingdom
- Language:
- English
Similar Records
Training Spiking Neural Networks with Synaptic Plasticity under Integer Representation
Design of a Robust Memristive Spiking Neuromorphic System with Unsupervised Learning in Hardware