Evolving Ensembles of Spiking Neural Networks for Neuromorphic Systems

Elbrecht, Daniel; Kulkarni, Shruti; Parsa, Maryam; Mitchell, Parker; Schuman, Catherine

doi:10.1109/SSCI47803.2020.9308568

Evolving Ensembles of Spiking Neural Networks for Neuromorphic Systems

Conference · Mon Nov 30 23:00:00 EST 2020

DOI:https://doi.org/10.1109/SSCI47803.2020.9308568· OSTI ID:1760126

Elbrecht, Daniel ^[1]; ^[2]; Parsa, Maryam ^[2]; Mitchell, Parker ^[2]; ^[2]

University of Central Florida
ORNL

Evolutionary algorithms have been proposed as a solution to overcome many of the challenges associated with training spiking neural networks. While evolutionary optimization for spiking neural networks is very flexible, its performance has difficulty scaling to complex tasks and correspondingly complex network structures. Here we propose a method for evolving ensembles of spiking neural networks. By using ensemble learning, the flexibility of evolutionary optimization is fully preserved while scaling to more challenging tasks. We test the performance of the proposed method using handwritten digit classification. We investigate multiple strategies for constructing ensembles of spiking neural networks, and demonstrate that evolving ensembles of SNNs offers significant performance advantages over evolutionary optimization.

View Conference

Research Organization:: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)

Sponsoring Organization:: USDOE; USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)

DOE Contract Number:: AC05-00OR22725

OSTI ID:: 1760126

Country of Publication:: United States

Language:: English

References (16)

Neuroevolution of Spiking Neural Networks Using Compositional Pattern Producing Networks Elbrecht, Daniel; Schuman, Catherine International Conference on Neuromorphic Systems 2020 https://doi.org/10.1145/3407197.3407198	conference	July 2020
Evolutionary Optimization for Neuromorphic Systems Schuman, Catherine D.; Mitchell, J. Parker; Patton, Robert M. NICE '20: Neuro-inspired Computational Elements Workshop, Proceedings of the Neuro-inspired Computational Elements Workshop https://doi.org/10.1145/3381755.3381758	conference	June 2020
A Hypercube-Based Encoding for Evolving Large-Scale Neural Networks Stanley, Kenneth O.; D'Ambrosio, David B.; Gauci, Jason Artificial Life, Vol. 15, Issue 2 https://doi.org/10.1162/artl.2009.15.2.15202	journal	April 2009
Error-backpropagation in temporally encoded networks of spiking neurons Bohte, Sander M.; Kok, Joost N.; La Poutré, Han Neurocomputing, Vol. 48, Issue 1-4 https://doi.org/10.1016/S0925-2312(01)00658-0	journal	October 2002
Evolving artificial neural network ensembles No authors listed IEEE Computational Intelligence Magazine, Vol. 3, Issue 1 https://doi.org/10.1109/MCI.2007.913386	journal	February 2008
An evolutionary optimization framework for neural networks and neuromorphic architectures Schuman, Catherine D.; Plank, James S.; Disney, Adam 2016 International Joint Conference on Neural Networks (IJCNN) https://doi.org/10.1109/IJCNN.2016.7727192	conference	July 2016
Evolving Neural Network Ensembles by Minimization of Mutual Information Yao, Xin; Liu, Yong International Journal of Hybrid Intelligent Systems, Vol. 1, Issue 1-2 https://doi.org/10.3233/HIS-2004-11-204	journal	September 2004
Caspian Mitchell, J. Parker; Schuman, Catherine D.; Patton, Robert M. Proceedings of the Neuro-inspired Computational Elements Workshop https://doi.org/10.1145/3381755.3381764	conference	March 2020
Evolving spiking neural networks for robot control Batllori, R.; Laramee, C. B.; Land, W. Procedia Computer Science, Vol. 6 https://doi.org/10.1016/j.procs.2011.08.060	journal	January 2011
Evolving artificial neural networks No authors listed Proceedings of the IEEE, Vol. 87, Issue 9 https://doi.org/10.1109/5.784219	journal	January 1999
Unsupervised Learning in an Ensemble of Spiking Neural Networks Mediated by ITDP Shim, Yoonsik; Philippides, Andrew; Staras, Kevin PLOS Computational Biology, Vol. 12, Issue 10 https://doi.org/10.1371/journal.pcbi.1005137	journal	October 2016
Neural network ensembles: evaluation of aggregation algorithms Granitto, P. M.; Verdes, P. F.; Ceccatto, H. A. Artificial Intelligence, Vol. 163, Issue 2 https://doi.org/10.1016/j.artint.2004.09.006	journal	April 2005
Training Deep Spiking Neural Networks Using Backpropagation Lee, Jun Haeng; Delbruck, Tobi; Pfeiffer, Michael Frontiers in Neuroscience, Vol. 10 https://doi.org/10.3389/fnins.2016.00508	journal	November 2016
A Small, Low Cost Event-Driven Architecture for Spiking Neural Networks on FPGAs Mitchell, J. Parker; Schuman, Catherine D.; Potok, Thomas E. ICONS 2020: International Conference on Neuromorphic Systems 2020 https://doi.org/10.1145/3407197.3407216	conference	July 2020
Networks of spiking neurons: The third generation of neural network models Maass, Wolfgang Neural Networks, Vol. 10, Issue 9 https://doi.org/10.1016/S0893-6080(97)00011-7	journal	December 1997
Explaining AdaBoost Schapire, Robert E. Empirical Inference https://doi.org/10.1007/978-3-642-41136-6_5	book	January 2013

Similar Records

SNNVis: Visualizing Graph Embedding of Evolutionary Optimization for Spiking Neural Networks

Conference · Sat Nov 30 23:00:00 EST 2024 · OSTI ID:2573544

Neuroevolution of Spiking Neural Networks Using Compositional Pattern Producing Networks

Conference · Wed Jul 01 00:00:00 EDT 2020 · OSTI ID:1649077

Benchmarking the Performance of Neuromorphic and Spiking Neural Network Simulators

Journal Article · Thu Mar 18 00:00:00 EDT 2021 · Neurocomputing · OSTI ID:1779135

Evolving Ensembles of Spiking Neural Networks for Neuromorphic Systems

Citation Formats

References (16)

Similar Records

Related Subjects