A Comparison of Neuromorphic Classification Tasks

Reynolds, John; Plank, James; Schuman, Catherine; Bruer, Grant; Disney, Adam; Dean, Mark; Rose, Garrett

doi:10.1145/3229884.3229896

A Comparison of Neuromorphic Classification Tasks

Conference · Sun Jul 01 00:00:00 EDT 2018

DOI:https://doi.org/10.1145/3229884.3229896· OSTI ID:1462845

Reynolds, John ^[1]; Plank, James ^[1]; ^[2]; Bruer, Grant ^[1]; Disney, Adam ^[1]; Dean, Mark ^[1]; Rose, Garrett ^[1]

University of Tennessee (UT)
ORNL

A variety of neural network models and machine learning techniques have arisen over the past decade, and their successes with image classification have been stunning. With other classification tasks, selecting and configuring a neural network solution is not straightforward. In this paper, we evaluate and compare a variety of neural network models, trained by a variety of machine learning techniques, on a variety of classification tasks. While Deep Learning typically exhibits the best classification accuracy, we note the promise of Reservoir Computing, and evolutionary optimization on spiking neural networks. In many cases, these technologies perform as well as, or better than Deep Learning, and the resulting networks are much smaller than their Deep Learning counterparts.

View Conference

Research Organization:: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)

Sponsoring Organization:: USDOE

DOE Contract Number:: AC05-00OR22725

OSTI ID:: 1462845

Country of Publication:: United States

Language:: English

References (14)

Long Short-Term Memory Hochreiter, Sepp; Schmidhuber, Jürgen Neural Computation, Vol. 9, Issue 8 https://doi.org/10.1162/neco.1997.9.8.1735	journal	November 1997
CNTK: Microsoft's Open-Source Deep-Learning Toolkit Seide, Frank; Agarwal, Amit Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining - KDD '16 https://doi.org/10.1145/2939672.2945397	conference	January 2016
EEG signal classification using PCA, ICA, LDA and support vector machines Subasi, Abdulhamit; Ismail Gursoy, M. Expert Systems with Applications, Vol. 37, Issue 12 https://doi.org/10.1016/j.eswa.2010.06.065	journal	December 2010
The Elements of Statistical Learning Hastie, Trevor; Tibshirani, Robert; Friedman, Jerome Springer Series in Statistics https://doi.org/10.1007/978-0-387-84858-7	book	January 2009
Robustness of a memristor based liquid state machine Soures, Nicholas; Hays, Lydia; Kudithipudi, Dhireesha 2017 International Joint Conference on Neural Networks (IJCNN) https://doi.org/10.1109/IJCNN.2017.7966149	conference	May 2017
Comparison of different implementations of MFCC Zheng, Fang; Zhang, Guoliang; Song, Zhanjiang Journal of Computer Science and Technology, Vol. 16, Issue 6 https://doi.org/10.1007/BF02943243	journal	November 2001
Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations Maass, Wolfgang; Natschläger, Thomas; Markram, Henry Neural Computation, Vol. 14, Issue 11 https://doi.org/10.1162/089976602760407955	journal	November 2002
Information processing using a single dynamical node as complex system Appeltant, L.; Soriano, M. C.; Van der Sande, G. Nature Communications, Vol. 2, Issue 1 https://doi.org/10.1038/ncomms1476	journal	September 2011
Indications of nonlinear deterministic and finite-dimensional structures in time series of brain electrical activity: Dependence on recording region and brain state Andrzejak, Ralph G.; Lehnertz, Klaus; Mormann, Florian Physical Review E, Vol. 64, Issue 6 https://doi.org/10.1103/PhysRevE.64.061907	journal	November 2001
Gradient-based learning applied to document recognition Lecun, Y.; Bottou, L.; Bengio, Y. Proceedings of the IEEE, Vol. 86, Issue 11 https://doi.org/10.1109/5.726791	journal	January 1998
Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences Davis, S.; Mermelstein, P. IEEE Transactions on Acoustics, Speech, and Signal Processing, Vol. 28, Issue 4 https://doi.org/10.1109/TASSP.1980.1163420	journal	August 1980
Improving liquid state machines through iterative refinement of the reservoir Norton, David; Ventura, Dan Neurocomputing, Vol. 73, Issue 16-18 https://doi.org/10.1016/j.neucom.2010.08.005	journal	October 2010
Spatiotemporal Classification Using Neuroscience-Inspired Dynamic Architectures Schuman, Catherine D.; Birdwell, J. Douglas; Dean, Mark E. Procedia Computer Science, Vol. 41 https://doi.org/10.1016/j.procs.2014.11.089	journal	January 2014
A Unified Hardware/Software Co-Design Framework for Neuromorphic Computing Devices and Applications Plank, James S.; Rose, Garrett S.; Dean, Mark E. 2017 IEEE International Conference on Rebooting Computing (ICRC) https://doi.org/10.1109/ICRC.2017.8123655	conference	November 2017

Similar Records

Evolutionary Optimization for Neuromorphic Systems

Conference · Sat Feb 29 23:00:00 EST 2020 · OSTI ID:1649325

Evolving Ensembles of Spiking Neural Networks for Neuromorphic Systems

Conference · Mon Nov 30 23:00:00 EST 2020 · OSTI ID:1760126

A Software Framework for Comparing Training Approaches for Spiking Neuromorphic Systems

Conference · Thu Jul 01 00:00:00 EDT 2021 · OSTI ID:1823363

A Comparison of Neuromorphic Classification Tasks

Citation Formats

References (14)

Similar Records

Related Subjects