A Programming Framework for Neuromorphic Systems with Emerging Technologies

Schuman, Catherine; Plank, James; Rose, Garrett; Chakma, Gangotree; Wyer, Austin; Bruer, Grant; Laanait, Nouamane

doi:10.1145/3109453.3123958

A Programming Framework for Neuromorphic Systems with Emerging Technologies

Conference · Sun Oct 01 04:00:00 EDT 2017

DOI:https://doi.org/10.1145/3109453.3123958· OSTI ID:1407781

^[1]; Plank, James ^[2]; Rose, Garrett ^[2]; Chakma, Gangotree ^[2]; Wyer, Austin ^[3]; Bruer, Grant ^[2]; ^[1]

ORNL
University of Tennessee (UT)
University of Tennessee, Knoxville (UTK)

Neuromorphic computing is a promising post-Moore's law era technology. A wide variety of neuromorphic computer (NC) architectures have emerged in recent years, ranging from traditional fully digital CMOS to nanoscale implementations with novel, beyond CMOS components. There are already major questions associated with how we are going to program and use NCs simply because of how radically different their architecture is as compared with the von Neumann architecture. When coupled with the implementations using emerging device technologies, which add additional issues associated with programming devices, it is clear that we must define a new way to program and develop for NC devices. In this work, we discuss a programming framework for NC devices implemented with emerging technologies. We discuss how we have applied this framework to program a NC system implemented with metal oxide memristors. We utilize the framework to develop two applications for the memristive NC device: a simple multiplexer and a simple control task (the cart-pole problem). Finally, we discuss how this framework can be extended to NC systems implemented with a variety of novel device components and materials.

View Conference

Research Organization:: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)

Sponsoring Organization:: USDOE

DOE Contract Number:: AC05-00OR22725

OSTI ID:: 1407781

Country of Publication:: United States

Language:: English

References (37)

Challenges for large-scale implementations of spiking neural networks on FPGAs Maguire, L. P.; McGinnity, T. M.; Glackin, B. Neurocomputing, Vol. 71, Issue 1-3 https://doi.org/10.1016/j.neucom.2006.11.029	journal	December 2007
Convolutional networks for fast, energy-efficient neuromorphic computing Esser, Steven K.; Merolla, Paul A.; Arthur, John V. Proceedings of the National Academy of Sciences, Vol. 113, Issue 41 https://doi.org/10.1073/pnas.1604850113	journal	September 2016
Neuromorphic computing gets ready for the (really) big time Monroe, Don Communications of the ACM, Vol. 57, Issue 6 https://doi.org/10.1145/2601069	journal	June 2014
Physical Realization of a Supervised Learning System Built with Organic Memristive Synapses Lin, Yu-Pu; Bennett, Christopher H.; Cabaret, Théo Scientific Reports, Vol. 6, Issue 1 https://doi.org/10.1038/srep31932	journal	September 2016
Parallel Evolutionary Optimization for Neuromorphic Network Training Schuman, Catherine D.; Disney, Adam; Singh, Susheela P. 2016 2nd Workshop on Machine Learning in HPC Environments (MLHPC) https://doi.org/10.1109/MLHPC.2016.008	conference	November 2016
Spintronic Nanodevices for Bioinspired Computing Grollier, Julie; Querlioz, Damien; Stiles, Mark D. Proceedings of the IEEE, Vol. 104, Issue 10 https://doi.org/10.1109/JPROC.2016.2597152	journal	October 2016
Neuroscience-inspired inspired dynamic architectures Schuman, Catherine D.; Birdwell, J. Douglas; Dean, Mark Proceedings of the 2014 Biomedical Sciences and Engineering Conference https://doi.org/10.1109/BSEC.2014.6867735	conference	May 2014
Band-Selective Measurements of Electron Dynamics in VO 2 Using Femtosecond Near-Edge X-Ray Absorption Cavalleri, A.; Rini, M.; Chong, H. H. W. Physical Review Letters, Vol. 95, Issue 6 https://doi.org/10.1103/PhysRevLett.95.067405	journal	August 2005
Competitive Hebbian learning through spike-timing-dependent synaptic plasticity Song, Sen; Miller, Kenneth D.; Abbott, L. F. Nature Neuroscience, Vol. 3, Issue 9 https://doi.org/10.1038/78829	journal	September 2000
Hebbian spike-driven synaptic plasticity for learning patterns of mean firing rates Fusi, Stefano Biological Cybernetics, Vol. 87, Issue 5-6 https://doi.org/10.1007/s00422-002-0356-8	journal	December 2002
Dynamic Artificial Neural Networks with Affective Systems Schuman, Catherine D.; Birdwell, J. Douglas PLoS ONE, Vol. 8, Issue 11 https://doi.org/10.1371/journal.pone.0080455	journal	November 2013
Demonstration of spike timing dependent plasticity in CBRAM devices with silicon neurons Mahalanabis, D.; Sivaraj, M.; Chen, W. 2016 IEEE International Symposium on Circuits and Systems (ISCAS) https://doi.org/10.1109/ISCAS.2016.7539047	conference	May 2016
Controllable Multiple Depression in a Graphene Oxide Artificial Synapse Wang, Laiyuan; Wang, Zhiyong; Zhao, Wei Advanced Electronic Materials, Vol. 3, Issue 1 https://doi.org/10.1002/aelm.201600244	journal	November 2016
Energy-Efficient Neuromorphic Classifiers Martí, Daniel; Rigotti, Mattia; Seok, Mingoo Neural Computation, Vol. 28, Issue 10 https://doi.org/10.1162/NECO_a_00882	journal	October 2016
Learning to be efficient Neil, Daniel; Pfeiffer, Michael; Liu, Shih-Chii Proceedings of the 31st Annual ACM Symposium on Applied Computing https://doi.org/10.1145/2851613.2851724	conference	April 2016
Electric-Pulse-driven Electronic Phase Separation, Insulator-Metal Transition, and Possible Superconductivity in a Mott Insulator Vaju, Cristian; Cario, Laurent; Corraze, Benoit Advanced Materials, Vol. 20, Issue 14 https://doi.org/10.1002/adma.200702967	journal	July 2008
Dynamic Adaptive Neural Network Array Dean, Mark E.; Schuman, Catherine D.; Birdwell, J. Douglas Unconventional Computation and Natural Computation https://doi.org/10.1007/978-3-319-08123-6_11	book	January 2014
An evolutionary optimization framework for neural networks and neuromorphic architectures Schuman, Catherine D.; Plank, James S.; Disney, Adam 2016 International Joint Conference on Neural Networks (IJCNN) https://doi.org/10.1109/IJCNN.2016.7727192	conference	July 2016
Neural identification of dynamic systems on FPGA with improved PSO learning Cavuslu, Mehmet Ali; Karakuzu, Cihan; Karakaya, Fuat Applied Soft Computing, Vol. 12, Issue 9 https://doi.org/10.1016/j.asoc.2012.03.022	journal	September 2012
An Application Development Platform for neuromorphic computing Dean, Mark E.; Chan, Jason; Daffron, Christopher 2016 International Joint Conference on Neural Networks (IJCNN) https://doi.org/10.1109/IJCNN.2016.7727354	conference	July 2016
A neuromorphic circuit mimicking biological short-term memory Barzegarjalali, Saeid; Parker, Alice C. 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) https://doi.org/10.1109/EMBC.2016.7590970	conference	August 2016
Resistive Switching in Mott Insulators and Correlated Systems Janod, Etienne; Tranchant, Julien; Corraze, Benoit Advanced Functional Materials, Vol. 25, Issue 40 https://doi.org/10.1002/adfm.201500823	journal	July 2015
Training and operation of an integrated neuromorphic network based on metal-oxide memristors Prezioso, M.; Merrikh-Bayat, F.; Hoskins, B. D. Nature, Vol. 521, Issue 7550 https://doi.org/10.1038/nature14441	journal	May 2015
Synaptic plasticity and memristive behavior operated by atomic switches Tsuruoka, Tohru; Hasegawa, Tsuyoshi; Aono, Masakazu 2014 14th International Workshop on Cellular Nanoscale Networks and their Applications (CNNA) https://doi.org/10.1109/CNNA.2014.6888615	conference	July 2014
Resistive switching in transition metal oxides Sawa, Akihito Materials Today, Vol. 11, Issue 6 https://doi.org/10.1016/S1369-7021(08)70119-6	journal	June 2008
Band excitation in scanning probe microscopy: sines of change Jesse, Stephen; Kalinin, Sergei V. Journal of Physics D: Applied Physics, Vol. 44, Issue 46 https://doi.org/10.1088/0022-3727/44/46/464006	journal	November 2011
Critical Behavior of the Mott Transition in Cr-Doped V 2 O 3 Jayaraman, A.; McWhan, D. B.; Remeika, J. P. Physical Review B, Vol. 2, Issue 9 https://doi.org/10.1103/PhysRevB.2.3751	journal	November 1970
Electric-pulse-induced resistive switching and possible superconductivity in the Mott insulator GaTa4Se8 Vaju, C.; Cario, L.; Corraze, B. Microelectronic Engineering, Vol. 85, Issue 12 https://doi.org/10.1016/j.mee.2008.09.026	journal	December 2008
Synaptic plasticity and learning behaviours in flexible artificial synapse based on polymer/viologen system Zhang, Chaochao; Tai, Yu-Tsung; Shang, Jie Journal of Materials Chemistry C, Vol. 4, Issue 15 https://doi.org/10.1039/C6TC00496B	journal	January 2016
Magnetic skyrmion-based synaptic devices Huang, Yangqi; Kang, Wang; Zhang, Xichao Nanotechnology, Vol. 28, Issue 8 https://doi.org/10.1088/1361-6528/aa5838	journal	January 2017
Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations Benjamin, Ben Varkey; Gao, Peiran; McQuinn, Emmett Proceedings of the IEEE, Vol. 102, Issue 5 https://doi.org/10.1109/JPROC.2014.2313565	journal	May 2014
Overview of the SpiNNaker System Architecture Furber, Steve B.; Lester, David R.; Plana, Luis A. IEEE Transactions on Computers, Vol. 62, Issue 12 https://doi.org/10.1109/TC.2012.142	journal	December 2013
Nanoscale Memristor Device as Synapse in Neuromorphic Systems Jo, Sung Hyun; Chang, Ting; Ebong, Idongesit Nano Letters, Vol. 10, Issue 4, p. 1297-1301 https://doi.org/10.1021/nl904092h	journal	April 2010
A million spiking-neuron integrated circuit with a scalable communication network and interface Merolla, P. A.; Arthur, J. V.; Alvarez-Icaza, R. Science, Vol. 345, Issue 6197 https://doi.org/10.1126/science.1254642	journal	August 2014
Evolving Unipolar Memristor Spiking Neural Networks Howard, David; Bull, Larry; de Lacy Costello, Ben Lecture Notes in Computer Science https://doi.org/10.1007/978-3-319-14803-8_20	book	January 2015
Spatiotemporal Classification Using Neuroscience-Inspired Dynamic Architectures Schuman, Catherine D.; Birdwell, J. Douglas; Dean, Mark E. Procedia Computer Science, Vol. 41 https://doi.org/10.1016/j.procs.2014.11.089	journal	January 2014
Extending SpikeProp Schrauwen, B.; Van Campenhout, J. 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541) https://doi.org/10.1109/IJCNN.2004.1379954	conference	January 2004

Similar Records

Neuromorphic Computing – From Materials Research to Systems Architecture Roundtable

Program Document · Thu Oct 29 00:00:00 EDT 2015 · OSTI ID:1283147

Neuromorphic Computing, Architectures, Models, and Applications. A Beyond-CMOS Approach to Future Computing, June 29-July 1, 2016, Oak Ridge, TN

Technical Report · Fri Dec 30 23:00:00 EST 2016 · OSTI ID:1341738

Memristive Mixed-Signal Neuromorphic Systems: Energy-Efficient Learning at the Circuit-Level

Journal Article · Wed Nov 22 19:00:00 EST 2017 · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · OSTI ID:1435263

A Programming Framework for Neuromorphic Systems with Emerging Technologies

Citation Formats

References (37)

Similar Records

Related Subjects