Encoding integers and rationals on neuromorphic computers using virtual neuron

Date, Prasanna; Kulkarni, Shruti; Young, Aaron; Schuman, Catherine; Potok, Thomas; Vetter, Jeffrey

doi:10.1038/s41598-023-35005-x

Title: Encoding integers and rationals on neuromorphic computers using virtual neuron

Journal Article · 05 July 2023 · Scientific Reports

DOI: https://doi.org/10.1038/s41598-023-35005-x · OSTI ID:1988323

Date, Prasanna; Kulkarni, Shruti; Young, Aaron; Schuman, Catherine; Potok, Thomas; Vetter, Jeffrey

Abstract Neuromorphic computers emulate the human brain while being extremely power efficient for computing tasks. In fact, they are poised to be critical for energy-efficient computing in the future. Neuromorphic computers are primarily used in spiking neural network–based machine learning applications. However, they are known to be Turing-complete, and in theory can perform all general-purpose computation. One of the biggest bottlenecks in realizing general-purpose computations on neuromorphic computers today is the inability to efficiently encode data on the neuromorphic computers. To fully realize the potential of neuromorphic computers for energy-efficient general-purpose computing, efficient mechanisms must be devised for encoding numbers. Current encoding mechanisms (e.g., binning, rate-based encoding, and time-based encoding) have limited applicability and are not suited for general-purpose computation. In this paper, we present the virtual neuron abstraction as a mechanism for encoding and adding integers and rational numbers by using spiking neural network primitives. We evaluate the performance of the virtual neuron on physical and simulated neuromorphic hardware. We estimate that the virtual neuron could perform an addition operation using just 23 nJ of energy on average with a mixed-signal, memristor-based neuromorphic processor. We also demonstrate the utility of the virtual neuron by using it in some of the μ -recursive functions, which are the building blocks of general-purpose computation.

View Journal Article

Cite

Export

Save

Research Organization:: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)

Sponsoring Organization:: USDOE; USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)

Grant/Contract Number:: AC05-00OR22725

OSTI ID:: 1988323

Journal Information:: Scientific Reports, Journal Name: Scientific Reports Journal Issue: 1 Vol. 13; ISSN 2045-2322

Publisher:: Nature Publishing GroupCopyright Statement

Country of Publication:: United Kingdom

Language:: English

References (48)

A Review of the Integrate-and-fire Neuron Model: I. Homogeneous Synaptic Input Burkitt, A. N. Biological Cybernetics, Vol. 95, Issue 1 https://doi.org/10.1007/s00422-006-0068-6	journal	April 2006
Memory-centric neuromorphic computing for unstructured data processing Sung, Sang Hyun; Kim, Tae Jin; Shin, Hera Nano Research, Vol. 14, Issue 9 https://doi.org/10.1007/s12274-021-3452-6	journal	April 2021
FPGA based spike-time dependent encoder and reservoir design in neuromorphic computing processors Yi, Yang; Liao, Yongbo; Wang, Bin Microprocessors and Microsystems, Vol. 46 https://doi.org/10.1016/j.micpro.2016.03.009	journal	October 2016
Training spiking neural networks to associate spatio-temporal input–output spike patterns Mohemmed, Ammar; Schliebs, Stefan; Matsuda, Satoshi Neurocomputing, Vol. 107 https://doi.org/10.1016/j.neucom.2012.08.034	journal	May 2013
IEEE 754 floating-point addition for neuromorphic architecture George, Arun M.; Sharma, Rahul; Rao, Shrisha Neurocomputing, Vol. 366 https://doi.org/10.1016/j.neucom.2019.05.093	journal	November 2019
Matrix multiplication by neuromorphic computing Lawrence, Sheril; Yandapalli, Aishwarya; Rao, Shrisha Neurocomputing, Vol. 431 https://doi.org/10.1016/j.neucom.2020.10.064	journal	March 2021
Deep learning in spiking neural networks Tavanaei, Amirhossein; Ghodrati, Masoud; Kheradpisheh, Saeed Reza Neural Networks, Vol. 111 https://doi.org/10.1016/j.neunet.2018.12.002	journal	March 2019
Neuromorphic spintronics Grollier, J.; Querlioz, D.; Camsari, K. Y. Nature Electronics, Vol. 3, Issue 7 https://doi.org/10.1038/s41928-019-0360-9	journal	March 2020
Encoding neural and synaptic functionalities in electron spin: A pathway to efficient neuromorphic computing Sengupta, Abhronil; Roy, Kaushik Applied Physics Reviews, Vol. 4, Issue 4 https://doi.org/10.1063/1.5012763	journal	December 2017
Neuromorphic encoding of image pixel data into rate-coded optical spike trains with a photonic VCSEL-neuron Hejda, Matěj; Robertson, Joshua; Bueno, Julián APL Photonics, Vol. 6, Issue 6 https://doi.org/10.1063/5.0048674	journal	June 2021
Introducing ‘Neuromorphic Computing and Engineering’ Indiveri, Giacomo Neuromorphic Computing and Engineering, Vol. 1, Issue 1 https://doi.org/10.1088/2634-4386/ac0a5b	journal	July 2021
Neuromorphic electronic systems Mead, C. Proceedings of the IEEE, Vol. 78, Issue 10 https://doi.org/10.1109/5.58356	journal	January 1990
Fast Ripple-Carry Adders in Standard-Cell CMOS VLSI Burgess, Neil 2011 IEEE 20th Symposium on Computer Arithmetic https://doi.org/10.1109/ARITH.2011.23	conference	July 2011
Neuromorphic encoding system design with chaos based CMOS analog neuron Zhao, Chenyuan; Danesh, Wafi; Wysocki, Bryant T. 2015 IEEE Symposium on Computational Intelligence for Security and Defense Applications (CISDA) https://doi.org/10.1109/CISDA.2015.7208631	conference	May 2015
Event-Driven Signal Processing with Neuromorphic Computing Systems Blouw, Peter; Eliasmith, Chris ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) https://doi.org/10.1109/ICASSP40776.2020.9053043	conference	May 2020
Non-Traditional Input Encoding Schemes for Spiking Neuromorphic Systems Schuman, Catherine D.; Plank, James S.; Bruer, Grant 2019 International Joint Conference on Neural Networks (IJCNN) https://doi.org/10.1109/IJCNN.2019.8852139	conference	July 2019
Sparse Binary Matrix-Vector Multiplication on Neuromorphic Computers Schuman, Catherine D.; Kay, Bill; Date, Prasanna 2021 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW) https://doi.org/10.1109/IPDPSW52791.2021.00054	conference	June 2021
A dynamic fixed-point representation for neuromorphic computing systems Kang, Yongshin; Chung, Jaeyong 2017 International SoC Design Conference (ISOCC) https://doi.org/10.1109/ISOCC.2017.8368819	conference	November 2017
An Ultra Low-Power Memristive Neuromorphic Circuit for Internet of Things Smart Sensors Fayyazi, Arash; Ansari, Mohammad; Kamal, Mehdi IEEE Internet of Things Journal, Vol. 5, Issue 2 https://doi.org/10.1109/JIOT.2018.2799948	journal	April 2018
Loihi: A Neuromorphic Manycore Processor with On-Chip Learning Davies, Mike; Srinivasa, Narayan; Lin, Tsung-Han IEEE Micro, Vol. 38, Issue 1 https://doi.org/10.1109/MM.2018.112130359	journal	January 2018
Efficient Classification of Supercomputer Failures Using Neuromorphic Computing Date, Prasanna; Carothers, Christopher D.; Hendler, James A. 2018 IEEE Symposium Series on Computational Intelligence (SSCI) https://doi.org/10.1109/SSCI.2018.8628946	conference	November 2018
A Scalable Multicore Architecture With Heterogeneous Memory Structures for Dynamic Neuromorphic Asynchronous Processors (DYNAPs) Moradi, Saber; Qiao, Ning; Stefanini, Fabio IEEE Transactions on Biomedical Circuits and Systems, Vol. 12, Issue 1 https://doi.org/10.1109/TBCAS.2017.2759700	journal	February 2018
TrueNorth: Design and Tool Flow of a 65 mW 1 Million Neuron Programmable Neurosynaptic Chip Akopyan, Filipp; Sawada, Jun; Cassidy, Andrew IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, Vol. 34, Issue 10 https://doi.org/10.1109/TCAD.2015.2474396	journal	October 2015
Neuromorphic implementation of orientation hypercolumns Choi, T. Y. W.; Merolla, P. A.; Arthur, J. V. IEEE Transactions on Circuits and Systems I: Regular Papers, Vol. 52, Issue 6 https://doi.org/10.1109/TCSI.2005.849136	journal	June 2005
Efficient Spiking Neural Networks With Radix Encoding Wang, Zhehui; Gu, Xiaozhe; Goh, Rick Siow Mong IEEE Transactions on Neural Networks and Learning Systems https://doi.org/10.1109/TNNLS.2022.3195918	journal	January 2022
Spiking Neural Networks Ghosh-Dastidar, Samanwoy; Adeli, Hojjat International Journal of Neural Systems, Vol. 19, Issue 04 https://doi.org/10.1142/S0129065709002002	journal	August 2009
A neuromorphic approach to computer vision Serre, Thomas; Poggio, Tomaso Communications of the ACM, Vol. 53, Issue 10 https://doi.org/10.1145/1831407.1831425	journal	October 2010
Spike-Time-Dependent Encoding for Neuromorphic Processors Zhao, Chenyuan; Wysocki, Bryant T.; Liu, Yifang ACM Journal on Emerging Technologies in Computing Systems, Vol. 12, Issue 3 https://doi.org/10.1145/2738040	journal	September 2015
Making neural encoding robust and energy efficient Zhao, Chenyuan; Li, Jialing; Yi, Yang Proceedings of the 35th International Conference on Computer-Aided Design https://doi.org/10.1145/2966986.2967052	conference	November 2016
Energy and Area Efficiency in Neuromorphic Computing for Resource Constrained Devices Chakma, Gangotree; Skuda, Nicholas D.; Schuman, Catherine D. Proceedings of the 2018 on Great Lakes Symposium on VLSI https://doi.org/10.1145/3194554.3194611	conference	May 2018
Neuromorphic Graph Algorithms Kay, Bill; Date, Prasanna; Schuman, Catherine Proceedings of the Neuro-inspired Computational Elements Workshop https://doi.org/10.1145/3381755.3381762	conference	March 2020
Caspian Mitchell, J. Parker; Schuman, Catherine D.; Patton, Robert M. Proceedings of the Neuro-inspired Computational Elements Workshop https://doi.org/10.1145/3381755.3381764	conference	March 2020
Spike-based graph centrality measures Hamilton, Kathleen; Mintz, Tiffany; Date, Prasanna International Conference on Neuromorphic Systems 2020 https://doi.org/10.1145/3407197.3407199	conference	July 2020
Modeling epidemic spread with spike-based models Hamilton, Kathleen; Date, Prasanna; Kay, Bill ICONS 2020: International Conference on Neuromorphic Systems 2020 https://doi.org/10.1145/3407197.3407219	conference	July 2020
Computational Complexity of Neuromorphic Algorithms Date, Prasanna; Kay, Bill; Schuman, Catherine International Conference on Neuromorphic Systems 2021 https://doi.org/10.1145/3477145.3477154	conference	July 2021
Spiking Neuromorphic Networks for Binary Tasks Plank, James; Zheng, Chaohui; Schuman, Catherine International Conference on Neuromorphic Systems 2021 https://doi.org/10.1145/3477145.3477168	conference	July 2021
Neuromorphic Computing for Autonomous Racing Patton, Robert; Schuman, Catherine; Kulkarni, Shruti ICONS 2021: International Conference on Neuromorphic Systems 2021 https://doi.org/10.1145/3477145.3477170	conference	October 2021
Neuromorphic Graph Algorithms: Cycle Detection, Odd Cycle Detection, and Max Flow Kay, Bill; Schuman, Catherine; O'Connor, Jade International Conference on Neuromorphic Systems 2021 https://doi.org/10.1145/3477145.3477172	conference	July 2021
Neuromorphic Computing is Turing-Complete Date, Prasanna; Potok, Thomas; Schuman, Catherine Proceedings of the International Conference on Neuromorphic Systems 2022 https://doi.org/10.1145/3546790.3546806	conference	July 2022
Connectivity concepts in neuronal network modeling Senk, Johanna; Kriener, Birgit; Djurfeldt, Mikael PLOS Computational Biology, Vol. 18, Issue 9 https://doi.org/10.1371/journal.pcbi.1010086	journal	September 2022
Skimming Digits: Neuromorphic Classification of Spike-Encoded Images Cohen, Gregory K.; Orchard, Garrick; Leng, Sio-Hoi Frontiers in Neuroscience, Vol. 10 https://doi.org/10.3389/fnins.2016.00184	journal	April 2016
Training Deep Spiking Neural Networks Using Backpropagation Lee, Jun Haeng; Delbruck, Tobi; Pfeiffer, Michael Frontiers in Neuroscience, Vol. 10 https://doi.org/10.3389/fnins.2016.00508	journal	November 2016
Adaptive Extreme Edge Computing for Wearable Devices Covi, Erika; Donati, Elisa; Liang, Xiangpeng Frontiers in Neuroscience, Vol. 15 https://doi.org/10.3389/fnins.2021.611300	journal	May 2021
The BrainScaleS-2 Accelerated Neuromorphic System With Hybrid Plasticity Pehle, Christian; Billaudelle, Sebastian; Cramer, Benjamin Frontiers in Neuroscience, Vol. 16 https://doi.org/10.3389/fnins.2022.795876	journal	February 2022
NEST (NEural Simulation Tool) Gewaltig, Marc-Oliver; Diesmann, Markus Scholarpedia, Vol. 2, Issue 4 https://doi.org/10.4249/scholarpedia.1430	journal	January 2007
Floating-Point Multiplication Using Neuromorphic Computing Dubey, Karn; Kothari, Urja; Rao, Shrisha arXiv https://doi.org/10.48550/ARXIV.2008.13245	preprint	January 2020
Binary Operations on Neuromorphic Hardware with Application to Linear Algebraic Operations and Stochastic Equations Iaroshenko, Oleksandr; Sornborger, Andrew T. arXiv https://doi.org/10.48550/ARXIV.2103.09198	preprint	January 2021
Quantized Neural Networks and Neuromorphic Computing for Embedded Systems Liu, Shiya; Yi, Yang Intelligent System and Computing https://doi.org/10.5772/intechopen.91835	book	March 2020

Similar Records

Virtual Neuron: A Neuromorphic Approach for Encoding Numbers

Conference · 2022 · OSTI ID:1985391

Date, Prasanna; Kulkarni, Shruti; Young, Aaron; +3 more

Neuromorphic Computing is Turing-Complete

Conference · 2022 · OSTI ID:1905363

Date, Prasanna; Potok, Thomas; Schuman, Catherine; +1 more

Design of a Robust Memristive Spiking Neuromorphic System with Unsupervised Learning in Hardware

Journal Article · 2021 · ACM Journal on Emerging Technologies in Computing Systems · OSTI ID:1814330

Adnan, Md Musabbir; Sayyaparaju, Sagarvarma; Brown, Samuel D.; +3 more

Related Subjects

97 MATHEMATICS AND COMPUTING
Applied mathematics
Computational science
Computer science
Information technology
Software

Title: Encoding integers and rationals on neuromorphic computers using virtual neuron

Citation Formats

References (48)

Similar Records

Related Subjects