Accelerating Scientific Computing in the Post-Moore’s Era

Hamilton, Kathleen E.; Schuman, Catherine D.; Young, Steven R.; Bennink, Ryan S.; Imam, Neena; Humble, Travis S.

doi:10.1145/3380940

Title: Accelerating Scientific Computing in the Post-Moore’s Era

Journal Article · Sun Mar 01 00:00:00 EST 2020 · ACM Transactions on Parallel Computing

DOI:https://doi.org/10.1145/3380940· OSTI ID:1649624

^[1];

^[1]

Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)

Novel uses of graphical processing units for accelerated computation revolutionized the field of high-performance scientific computing by providing specialized workflows tailored to algorithmic requirements. As the era of Moore’s law draws to a close, many new non–von Neumann processors are emerging as potential computational accelerators, including those based on the principles of neuromorphic computing, tensor algebra, and quantum information. While development of these new processors is continuing to mature, the potential impact on accelerated computing is anticipated to be profound. We discuss how different processing models can advance computing in key scientific paradigms: machine learning and constraint satisfaction. Significantly, each of these new processor types utilizes a fundamentally different model of computation, and this raises questions about how to best use such processors in the design and implementation of applications. While many processors are being developed with a specific domain target, the ubiquity of spin-glass models and neural networks provides an avenue for multi-functional applications. Furthermore, this also hints at the infrastructure needed to integrate next-generation processing units into future high-performance computing systems.

View Accepted Manuscript (DOE)

Cite

Export

Save

Research Organization:: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)

Sponsoring Organization:: USDOE

Grant/Contract Number:: AC05-00OR22725

OSTI ID:: 1649624

Journal Information:: ACM Transactions on Parallel Computing, Vol. 7, Issue 1; ISSN 2329-4949

Publisher:: Association for Computing MachineryCopyright Statement

Country of Publication:: United States

Language:: English

References (170)

A Learning Algorithm for Boltzmann Machines* Ackley, David H.; Hinton, Geoffrey E.; Sejnowski, Terrence J. Cognitive Science, Vol. 9, Issue 1 https://doi.org/10.1207/s15516709cog0901_7	journal	January 1985
Solving Constraint Satisfaction Problems with Networks of Spiking Neurons Jonke, Zeno; Habenschuss, Stefan; Maass, Wolfgang Frontiers in Neuroscience, Vol. 10 https://doi.org/10.3389/fnins.2016.00118	journal	March 2016
Trapped-ion quantum computing: Progress and challenges Bruzewicz, Colin D.; Chiaverini, John; McConnell, Robert Applied Physics Reviews, Vol. 6, Issue 2 https://doi.org/10.1063/1.5088164	journal	June 2019
Circuit-centric quantum classifiers Schuld, Maria; Bocharov, Alex; Svore, Krysta M. Physical Review A, Vol. 101, Issue 3 https://doi.org/10.1103/PhysRevA.101.032308	journal	March 2020
Event-Driven Random Back-Propagation: Enabling Neuromorphic Deep Learning Machines Neftci, Emre O.; Augustine, Charles; Paul, Somnath Frontiers in Neuroscience, Vol. 11 https://doi.org/10.3389/fnins.2017.00324	journal	June 2017
The capacity of the Hopfield associative memory McEliece, R.; Posner, E.; Rodemich, E. IEEE Transactions on Information Theory, Vol. 33, Issue 4 https://doi.org/10.1109/TIT.1987.1057328	journal	July 1987
Readiness of Quantum Optimization Machines for Industrial Applications Perdomo-Ortiz, Alejandro; Feldman, Alexander; Ozaeta, Asier Physical Review Applied, Vol. 12, Issue 1 https://doi.org/10.1103/PhysRevApplied.12.014004	journal	July 2019
Cognitive computing building block: A versatile and efficient digital neuron model for neurosynaptic cores Cassidy, Andrew S.; Merolla, Paul; Arthur, John V. 2013 International Joint Conference on Neural Networks (IJCNN 2013 - Dallas), The 2013 International Joint Conference on Neural Networks (IJCNN) https://doi.org/10.1109/IJCNN.2013.6707077	conference	August 2013
A million spiking-neuron integrated circuit with a scalable communication network and interface Merolla, P. A.; Arthur, J. V.; Alvarez-Icaza, R. Science, Vol. 345, Issue 6197 https://doi.org/10.1126/science.1254642	journal	August 2014
Ising formulation of associative memory models and quantum annealing recall Santra, Siddhartha; Shehab, Omar; Balu, Radhakrishnan Physical Review A, Vol. 96, Issue 6 https://doi.org/10.1103/PhysRevA.96.062330	journal	December 2017
Mapping Generative Models onto a Network of Digital Spiking Neurons Pedroni, Bruno U.; Das, Srinjoy; Arthur, John V. IEEE Transactions on Biomedical Circuits and Systems, Vol. 10, Issue 4 https://doi.org/10.1109/TBCAS.2016.2539352	journal	August 2016
Sparse Hardware Embedding of Spiking Neuron Systems for Community Detection Hamilton, Kathleen E.; Imam, Neena; Humble, Travis S. ACM Journal on Emerging Technologies in Computing Systems, Vol. 14, Issue 4 https://doi.org/10.1145/3223048	journal	December 2018
Silicon chip delivers quantum speeds [News] Boyd, John IEEE Spectrum, Vol. 55, Issue 7 https://doi.org/10.1109/MSPEC.2018.8389173	journal	July 2018
Quantum Computation and Quantum Information Nielsen, Michael A.; Chuang, Isaac L. Cambridge University Press https://doi.org/10.1017/CBO9780511976667	book	January 2011
Graph Partitioning using Quantum Annealing on the D-Wave System Ushijima-Mwesigwa, Hayato; Negre, Christian F. A.; Mniszewski, Susan M. Proceedings of the Second International Workshop on Post Moores Era Supercomputing - PMES'17 https://doi.org/10.1145/3149526.3149531	conference	January 2017
The many facets of community detection in complex networks Schaub, Michael T.; Delvenne, Jean-Charles; Rosvall, Martin Applied Network Science, Vol. 2, Issue 1 https://doi.org/10.1007/s41109-017-0023-6	journal	February 2017
Programming Spiking Neural Networks on Intel’s Loihi Lin, Chit-Kwan; Wild, Andreas; Chinya, Gautham N. Computer, Vol. 51, Issue 3 https://doi.org/10.1109/MC.2018.157113521	journal	March 2018
Training Products of Experts by Minimizing Contrastive Divergence Hinton, Geoffrey E. Neural Computation, Vol. 14, Issue 8 https://doi.org/10.1162/089976602760128018	journal	August 2002
Differentiable learning of quantum circuit Born machines Liu, Jin-Guo; Wang, Lei Physical Review A, Vol. 98, Issue 6 https://doi.org/10.1103/PhysRevA.98.062324	journal	December 2018
Efficient Variational Quantum Simulator Incorporating Active Error Minimization Li, Ying; Benjamin, Simon C. Physical Review X, Vol. 7, Issue 2 https://doi.org/10.1103/PhysRevX.7.021050	journal	June 2017
Using Stochastic Spiking Neural Networks on SpiNNaker to Solve Constraint Satisfaction Problems Fonseca Guerra, Gabriel A.; Furber, Steve B. Frontiers in Neuroscience, Vol. 11 https://doi.org/10.3389/fnins.2017.00714	journal	December 2017
Quantum correlation in degenerate optical parametric oscillators with mutual injections Takata, Kenta; Marandi, Alireza; Yamamoto, Yoshihisa Physical Review A, Vol. 92, Issue 4 https://doi.org/10.1103/PhysRevA.92.043821	journal	October 2015
Quantum Computing in the NISQ era and beyond Preskill, John Quantum, Vol. 2 https://doi.org/10.22331/q-2018-08-06-79	journal	August 2018
Physics-Inspired Optimization for Quadratic Unconstrained Problems Using a Digital Annealer Aramon, Maliheh; Rosenberg, Gili; Valiante, Elisabetta Frontiers in Physics, Vol. 7 https://doi.org/10.3389/fphy.2019.00048	journal	April 2019
Error-backpropagation in temporally encoded networks of spiking neurons Bohte, Sander M.; Kok, Joost N.; La Poutré, Han Neurocomputing, Vol. 48, Issue 1-4 https://doi.org/10.1016/S0925-2312(01)00658-0	journal	October 2002
Motivation for and Evaluation of the First Tensor Processing Unit Jouppi, Norman; Young, Cliff; Patil, Nishant IEEE Micro, Vol. 38, Issue 3 https://doi.org/10.1109/MM.2018.032271057	journal	May 2018
Memristive Ion Channel-Doped Biomembranes as Synaptic Mimics Najem, Joseph S.; Taylor, Graham J.; Weiss, Ryan J. ACS Nano, Vol. 12, Issue 5 https://doi.org/10.1021/acsnano.8b01282	journal	March 2018
A coherent Ising machine for 2000-node optimization problems Inagaki, T.; Haribara, Y.; Igarashi, K. Science, Vol. 354, Issue 6312 https://doi.org/10.1126/science.aah4243	journal	October 2016
A fully programmable 100-spin coherent Ising machine with all-to-all connections McMahon, Peter L.; Marandi, Alireza; Haribara, Yoshitaka Science, Vol. 354, Issue 6312 https://doi.org/10.1126/science.aah5178	journal	October 2016
Storing Infinite Numbers of Patterns in a Spin-Glass Model of Neural Networks Amit, Daniel J.; Gutfreund, Hanoch; Sompolinsky, H. Physical Review Letters, Vol. 55, Issue 14 https://doi.org/10.1103/PhysRevLett.55.1530	journal	September 1985
Experimental demonstration of associative memory with memristive neural networks Pershin, Yuriy V.; Di Ventra, Massimiliano Neural Networks, Vol. 23, Issue 7, p. 881-886 https://doi.org/10.1016/j.neunet.2010.05.001	journal	September 2010
Long Short-Term Memory Hochreiter, Sepp; Schmidhuber, Jürgen Neural Computation, Vol. 9, Issue 8 https://doi.org/10.1162/neco.1997.9.8.1735	journal	November 1997
Optimization by quantum annealing: Lessons from hard satisfiability problems Battaglia, Demian A.; Santoro, Giuseppe E.; Tosatti, Erio Physical Review E, Vol. 71, Issue 6 https://doi.org/10.1103/PhysRevE.71.066707	journal	June 2005
Machine learning & artificial intelligence in the quantum domain: a review of recent progress Dunjko, Vedran; Briegel, Hans J. Reports on Progress in Physics, Vol. 81, Issue 7 https://doi.org/10.1088/1361-6633/aab406	journal	June 2018
Triangle Finding and Listing in CONGEST Networks Izumi, Taisuke; Le Gall, François PODC '17: ACM Symposium on Principles of Distributed Computing, Proceedings of the ACM Symposium on Principles of Distributed Computing https://doi.org/10.1145/3087801.3087811	conference	July 2017
Simulating a perceptron on a quantum computer Schuld, Maria; Sinayskiy, Ilya; Petruccione, Francesco Physics Letters A, Vol. 379, Issue 7 https://doi.org/10.1016/j.physleta.2014.11.061	journal	March 2015
Probing many-body dynamics on a 51-atom quantum simulator Bernien, Hannes; Schwartz, Sylvain; Keesling, Alexander Nature, Vol. 551, Issue 7682 https://doi.org/10.1038/nature24622	journal	November 2017
Practical Quantum Error Mitigation for Near-Future Applications Endo, Suguru; Benjamin, Simon C.; Li, Ying Physical Review X, Vol. 8, Issue 3 https://doi.org/10.1103/PhysRevX.8.031027	journal	July 2018
Performance Models for Split-Execution Computing Systems Humble, Travis S.; McCaskey, Alexander J.; Schrock, Jonathan 2016 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW) https://doi.org/10.1109/IPDPSW.2016.113	conference	May 2016
Storing Sparse Messages in Networks of Neural Cliques Aliabadi, Behrooz Kamary; Berrou, Claude; Gripon, Vincent IEEE Transactions on Neural Networks and Learning Systems, Vol. 25, Issue 5 https://doi.org/10.1109/TNNLS.2013.2285253	journal	May 2014
Building block of a programmable neuromorphic substrate: A digital neurosynaptic core Arthur, John V.; Merolla, Paul A.; Akopyan, Filipp 2012 International Joint Conference on Neural Networks (IJCNN 2012 - Brisbane), The 2012 International Joint Conference on Neural Networks (IJCNN) https://doi.org/10.1109/IJCNN.2012.6252637	conference	June 2012
Training a quantum optimizer Wecker, Dave; Hastings, Matthew B.; Troyer, Matthias Physical Review A, Vol. 94, Issue 2 https://doi.org/10.1103/PhysRevA.94.022309	journal	August 2016
Neural networks and physical systems with emergent collective computational abilities. Hopfield, J. J. Proceedings of the National Academy of Sciences, Vol. 79, Issue 8 https://doi.org/10.1073/pnas.79.8.2554	journal	April 1982
GPU clusters for high-performance computing Kindratenko, Volodymyr V.; Enos, Jeremy J.; Shi, Guochun 2009 IEEE International Conference on Cluster Computing and Workshops https://doi.org/10.1109/CLUSTR.2009.5289128	conference	August 2009
Observation of topological phenomena in a programmable lattice of 1,800 qubits King, Andrew D.; Carrasquilla, Juan; Raymond, Jack Nature, Vol. 560, Issue 7719 https://doi.org/10.1038/s41586-018-0410-x	journal	August 2018
Phase transitions in a programmable quantum spin glass simulator Harris, R.; Sato, Y.; Berkley, A. J. Science, Vol. 361, Issue 6398 https://doi.org/10.1126/science.aat2025	journal	July 2018
Detecting Fuzzy Community Structures in Complex Networks with a Potts Model Reichardt, Jörg; Bornholdt, Stefan Physical Review Letters, Vol. 93, Issue 21 https://doi.org/10.1103/PhysRevLett.93.218701	journal	November 2004
Harnessing Disordered-Ensemble Quantum Dynamics for Machine Learning Fujii, Keisuke; Nakajima, Kohei Physical Review Applied, Vol. 8, Issue 2 https://doi.org/10.1103/PhysRevApplied.8.024030	journal	August 2017
Quantum circuit learning Mitarai, K.; Negoro, M.; Kitagawa, M. Physical Review A, Vol. 98, Issue 3 https://doi.org/10.1103/PhysRevA.98.032309	journal	September 2018
Ising formulations of many NP problems Lucas, Andrew Frontiers in Physics, Vol. 2 https://doi.org/10.3389/fphy.2014.00005	journal	January 2014
Barren plateaus in quantum neural network training landscapes McClean, Jarrod R.; Boixo, Sergio; Smelyanskiy, Vadim N. Nature Communications, Vol. 9, Issue 1 https://doi.org/10.1038/s41467-018-07090-4	journal	November 2018
A fast quantum mechanical algorithm for database search Grover, Lov K. Proceedings of the twenty-eighth annual ACM symposium on Theory of computing - STOC '96 https://doi.org/10.1145/237814.237866	conference	January 1996
Quantum-assisted Helmholtz machines: A quantum–classical deep learning framework for industrial datasets in near-term devices Benedetti, Marcello; Realpe-Gómez, John; Perdomo-Ortiz, Alejandro Quantum Science and Technology, Vol. 3, Issue 3 https://doi.org/10.1088/2058-9565/aabd98	journal	May 2018
Quantum model for coherent Ising machines: Stochastic differential equations with replicator dynamics Shoji, Taime; Aihara, Kazuyuki; Yamamoto, Yoshihisa Physical Review A, Vol. 96, Issue 5 https://doi.org/10.1103/PhysRevA.96.053833	journal	November 2017
The theory of variational hybrid quantum-classical algorithms McClean, Jarrod R.; Romero, Jonathan; Babbush, Ryan New Journal of Physics, Vol. 18, Issue 2 https://doi.org/10.1088/1367-2630/18/2/023023	journal	February 2016
Convolutional networks for fast, energy-efficient neuromorphic computing Esser, Steven K.; Merolla, Paul A.; Arthur, John V. Proceedings of the National Academy of Sciences, Vol. 113, Issue 41 https://doi.org/10.1073/pnas.1604850113	journal	September 2016
Quantum optimization using variational algorithms on near-term quantum devices Moll, Nikolaj; Barkoutsos, Panagiotis; Bishop, Lev S. Quantum Science and Technology, Vol. 3, Issue 3 https://doi.org/10.1088/2058-9565/aab822	journal	June 2018
What is the Computational Value of Finite-Range Tunneling? Denchev, Vasil S.; Boixo, Sergio; Isakov, Sergei V. Physical Review X, Vol. 6, Issue 3 https://doi.org/10.1103/PhysRevX.6.031015	journal	August 2016
A case study in programming a quantum annealer for hard operational planning problems Rieffel, Eleanor G.; Venturelli, Davide; O’Gorman, Bryan Quantum Information Processing, Vol. 14, Issue 1 https://doi.org/10.1007/s11128-014-0892-x	journal	December 2014
Adversarial quantum circuit learning for pure state approximation Benedetti, Marcello; Grant, Edward; Wossnig, Leonard New Journal of Physics, Vol. 21, Issue 4 https://doi.org/10.1088/1367-2630/ab14b5	journal	April 2019
Evaluating analytic gradients on quantum hardware Schuld, Maria; Bergholm, Ville; Gogolin, Christian Physical Review A, Vol. 99, Issue 3 https://doi.org/10.1103/PhysRevA.99.032331	journal	March 2019
Training deep neural networks for binary communication with the Whetstone method Severa, William; Vineyard, Craig M.; Dellana, Ryan Nature Machine Intelligence, Vol. 1, Issue 2 https://doi.org/10.1038/s42256-018-0015-y	journal	January 2019
Quantum generative adversarial networks Dallaire-Demers, Pierre-Luc; Killoran, Nathan Physical Review A, Vol. 98, Issue 1 https://doi.org/10.1103/PhysRevA.98.012324	journal	July 2018
Quantum Support Vector Machine for Big Data Classification Rebentrost, Patrick; Mohseni, Masoud; Lloyd, Seth Physical Review Letters, Vol. 113, Issue 13 https://doi.org/10.1103/PhysRevLett.113.130503	journal	September 2014
Quantum sensing Degen, C. L.; Reinhard, F.; Cappellaro, P. Reviews of Modern Physics, Vol. 89, Issue 3 https://doi.org/10.1103/RevModPhys.89.035002	journal	July 2017
Scalable energy-efficient, low-latency implementations of trained spiking Deep Belief Networks on SpiNNaker Stromatias, Evangelos; Neil, Daniel; Galluppi, Francesco 2015 International Joint Conference on Neural Networks (IJCNN) https://doi.org/10.1109/IJCNN.2015.7280625	conference	July 2015
Sparse Coding via Thresholding and Local Competition in Neural Circuits Rozell, Christopher J.; Johnson, Don H.; Baraniuk, Richard G. Neural Computation, Vol. 20, Issue 10 https://doi.org/10.1162/neco.2008.03-07-486	journal	October 2008
Quantum Generative Adversarial Learning Lloyd, Seth; Weedbrook, Christian Physical Review Letters, Vol. 121, Issue 4 https://doi.org/10.1103/PhysRevLett.121.040502	journal	July 2018
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification He, Kaiming; Zhang, Xiangyu; Ren, Shaoqing 2015 IEEE International Conference on Computer Vision (ICCV) https://doi.org/10.1109/ICCV.2015.123	conference	December 2015
Superparamagnetic Clustering of Data Blatt, Marcelo; Wiseman, Shai; Domany, Eytan Physical Review Letters, Vol. 76, Issue 18 https://doi.org/10.1103/PhysRevLett.76.3251	journal	April 1996
Adiabatic quantum optimization for associative memory recall Seddiqi, Hadayat; Humble, Travis S. Frontiers in Physics, Vol. 2 https://doi.org/10.3389/fphy.2014.00079	journal	December 2014
Systematic and deterministic graph minor embedding for Cartesian products of graphs Zaribafiyan, Arman; Marchand, Dominic J. J.; Changiz Rezaei, Seyed Saeed Quantum Information Processing, Vol. 16, Issue 5 https://doi.org/10.1007/s11128-017-1569-z	journal	April 2017
Gradient-based learning applied to document recognition Lecun, Y.; Bottou, L.; Bengio, Y. Proceedings of the IEEE, Vol. 86, Issue 11 https://doi.org/10.1109/5.726791	journal	January 1998
Coherent Ising machine based on degenerate optical parametric oscillators Wang, Zhe; Marandi, Alireza; Wen, Kai Physical Review A, Vol. 88, Issue 6 https://doi.org/10.1103/PhysRevA.88.063853	journal	December 2013
Experimental investigation of performance differences between coherent Ising machines and a quantum annealer Hamerly, Ryan; Inagaki, Takahiro; McMahon, Peter L. Science Advances, Vol. 5, Issue 5 https://doi.org/10.1126/sciadv.aau0823	journal	May 2019
Glassy Chimeras Could Be Blind to Quantum Speedup: Designing Better Benchmarks for Quantum Annealing Machines Katzgraber, Helmut G.; Hamze, Firas; Andrist, Ruben S. Physical Review X, Vol. 4, Issue 2 https://doi.org/10.1103/PhysRevX.4.021008	journal	April 2014
A language and hardware independent approach to quantum–classical computing McCaskey, A. J.; Dumitrescu, E. F.; Liakh, D. SoftwareX, Vol. 7 https://doi.org/10.1016/j.softx.2018.07.007	journal	January 2018
Rapid, parallel path planning by propagating wavefronts of spiking neural activity Ponulak, Filip; Hopfield, John J. Frontiers in Computational Neuroscience, Vol. 7 https://doi.org/10.3389/fncom.2013.00098	journal	January 2013
Rebooting Computing: The Road Ahead Conte, Thomas M.; DeBenedictis, Erik P.; Gargini, Paolo A. Computer, Vol. 50, Issue 1 https://doi.org/10.1109/MC.2017.8	journal	January 2017
Dynamic evolving spiking neural networks for on-line spatio- and spectro-temporal pattern recognition Kasabov, Nikola; Dhoble, Kshitij; Nuntalid, Nuttapod Neural Networks, Vol. 41 https://doi.org/10.1016/j.neunet.2012.11.014	journal	May 2013
Hardware-efficient variational quantum eigensolver for small molecules and quantum magnets Kandala, Abhinav; Mezzacapo, Antonio; Temme, Kristan Nature, Vol. 549, Issue 7671 https://doi.org/10.1038/nature23879	journal	September 2017
The complexity of some polynomial network consistency algorithms for constraint satisfaction problems Mackworth, Alan K.; Freuder, Eugene C. Artificial Intelligence, Vol. 25, Issue 1 https://doi.org/10.1016/0004-3702(85)90041-4	journal	January 1985
In-Datacenter Performance Analysis of a Tensor Processing Unit Jouppi, Norman P.; Borchers, Al; Boyle, Rick Proceedings of the 44th Annual International Symposium on Computer Architecture - ISCA '17 https://doi.org/10.1145/3079856.3080246	conference	January 2017
Associative Dynamics in a Chaotic Neural Network Adachi, Masaharu; Aihara, Kazuyuki Neural Networks, Vol. 10, Issue 1 https://doi.org/10.1016/S0893-6080(96)00061-5	journal	January 1997
Polynomial-Time Algorithms for Prime Factorization and Discrete Logarithms on a Quantum Computer Shor, Peter W. SIAM Review, Vol. 41, Issue 2 https://doi.org/10.1137/S0036144598347011	journal	January 1999
Phase transitions in random Potts systems and the community detection problem: spin-glass type and dynamic perspectives Hu, Dandan; Ronhovde, Peter; Nussinov, Zohar Philosophical Magazine, Vol. 92, Issue 4 https://doi.org/10.1080/14786435.2011.616547	journal	February 2012
Quantum Annealing for Constrained Optimization Hen, Itay; Spedalieri, Federico M. Physical Review Applied, Vol. 5, Issue 3 https://doi.org/10.1103/PhysRevApplied.5.034007	journal	March 2016
Quantum machine learning Biamonte, Jacob; Wittek, Peter; Pancotti, Nicola Nature, Vol. 549, Issue 7671 https://doi.org/10.1038/nature23474	journal	September 2017
Quantum annealing: The fastest route to quantum computation? Laumann, C. R.; Moessner, R.; Scardicchio, A. The European Physical Journal Special Topics, Vol. 224, Issue 1 https://doi.org/10.1140/epjst/e2015-02344-2	journal	February 2015
What would you do with 1000 qubits? Morello, Andrea Quantum Science and Technology, Vol. 3, Issue 3 https://doi.org/10.1088/2058-9565/aac869	journal	June 2018
The basins of attraction of a new Hopfield learning rule Storkey, A. J.; Valabregue, R. Neural Networks, Vol. 12, Issue 6 https://doi.org/10.1016/S0893-6080(99)00038-6	journal	July 1999
Scalable Quantum Simulation of Molecular Energies O’Malley, P. J. J.; Babbush, R.; Kivlichan, I. D. Physical Review X, Vol. 6, Issue 3 https://doi.org/10.1103/PhysRevX.6.031007	journal	July 2016
Pattern recall in networks of chaotic neurons Crook, Nigel; Goh, Wee Jin; Hawarat, Mohammad Biosystems, Vol. 87, Issue 2-3 https://doi.org/10.1016/j.biosystems.2006.09.022	journal	February 2007
Superconducting Optoelectronic Circuits for Neuromorphic Computing Shainline, Jeffrey M.; Buckley, Sonia M.; Mirin, Richard P. Physical Review Applied, Vol. 7, Issue 3 https://doi.org/10.1103/PhysRevApplied.7.034013	journal	March 2017
Cognitive computing systems: Algorithms and applications for networks of neurosynaptic cores Esser, Steve K.; Andreopoulos, Alexander; Appuswamy, Rathinakumar 2013 International Joint Conference on Neural Networks (IJCNN 2013 - Dallas), The 2013 International Joint Conference on Neural Networks (IJCNN) https://doi.org/10.1109/IJCNN.2013.6706746	conference	August 2013
Design and Analysis of a Neuromemristive Reservoir Computing Architecture for Biosignal Processing Kudithipudi, Dhireesha; Saleh, Qutaiba; Merkel, Cory Frontiers in Neuroscience, Vol. 9 https://doi.org/10.3389/fnins.2015.00502	journal	February 2016
Gibbs sampling with low-power spiking digital neurons Das, Srinjoy; Pedroni, Bruno Umbria; Merolla, Paul 2015 IEEE International Symposium on Circuits and Systems (ISCAS) https://doi.org/10.1109/ISCAS.2015.7169244	conference	May 2015
Experimental comparison of two quantum computing architectures Linke, Norbert M.; Maslov, Dmitri; Roetteler, Martin Proceedings of the National Academy of Sciences, Vol. 114, Issue 13 https://doi.org/10.1073/pnas.1618020114	journal	March 2017
Associative memory in networks of spiking neurons Sommer, Friedrich T.; Wennekers, Thomas Neural Networks, Vol. 14, Issue 6-7 https://doi.org/10.1016/S0893-6080(01)00064-8	journal	July 2001
Optimizing adiabatic quantum program compilation using a graph-theoretic framework Goodrich, Timothy D.; Sullivan, Blair D.; Humble, Travis S. Quantum Information Processing, Vol. 17, Issue 5 https://doi.org/10.1007/s11128-018-1863-4	journal	April 2018
Locally Competitive Algorithms for Sparse Approximation Rozell, Christopher; Johnson, Don; Baraniuk, Richard 2007 IEEE International Conference on Image Processing https://doi.org/10.1109/ICIP.2007.4379981	conference	September 2007
Bidirectional associative memories Kosko, B. IEEE Transactions on Systems, Man, and Cybernetics, Vol. 18, Issue 1 https://doi.org/10.1109/21.87054	journal	January 1988
Statistical mechanics of community detection Reichardt, Jörg; Bornholdt, Stefan Physical Review E, Vol. 74, Issue 1 https://doi.org/10.1103/PhysRevE.74.016110	journal	July 2006
Max 2-SAT with up to 108 qubits Santra, Siddhartha; Quiroz, Gregory; Ver Steeg, Greg New Journal of Physics, Vol. 16, Issue 4 https://doi.org/10.1088/1367-2630/16/4/045006	journal	April 2014
Gaussian optical Ising machines Clements, William R.; Renema, Jelmer J.; Wen, Y. Henry Physical Review A, Vol. 96, Issue 4 https://doi.org/10.1103/PhysRevA.96.043850	journal	October 2017
Empirical comparison of algorithms for network community detection Leskovec, Jure; Lang, Kevin J.; Mahoney, Michael Proceedings of the 19th international conference on World wide web - WWW '10 https://doi.org/10.1145/1772690.1772755	conference	January 2010
The use of Multiple Measurements in Taxonomic Problems Fisher, R. A. Annals of Eugenics, Vol. 7, Issue 2 https://doi.org/10.1111/j.1469-1809.1936.tb02137.x	journal	September 1936
Most Tensor Problems Are NP-Hard Hillar, Christopher J.; Lim, Lek-Heng Journal of the ACM, Vol. 60, Issue 6 https://doi.org/10.1145/2512329	journal	November 2013
Quantum annealing with manufactured spins Johnson, M. W.; Amin, M. H. S.; Gildert, S. Nature, Vol. 473, Issue 7346 https://doi.org/10.1038/nature10012	journal	May 2011
Quantum Computing Circuits and Devices Humble, Travis S.; Thapliyal, Himanshu; Munoz-Coreas, Edgard IEEE Design & Test, Vol. 36, Issue 3 https://doi.org/10.1109/MDAT.2019.2907130	journal	June 2019
A variational eigenvalue solver on a photonic quantum processor Peruzzo, Alberto; McClean, Jarrod; Shadbolt, Peter Nature Communications, Vol. 5, Issue 1 https://doi.org/10.1038/ncomms5213	journal	July 2014
Minor-embedding in adiabatic quantum computation: II. Minor-universal graph design Choi, Vicky Quantum Information Processing, Vol. 10, Issue 3 https://doi.org/10.1007/s11128-010-0200-3	journal	October 2010
Approximation by superpositions of a sigmoidal function Cybenko, G. Mathematics of Control, Signals, and Systems, Vol. 2, Issue 4 https://doi.org/10.1007/BF02551274	journal	December 1989
Memristive Mixed-Signal Neuromorphic Systems: Energy-Efficient Learning at the Circuit-Level Chakma, Gangotree; Adnan, Md Musabbir; Wyer, Austin R. IEEE Journal on Emerging and Selected Topics in Circuits and Systems, Vol. 8, Issue 1 https://doi.org/10.1109/JETCAS.2017.2777181	journal	March 2018
Adiabatic quantum programming: minor embedding with hard faults Klymko, Christine; Sullivan, Blair D.; Humble, Travis S. Quantum Information Processing, Vol. 13, Issue 3 https://doi.org/10.1007/s11128-013-0683-9	journal	November 2013
Solvable Model of a Spin-Glass Sherrington, David; Kirkpatrick, Scott Physical Review Letters, Vol. 35, Issue 26 https://doi.org/10.1103/PhysRevLett.35.1792	journal	December 1975
Sparse Neural Networks With Large Learning Diversity Gripon, Vincent; Berrou, Claude IEEE Transactions on Neural Networks, Vol. 22, Issue 7 https://doi.org/10.1109/TNN.2011.2146789	journal	July 2011
Network of time-multiplexed optical parametric oscillators as a coherent Ising machine Marandi, Alireza; Wang, Zhe; Takata, Kenta Nature Photonics, Vol. 8, Issue 12 https://doi.org/10.1038/nphoton.2014.249	journal	October 2014
Hierarchical quantum classifiers Grant, Edward; Benedetti, Marcello; Cao, Shuxiang npj Quantum Information, Vol. 4, Issue 1 https://doi.org/10.1038/s41534-018-0116-9	journal	December 2018
Quantum algorithms: an overview Montanaro, Ashley npj Quantum Information, Vol. 2, Issue 1 https://doi.org/10.1038/npjqi.2015.23	journal	January 2016
A generative modeling approach for benchmarking and training shallow quantum circuits Benedetti, Marcello; Garcia-Pintos, Delfina; Perdomo, Oscar npj Quantum Information, Vol. 5, Issue 1 https://doi.org/10.1038/s41534-019-0157-8	journal	May 2019
High-Performance Computing with Quantum Processing Units Britt, Keith A.; Humble, Travis S. ACM Journal on Emerging Technologies in Computing Systems, Vol. 13, Issue 3 https://doi.org/10.1145/3007651	journal	May 2017
Quantum speedup of the traveling-salesman problem for bounded-degree graphs Moylett, Dominic J.; Linden, Noah; Montanaro, Ashley Physical Review A, Vol. 95, Issue 3 https://doi.org/10.1103/PhysRevA.95.032323	journal	March 2017
Computational Principle and Performance Evaluation of Coherent Ising Machine Based on Degenerate Optical Parametric Oscillator Network Haribara, Yoshitaka; Utsunomiya, Shoko; Yamamoto, Yoshihisa Entropy, Vol. 18, Issue 4 https://doi.org/10.3390/e18040151	journal	April 2016
Fast clique minor generation in Chimera qubit connectivity graphs Boothby, Tomas; King, Andrew D.; Roy, Aidan Quantum Information Processing, Vol. 15, Issue 1 https://doi.org/10.1007/s11128-015-1150-6	journal	October 2015
Movement prediction from real-world images using a liquid state machine Burgsteiner, Harald; Kröll, Mark; Leopold, Alexander Applied Intelligence, Vol. 26, Issue 2 https://doi.org/10.1007/s10489-006-0007-1	journal	November 2006
An evolutionary optimization framework for neural networks and neuromorphic architectures Schuman, Catherine D.; Plank, James S.; Disney, Adam 2016 International Joint Conference on Neural Networks (IJCNN) https://doi.org/10.1109/IJCNN.2016.7727192	conference	July 2016
Competitive Hebbian learning through spike-timing-dependent synaptic plasticity Song, Sen; Miller, Kenneth D.; Abbott, L. F. Nature Neuroscience, Vol. 3, Issue 9 https://doi.org/10.1038/78829	journal	September 2000
Simulated annealing van Laarhoven, Peter J. M.; Aarts, Emile H. L. Simulated Annealing: Theory and Applications https://doi.org/10.1007/978-94-015-7744-1_2	book	January 1987
A Quantum Adiabatic Evolution Algorithm Applied to Random Instances of an NP-Complete Problem Farhi, E.; Goldstone, J.; Gutmann, S. Science, Vol. 292, Issue 5516 https://doi.org/10.1126/science.1057726	journal	April 2001
Keeneland: Bringing Heterogeneous GPU Computing to the Computational Science Community Vetter, Jeffrey S.; Glassbrook, Richard; Dongarra, Jack Computing in Science & Engineering, Vol. 13, Issue 5 https://doi.org/10.1109/MCSE.2011.83	journal	September 2011
Conversion of artificial recurrent neural networks to spiking neural networks for low-power neuromorphic hardware Diehl, Peter U.; Zarrella, Guido; Cassidy, Andrew 2016 IEEE International Conference on Rebooting Computing (ICRC) https://doi.org/10.1109/ICRC.2016.7738691	conference	October 2016
The SpiNNaker Project Furber, Steve B.; Galluppi, Francesco; Temple, Steve Proceedings of the IEEE, Vol. 102, Issue 5 https://doi.org/10.1109/JPROC.2014.2304638	journal	May 2014
A quantum engineer's guide to superconducting qubits Krantz, P.; Kjaergaard, M.; Yan, F. Applied Physics Reviews, Vol. 6, Issue 2 https://doi.org/10.1063/1.5089550	journal	June 2019
Efficient associative memory using small-world architecture Bohland, Jason W.; Minai, Ali A. Neurocomputing, Vol. 38-40 https://doi.org/10.1016/S0925-2312(01)00378-2	journal	June 2001
An initialization strategy for addressing barren plateaus in parametrized quantum circuits Grant, Edward; Wossnig, Leonard; Ostaszewski, Mateusz Quantum, Vol. 3 https://doi.org/10.22331/q-2019-12-09-214	journal	December 2019
Characteristics of sparsely encoded associative memory Amari, Shun-ichi Neural Networks, Vol. 2, Issue 6 https://doi.org/10.1016/0893-6080(89)90043-9	journal	January 1989
Quantum reservoir processing Ghosh, Sanjib; Opala, Andrzej; Matuszewski, Michał npj Quantum Information, Vol. 5, Issue 1 https://doi.org/10.1038/s41534-019-0149-8	journal	April 2019
Adiabatic quantum computation Albash, Tameem; Lidar, Daniel A. Reviews of Modern Physics, Vol. 90, Issue 1 https://doi.org/10.1103/RevModPhys.90.015002	journal	January 2018
Sublinear-Time Quantum Computation of the Diameter in CONGEST Networks Le Gall, François; Magniez, Frédéric PODC '18: ACM Symposium on Principles of Distributed Computing, Proceedings of the 2018 ACM Symposium on Principles of Distributed Computing https://doi.org/10.1145/3212734.3212744	conference	July 2018
Quantum Optimization of Fully Connected Spin Glasses Venturelli, Davide; Mandrà, Salvatore; Knysh, Sergey Physical Review X, Vol. 5, Issue 3 https://doi.org/10.1103/PhysRevX.5.031040	journal	September 2015
An introduction to quantum machine learning Schuld, Maria; Sinayskiy, Ilya; Petruccione, Francesco Contemporary Physics, Vol. 56, Issue 2 https://doi.org/10.1080/00107514.2014.964942	journal	October 2014
Supervised learning with quantum-enhanced feature spaces Havlíček, Vojtěch; Córcoles, Antonio D.; Temme, Kristan Nature, Vol. 567, Issue 7747 https://doi.org/10.1038/s41586-019-0980-2	journal	March 2019
Thermally assisted quantum annealing of a 16-qubit problem Dickson, N. G.; Johnson, M. W.; Amin, M. H. Nature Communications, Vol. 4, Issue 1 https://doi.org/10.1038/ncomms2920	journal	May 2013
Training and operation of an integrated neuromorphic network based on metal-oxide memristors Prezioso, M.; Merrikh-Bayat, F.; Hoskins, B. D. Nature, Vol. 521, Issue 7550 https://doi.org/10.1038/nature14441	journal	May 2015
Learning and inference on generative adversarial quantum circuits Zeng, Jinfeng; Wu, Yufeng; Liu, Jin-Guo Physical Review A, Vol. 99, Issue 5 https://doi.org/10.1103/PhysRevA.99.052306	journal	May 2019
Error Mitigation for Short-Depth Quantum Circuits Temme, Kristan; Bravyi, Sergey; Gambetta, Jay M. Physical Review Letters, Vol. 119, Issue 18 https://doi.org/10.1103/PhysRevLett.119.180509	journal	November 2017
Demonstration of a Scaling Advantage for a Quantum Annealer over Simulated Annealing Albash, Tameem; Lidar, Daniel A. Physical Review X, Vol. 8, Issue 3 https://doi.org/10.1103/PhysRevX.8.031016	journal	July 2018
Demonstration of quantum advantage in machine learning Ristè, Diego; da Silva, Marcus P.; Ryan, Colm A. npj Quantum Information, Vol. 3, Issue 1 https://doi.org/10.1038/s41534-017-0017-3	journal	April 2017
Neurons with graded response have collective computational properties like those of two-state neurons. Hopfield, J. J. Proceedings of the National Academy of Sciences, Vol. 81, Issue 10 https://doi.org/10.1073/pnas.81.10.3088	journal	May 1984
SpiNNaker: A 1-W 18-Core System-on-Chip for Massively-Parallel Neural Network Simulation Painkras, Eustace; Plana, Luis A.; Garside, Jim IEEE Journal of Solid-State Circuits, Vol. 48, Issue 8 https://doi.org/10.1109/JSSC.2013.2259038	journal	August 2013
Fast Quantum Algorithm for Numerical Gradient Estimation Jordan, Stephen P. Physical Review Letters, Vol. 95, Issue 5 https://doi.org/10.1103/PhysRevLett.95.050501	journal	July 2005
An integrated programming and development environment for adiabatic quantum optimization S. Humble, T.; J. McCaskey, A.; S. Bennink, R. Computational Science & Discovery, Vol. 7, Issue 1 https://doi.org/10.1088/1749-4680/7/1/015006	journal	January 2014
Enabling and scaling matrix computations on heterogeneous multi-core and multi-GPU systems Song, Fengguang; Tomov, Stanimire; Dongarra, Jack Proceedings of the 26th ACM international conference on Supercomputing - ICS '12 https://doi.org/10.1145/2304576.2304625	conference	January 2012
Generative model benchmarks for superconducting qubits Hamilton, Kathleen E.; Dumitrescu, Eugene F.; Pooser, Raphael C. Physical Review A, Vol. 99, Issue 6 https://doi.org/10.1103/PhysRevA.99.062323	journal	June 2019
Willshaw model: Associative memory with sparse coding and low firing rates Golomb, D.; Rubin, N.; Sompolinsky, H. Physical Review A, Vol. 41, Issue 4 https://doi.org/10.1103/PhysRevA.41.1843	journal	February 1990
The Super-Turing Computational Power of Plastic Recurrent Neural Networks Cabessa, JÉRÉMie; Siegelmann, Hava T. International Journal of Neural Systems, Vol. 24, Issue 08 https://doi.org/10.1142/S0129065714500294	journal	November 2014
Label propagation through neuronal synchrony Quiles, Marcos G.; Zhao, Liang; Breve, Fabricio A. The 2010 International Joint Conference on Neural Networks (IJCNN) https://doi.org/10.1109/IJCNN.2010.5596809	conference	July 2010
Performance Comparison of the Digital Neuromorphic Hardware SpiNNaker and the Neural Network Simulation Software NEST for a Full-Scale Cortical Microcircuit Model van Albada, Sacha J.; Rowley, Andrew G.; Senk, Johanna Frontiers in Neuroscience, Vol. 12 https://doi.org/10.3389/fnins.2018.00291	journal	May 2018
A Fast Learning Algorithm for Deep Belief Nets Hinton, Geoffrey E.; Osindero, Simon; Teh, Yee-Whye Neural Computation, Vol. 18, Issue 7 https://doi.org/10.1162/neco.2006.18.7.1527	journal	July 2006
Demonstration of a small programmable quantum computer with atomic qubits Debnath, S.; Linke, N. M.; Figgatt, C. Nature, Vol. 536, Issue 7614 https://doi.org/10.1038/nature18648	journal	August 2016
A Study of Complex Deep Learning Networks on High Performance, Neuromorphic, and Quantum Computers Potok, Thomas E.; Schuman, Catherine D.; Young, Steven R. 2016 2nd Workshop on Machine Learning in HPC Environments (MLHPC) https://doi.org/10.1109/MLHPC.2016.009	conference	November 2016
Deep learning in neural networks: An overview Schmidhuber, Jürgen Neural Networks, Vol. 61 https://doi.org/10.1016/j.neunet.2014.09.003	journal	January 2015
Temperature Scaling Law for Quantum Annealing Optimizers Albash, Tameem; Martin-Mayor, Victor; Hen, Itay Physical Review Letters, Vol. 119, Issue 11 https://doi.org/10.1103/PhysRevLett.119.110502	journal	September 2017
Identifying the minor set cover of dense connected bipartite graphs via random matching edge sets Hamilton, Kathleen E.; Humble, Travis S. Quantum Information Processing, Vol. 16, Issue 4 https://doi.org/10.1007/s11128-016-1513-7	journal	February 2017
Community detection in graphs Fortunato, Santo Physics Reports, Vol. 486, Issue 3-5 https://doi.org/10.1016/j.physrep.2009.11.002	journal	February 2010
Local resolution-limit-free Potts model for community detection Ronhovde, Peter; Nussinov, Zohar Physical Review E, Vol. 81, Issue 4 https://doi.org/10.1103/PhysRevE.81.046114	journal	April 2010
Error mitigation extends the computational reach of a noisy quantum processor Kandala, Abhinav; Temme, Kristan; Córcoles, Antonio D. Nature, Vol. 567, Issue 7749 https://doi.org/10.1038/s41586-019-1040-7	journal	March 2019
Opportunities and challenges for quantum-assisted machine learning in near-term quantum computers Perdomo-Ortiz, Alejandro; Benedetti, Marcello; Realpe-Gómez, John Quantum Science and Technology, Vol. 3, Issue 3 https://doi.org/10.1088/2058-9565/aab859	journal	June 2018
Minor-embedding in adiabatic quantum computation: I. The parameter setting problem Choi, Vicky Quantum Information Processing, Vol. 7, Issue 5 https://doi.org/10.1007/s11128-008-0082-9	journal	September 2008

Similar Records

Neural Networks and Graph Algorithms with Next-Generation Processors

Conference · Tue May 01 00:00:00 EDT 2018 · OSTI ID:1649624

Hamilton, Kathleen; Schuman, Catherine; Young, Steven; +2 more

Neuromorphic Computing, Architectures, Models, and Applications. A Beyond-CMOS Approach to Future Computing, June 29-July 1, 2016, Oak Ridge, TN

Technical Report · Sat Dec 31 00:00:00 EST 2016 · OSTI ID:1649624

Potok, Thomas; Schuman, Catherine; Patton, Robert; +3 more

Basic Energy Sciences Exascale Requirements Review. An Office of Science review sponsored jointly by Advanced Scientific Computing Research and Basic Energy Sciences, November 3-5, 2015, Rockville, Maryland

Technical Report · Fri Feb 03 00:00:00 EST 2017 · OSTI ID:1649624

Windus, Theresa; Banda, Michael; Devereaux, Thomas; +86 more

Related Subjects

97 MATHEMATICS AND COMPUTING
Graph algorithms
machine learning
constraint satisfaction problems
quantum computing
neuromorphic computing
optical Ising machines

Title: Accelerating Scientific Computing in the Post-Moore’s Era

Citation Formats

References (170)

Similar Records

Related Subjects