Benchmarking quantum computers

Proctor, Timothy James; Young, Kevin Christopher; Baczewski, Andrew David; Blume-Kohout, Robin J.

doi:10.1038/s42254-024-00796-z

Title: Benchmarking quantum computers

Journal Article · Mon Jan 06 19:00:00 EST 2025 · Nature Reviews Physics

DOI: https://doi.org/10.1038/s42254-024-00796-z · OSTI ID:3019052

^[1];

^[2];

^[2]

Sandia National Laboratories (SNL-CA), Livermore, CA (United States)
Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States)

The rapid pace of development in quantum computing technology has sparked a proliferation of benchmarks to assess the performance of quantum computing hardware and software. However, not all benchmarks are of equal merit. Good ones empower scientists, engineers, programmers and users to understand the power of a computing system, whereas bad ones can misdirect research and inhibit progress. In this Perspective, we survey the science of quantum computer benchmarking. Here, we discuss the role of benchmarks and benchmarking and how good benchmarks can drive and measure progress towards the long-term goal of useful quantum computations, known as quantum utility. We explain how different kinds of benchmark quantify the performance of different parts of a quantum computer, discuss existing benchmarks, examine recent trends in benchmarking, and highlight important open research questions in this field.

View Accepted Manuscript (DOE)

Cite

Export

Save

Research Organization:: Sandia National Laboratories (SNL-CA), Livermore, CA (United States)

Sponsoring Organization:: USDOE National Nuclear Security Administration (NNSA); USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); USDOE Office of Science (SC), Fusion Energy Sciences (FES)

Grant/Contract Number:: NA0003525

OSTI ID:: 3019052

Report Number(s):: SAND--2026-17459J; 1749719

Journal Information:: Nature Reviews Physics, Journal Name: Nature Reviews Physics Journal Issue: 2 Vol. 7; ISSN 2522-5820

Publisher:: Springer NatureCopyright Statement

Country of Publication:: United States

Language:: English

References (151)

The LINPACK Benchmark: past, present and future Dongarra, Jack J.; Luszczek, Piotr; Petitet, Antoine Concurrency and Computation: Practice and Experience, Vol. 15, Issue 9 https://doi.org/10.1002/cpe.728	journal	January 2003
Verification of Quantum Computation: An Overview of Existing Approaches Gheorghiu, Alexandru; Kapourniotis, Theodoros; Kashefi, Elham Theory of Computing Systems, Vol. 63, Issue 4 https://doi.org/10.1007/s00224-018-9872-3	journal	July 2018
Quantum Computation and Quantum Information Nielsen, Michael A.; Chuang, Isaac L. Cambridge University Press https://doi.org/10.1017/CBO9780511976667	book	January 2011
An algorithmic benchmark for quantum information processing Knill, E.; Laflamme, R.; Martinez, R. Nature, Vol. 404, Issue 6776 https://doi.org/10.1038/35006012	journal	March 2000
Implementation of the Deutsch–Jozsa algorithm on an ion-trap quantum computer Gulde, Stephan; Riebe, Mark; Lancaster, Gavin P. T. Nature, Vol. 421, Issue 6918 https://doi.org/10.1038/nature01336	journal	January 2003
Demonstration of two-qubit algorithms with a superconducting quantum processor DiCarlo, L.; Chow, J. M.; Gambetta, J. M. Nature, Vol. 460, Issue 7252 https://doi.org/10.1038/nature08121	journal	June 2009
Oversimplifying quantum factoring Smolin, John A.; Smith, Graeme; Vargo, Alexander Nature, Vol. 499, Issue 7457 https://doi.org/10.1038/nature12290	journal	July 2013
Superconducting quantum circuits at the surface code threshold for fault tolerance Barends, R.; Kelly, J.; Megrant, A. Nature, Vol. 508, Issue 7497 https://doi.org/10.1038/nature13171	journal	April 2014
Roads towards fault-tolerant universal quantum computation Campbell, Earl T.; Terhal, Barbara M.; Vuillot, Christophe Nature, Vol. 549, Issue 7671 https://doi.org/10.1038/nature23460	journal	September 2017
Characterizing large-scale quantum computers via cycle benchmarking Erhard, Alexander; Wallman, Joel J.; Postler, Lukas Nature Communications, Vol. 10, Issue 1 https://doi.org/10.1038/s41467-019-13068-7	journal	November 2019
Detecting and tracking drift in quantum information processors Proctor, Timothy; Revelle, Melissa; Nielsen, Erik Nature Communications, Vol. 11, Issue 1 https://doi.org/10.1038/s41467-020-19074-4	journal	October 2020
Towards near-term quantum simulation of materials Clinton, Laura; Cubitt, Toby; Flynn, Brian Nature Communications, Vol. 15, Issue 1 https://doi.org/10.1038/s41467-023-43479-6	journal	January 2024
A generative modeling approach for benchmarking and training shallow quantum circuits Benedetti, Marcello; Garcia-Pintos, Delfina; Perdomo, Oscar npj Quantum Information, Vol. 5, Issue 1 https://doi.org/10.1038/s41534-019-0157-8	journal	May 2019
A quantum hamiltonian simulation benchmark Dong, Yulong; Whaley, K. Birgitta; Lin, Lin npj Quantum Information, Vol. 8, Issue 1 https://doi.org/10.1038/s41534-022-00636-x	journal	November 2022
Characterizing quantum supremacy in near-term devices Boixo, Sergio; Isakov, Sergei V.; Smelyanskiy, Vadim N. Nature Physics, Vol. 14, Issue 6 https://doi.org/10.1038/s41567-018-0124-x	journal	April 2018
Quantum approximate optimization of non-planar graph problems on a planar superconducting processor Harrigan, Matthew P.; Sung, Kevin J.; Neeley, Matthew Nature Physics, Vol. 17, Issue 3 https://doi.org/10.1038/s41567-020-01105-y	journal	February 2021
Measuring the capabilities of quantum computers Proctor, Timothy; Rudinger, Kenneth; Young, Kevin Nature Physics, Vol. 18, Issue 1 https://doi.org/10.1038/s41567-021-01409-7	journal	December 2021
Quantum supremacy using a programmable superconducting processor Arute, Frank; Arya, Kunal; Babbush, Ryan Nature, Vol. 574, Issue 7779 https://doi.org/10.1038/s41586-019-1666-5	journal	October 2019
Demonstration of the trapped-ion quantum CCD computer architecture Pino, J. M.; Dreiling, J. M.; Figgatt, C. Nature, Vol. 592, Issue 7853 https://doi.org/10.1038/s41586-021-03318-4	journal	April 2021
Realizing repeated quantum error correction in a distance-three surface code Krinner, Sebastian; Lacroix, Nathan; Remm, Ants Nature, Vol. 605, Issue 7911 https://doi.org/10.1038/s41586-022-04566-8	journal	May 2022
Multi-qubit entanglement and algorithms on a neutral-atom quantum computer Graham, T. M.; Song, Y.; Scott, J. Nature, Vol. 604, Issue 7906 https://doi.org/10.1038/s41586-022-04603-6	journal	April 2022
Suppressing quantum errors by scaling a surface code logical qubit Nature, Vol. 614, Issue 7949 https://doi.org/10.1038/s41586-022-05434-1	journal	February 2023
Evidence for the utility of quantum computing before fault tolerance Kim, Youngseok; Eddins, Andrew; Anand, Sajant Nature, Vol. 618, Issue 7965 https://doi.org/10.1038/s41586-023-06096-3	journal	June 2023
Encoding a magic state with beyond break-even fidelity Gupta, Riddhi S.; Sundaresan, Neereja; Alexander, Thomas Nature, Vol. 625, Issue 7994 https://doi.org/10.1038/s41586-023-06846-3	journal	January 2024
Logical quantum processor based on reconfigurable atom arrays Bluvstein, Dolev; Evered, Simon J.; Geim, Alexandra A. Nature, Vol. 626, Issue 7997 https://doi.org/10.1038/s41586-023-06927-3	journal	December 2023
Quantum certification and benchmarking Eisert, Jens; Hangleiter, Dominik; Walk, Nathan Nature Reviews Physics, Vol. 2, Issue 7 https://doi.org/10.1038/s42254-020-0186-4	journal	June 2020
The electronic complexity of the ground-state of the FeMo cofactor of nitrogenase as relevant to quantum simulations Li, Zhendong; Li, Junhao; Dattani, Nikesh S. The Journal of Chemical Physics, Vol. 150, Issue 2 https://doi.org/10.1063/1.5063376	journal	January 2019
Benchmarking of different optimizers in the variational quantum algorithms for applications in quantum chemistry Singh, Harshdeep; Majumder, Sonjoy; Mishra, Sabyashachi The Journal of Chemical Physics, Vol. 159, Issue 4 https://doi.org/10.1063/5.0161057	journal	July 2023
Experimental comparison of two quantum computing architectures Linke, Norbert M.; Maslov, Dmitri; Roetteler, Martin Proceedings of the National Academy of Sciences, Vol. 114, Issue 13 https://doi.org/10.1073/pnas.1618020114	journal	March 2017
Elucidating reaction mechanisms on quantum computers Reiher, Markus; Wiebe, Nathan; Svore, Krysta M. Proceedings of the National Academy of Sciences, Vol. 114, Issue 29 https://doi.org/10.1073/pnas.1619152114	journal	July 2017
Toward the first quantum simulation with quantum speedup Childs, Andrew M.; Maslov, Dmitri; Nam, Yunseong Proceedings of the National Academy of Sciences, Vol. 115, Issue 38 https://doi.org/10.1073/pnas.1801723115	journal	September 2018
Reliably assessing the electronic structure of cytochrome P450 on today’s classical computers and tomorrow’s quantum computers Goings, Joshua J.; White, Alec; Lee, Joonho Proceedings of the National Academy of Sciences, Vol. 119, Issue 38 https://doi.org/10.1073/pnas.2203533119	journal	September 2022
Quantum computation of stopping power for inertial fusion target design Rubin, Nicholas C.; Berry, Dominic W.; Kononov, Alina Proceedings of the National Academy of Sciences, Vol. 121, Issue 23 https://doi.org/10.1073/pnas.2317772121	journal	May 2024
Prescription for experimental determination of the dynamics of a quantum black box Chuang, Isaac L.; Nielsen, M. A. Journal of Modern Optics, Vol. 44, Issue 11-12 https://doi.org/10.1080/09500349708231894	journal	November 1997
Surface code quantum computing by lattice surgery Horsman, Clare; Fowler, Austin G.; Devitt, Simon New Journal of Physics, Vol. 14, Issue 12 https://doi.org/10.1088/1367-2630/14/12/123011	journal	December 2012
A randomized benchmarking suite for mid-circuit measurements Govia, L. C. G.; Jurcevic, P.; Wood, C. J. New Journal of Physics, Vol. 25, Issue 12 https://doi.org/10.1088/1367-2630/ad0e19 123016	journal	December 2023
Scalable noise estimation with random unitary operators Emerson, Joseph; Alicki, Robert; Życzkowski, Karol Journal of Optics B: Quantum and Semiclassical Optics, Vol. 7, Issue 10 https://doi.org/10.1088/1464-4266/7/10/021	journal	September 2005
Demonstration of quantum volume 64 on a superconducting quantum computing system Jurcevic, Petar; Javadi-Abhari, Ali; Bishop, Lev S. Quantum Science and Technology, Vol. 6, Issue 2 https://doi.org/10.1088/2058-9565/abe519	journal	March 2021
Early fault-tolerant simulations of the Hubbard model Campbell, Earl T. Quantum Science and Technology, Vol. 7, Issue 1 https://doi.org/10.1088/2058-9565/ac3110	journal	November 2021
Operational Markovianization in randomized benchmarking Figueroa-Romero, P.; Papič, M.; Auer, A. Quantum Science and Technology, Vol. 9, Issue 3 https://doi.org/10.1088/2058-9565/ad3f44	journal	April 2024
Compilation of Fault-Tolerant Quantum Heuristics for Combinatorial Optimization Sanders, Yuval R.; Berry, Dominic W.; Costa, Pedro C. S. PRX Quantum, Vol. 1, Issue 2 https://doi.org/10.1103/PRXQuantum.1.020312	journal	November 2020
Theoretical and Experimental Perspectives of Quantum Verification Carrasco, Jose; Elben, Andreas; Kokail, Christian PRX Quantum, Vol. 2, Issue 1 https://doi.org/10.1103/PRXQuantum.2.010102	journal	March 2021
Focus beyond Quadratic Speedups for Error-Corrected Quantum Advantage Babbush, Ryan; McClean, Jarrod R.; Newman, Michael PRX Quantum, Vol. 2, Issue 1 https://doi.org/10.1103/PRXQuantum.2.010103	journal	March 2021
Theory of Quantum System Certification Kliesch, Martin; Roth, Ingo PRX Quantum, Vol. 2, Issue 1 https://doi.org/10.1103/PRXQuantum.2.010201	journal	January 2021
Even More Efficient Quantum Computations of Chemistry Through Tensor Hypercontraction Lee, Joonho; Berry, Dominic W.; Gidney, Craig PRX Quantum, Vol. 2, Issue 3 https://doi.org/10.1103/PRXQuantum.2.030305	journal	July 2021
Fault-Tolerant Quantum Simulations of Chemistry in First Quantization Su, Yuan; Berry, Dominic W.; Wiebe, Nathan PRX Quantum, Vol. 2, Issue 4 https://doi.org/10.1103/PRXQuantum.2.040332	journal	November 2021
Randomized Benchmarking for Non-Markovian Noise Figueroa-Romero, Pedro; Modi, Kavan; Harris, Robert J. PRX Quantum, Vol. 2, Issue 4 https://doi.org/10.1103/PRXQuantum.2.040351	journal	December 2021
A Taxonomy of Small Markovian Errors Blume-Kohout, Robin; da Silva, Marcus P.; Nielsen, Erik PRX Quantum, Vol. 3, Issue 2 https://doi.org/10.1103/PRXQuantum.3.020335	journal	May 2022
General Framework for Randomized Benchmarking Helsen, J.; Roth, I.; Onorati, E. PRX Quantum, Vol. 3, Issue 2 https://doi.org/10.1103/PRXQuantum.3.020357	journal	June 2022
Fault-Tolerant Quantum Simulation of Materials Using Bloch Orbitals Rubin, Nicholas C.; Berry, Dominic W.; Malone, Fionn D. PRX Quantum, Vol. 4, Issue 4 https://doi.org/10.1103/PRXQuantum.4.040303	journal	October 2023
Learning Correlated Noise in a 39-Qubit Quantum Processor Harper, Robin; Flammia, Steven T. PRX Quantum, Vol. 4, Issue 4 https://doi.org/10.1103/PRXQuantum.4.040311	journal	October 2023
Efficient Tensor Network Simulation of IBM’s Eagle Kicked Ising Experiment Tindall, Joseph; Fishman, Matthew; Stoudenmire, E. Miles PRX Quantum, Vol. 5, Issue 1 https://doi.org/10.1103/PRXQuantum.5.010308	journal	January 2024
Analyzing Prospects for Quantum Advantage in Topological Data Analysis Berry, Dominic W.; Su, Yuan; Gyurik, Casper PRX Quantum, Vol. 5, Issue 1 https://doi.org/10.1103/PRXQuantum.5.010319	journal	February 2024
Fault-Tolerant Quantum Algorithm for Symmetry-Adapted Perturbation Theory Cortes, Cristian L.; Loipersberger, Matthias; Parrish, Robert M. PRX Quantum, Vol. 5, Issue 1 https://doi.org/10.1103/PRXQuantum.5.010336	journal	March 2024
Fully Scalable Randomized Benchmarking Without Motion Reversal Hines, Jordan; Hothem, Daniel; Blume-Kohout, Robin PRX Quantum, Vol. 5, Issue 3 https://doi.org/10.1103/PRXQuantum.5.030334	journal	August 2024
Determination of the Quantum State by Measurements Gale, W.; Guth, E.; Trammell, G. T. Physical Review, Vol. 165, Issue 5 https://doi.org/10.1103/PhysRev.165.1434	journal	January 1968
Validating quantum computers using randomized model circuits Cross, Andrew W.; Bishop, Lev S.; Sheldon, Sarah Physical Review A, Vol. 100, Issue 3 https://doi.org/10.1103/PhysRevA.100.032328	journal	September 2019
Resource estimate for quantum many-body ground-state preparation on a quantum computer Lemieux, Jessica; Duclos-Cianci, Guillaume; Sénéchal, David Physical Review A, Vol. 103, Issue 5 https://doi.org/10.1103/PhysRevA.103.052408	journal	May 2021
Random circuit block-encoded matrix and a proposal of quantum LINPACK benchmark Dong, Yulong; Lin, Lin Physical Review A, Vol. 103, Issue 6 https://doi.org/10.1103/PhysRevA.103.062412	journal	June 2021
Experimental accreditation of outputs of noisy quantum computers Ferracin, Samuele; Merkel, Seth T.; McKay, David Physical Review A, Vol. 104, Issue 4 https://doi.org/10.1103/PhysRevA.104.042603	journal	October 2021
Simulating key properties of lithium-ion batteries with a fault-tolerant quantum computer Delgado, Alain; Casares, Pablo A. M.; dos Reis, Roberto Physical Review A, Vol. 106, Issue 3 https://doi.org/10.1103/PhysRevA.106.032428	journal	September 2022
Quantifying T -gate-count improvements for ground-state-energy estimation with near-optimal state preparation Pathak, S.; Russo, A. E.; Seritan, S. K. Physical Review A, Vol. 107, Issue 4 https://doi.org/10.1103/PhysRevA.107.L040601	journal	April 2023
Quantum-state estimation Hradil, Z. Physical Review A, Vol. 55, Issue 3 https://doi.org/10.1103/PhysRevA.55.R1561	journal	March 1997
Randomized benchmarking of quantum gates Knill, E.; Leibfried, D.; Reichle, R. Physical Review A, Vol. 77, Issue 1 https://doi.org/10.1103/PhysRevA.77.012307	journal	January 2008
Low-distance surface codes under realistic quantum noise Tomita, Yu; Svore, Krysta M. Physical Review A, Vol. 90, Issue 6 https://doi.org/10.1103/PhysRevA.90.062320	journal	December 2014
Universal transversal gates with color codes: A simplified approach Kubica, Aleksander; Beverland, Michael E. Physical Review A, Vol. 91, Issue 3 https://doi.org/10.1103/PhysRevA.91.032330	journal	March 2015
Quantification and characterization of leakage errors Wood, Christopher J.; Gambetta, Jay M. Physical Review A, Vol. 97, Issue 3 https://doi.org/10.1103/PhysRevA.97.032306	journal	March 2018
Controlling error orientation to improve quantum algorithm success rates Murphy, Daniel C.; Brown, Kenneth R. Physical Review A, Vol. 99, Issue 3 https://doi.org/10.1103/PhysRevA.99.032318	journal	March 2019
Restless Tuneup of High-Fidelity Qubit Gates Rol, M. A.; Bultink, C. C.; O’Brien, T. E. Physical Review Applied, Vol. 7, Issue 4 https://doi.org/10.1103/PhysRevApplied.7.041001	journal	April 2017
Restrictions on Transversal Encoded Quantum Gate Sets Eastin, Bryan; Knill, Emanuel Physical Review Letters, Vol. 102, Issue 11 https://doi.org/10.1103/PhysRevLett.102.110502	journal	March 2009
Scalable and Robust Randomized Benchmarking of Quantum Processes Magesan, Easwar; Gambetta, J. M.; Emerson, Joseph Physical Review Letters, Vol. 106, Issue 18 https://doi.org/10.1103/PhysRevLett.106.180504	journal	May 2011
Efficient Measurement of Quantum Gate Error by Interleaved Randomized Benchmarking Magesan, Easwar; Gambetta, Jay M.; Johnson, B. R. Physical Review Letters, Vol. 109, Issue 8 https://doi.org/10.1103/PhysRevLett.109.080505	journal	August 2012
Characterization of Addressability by Simultaneous Randomized Benchmarking Gambetta, Jay M.; Córcoles, A. D.; Merkel, S. T. Physical Review Letters, Vol. 109, Issue 24 https://doi.org/10.1103/PhysRevLett.109.240504	journal	December 2012
Adaptive Hybrid Optimal Quantum Control for Imprecisely Characterized Systems Egger, D. J.; Wilhelm, F. K. Physical Review Letters, Vol. 112, Issue 24 https://doi.org/10.1103/PhysRevLett.112.240503	journal	June 2014
Optimal Quantum Control Using Randomized Benchmarking Kelly, J.; Barends, R.; Campbell, B. Physical Review Letters, Vol. 112, Issue 24 https://doi.org/10.1103/PhysRevLett.112.240504	journal	June 2014
What Randomized Benchmarking Actually Measures Proctor, Timothy; Rudinger, Kenneth; Young, Kevin Physical Review Letters, Vol. 119, Issue 13 https://doi.org/10.1103/PhysRevLett.119.130502	journal	September 2017
Three-Qubit Randomized Benchmarking McKay, David C.; Sheldon, Sarah; Smolin, John A. Physical Review Letters, Vol. 122, Issue 20 https://doi.org/10.1103/PhysRevLett.122.200502	journal	May 2019
Sample Complexity of Device-Independently Certified “Quantum Supremacy” Hangleiter, Dominik; Kliesch, Martin; Eisert, Jens Physical Review Letters, Vol. 122, Issue 21 https://doi.org/10.1103/PhysRevLett.122.210502	journal	May 2019
Direct Randomized Benchmarking for Multiqubit Devices Proctor, Timothy J.; Carignan-Dugas, Arnaud; Rudinger, Kenneth Physical Review Letters, Vol. 123, Issue 3 https://doi.org/10.1103/PhysRevLett.123.030503	journal	July 2019
Cross-Platform Verification of Intermediate Scale Quantum Devices Elben, Andreas; Vermersch, Benoît; van Bijnen, Rick Physical Review Letters, Vol. 124, Issue 1 https://doi.org/10.1103/PhysRevLett.124.010504	journal	January 2020
Scalable Randomized Benchmarking of Quantum Computers Using Mirror Circuits Proctor, Timothy; Seritan, Stefan; Rudinger, Kenneth Physical Review Letters, Vol. 129, Issue 15 https://doi.org/10.1103/PhysRevLett.129.150502	journal	October 2022
Bell Sampling from Quantum Circuits Hangleiter, Dominik; Gullans, Michael J. Physical Review Letters, Vol. 133, Issue 2 https://doi.org/10.1103/PhysRevLett.133.020601	journal	July 2024
Demonstration of a Fundamental Quantum Logic Gate Monroe, C.; Meekhof, D. M.; King, B. E. Physical Review Letters, Vol. 75, Issue 25 https://doi.org/10.1103/PhysRevLett.75.4714	journal	December 1995
Complete Characterization of a Quantum Process: The Two-Bit Quantum Gate Poyatos, J. F.; Cirac, J. I.; Zoller, P. Physical Review Letters, Vol. 78, Issue 2 https://doi.org/10.1103/PhysRevLett.78.390	journal	January 1997
Experimental Implementation of Fast Quantum Searching Chuang, Isaac L.; Gershenfeld, Neil; Kubinec, Mark Physical Review Letters, Vol. 80, Issue 15 https://doi.org/10.1103/PhysRevLett.80.3408	journal	April 1998
Benchmarking Quantum Control Methods on a 12-Qubit System Negrevergne, C.; Mahesh, T. S.; Ryan, C. A. Physical Review Letters, Vol. 96, Issue 17 https://doi.org/10.1103/PhysRevLett.96.170501	journal	May 2006
Experimental Demonstration of a Compiled Version of Shor’s Algorithm with Quantum Entanglement Lanyon, B. P.; Weinhold, T. J.; Langford, N. K. Physical Review Letters, Vol. 99, Issue 25 https://doi.org/10.1103/PhysRevLett.99.250505	journal	December 2007
Quantum computing enhanced computational catalysis von Burg, Vera; Low, Guang Hao; Häner, Thomas Physical Review Research, Vol. 3, Issue 3 https://doi.org/10.1103/PhysRevResearch.3.033055	journal	July 2021
Fault-tolerant resource estimate for quantum chemical simulations: Case study on Li-ion battery electrolyte molecules Kim, Isaac H.; Liu, Ye-Hua; Pallister, Sam Physical Review Research, Vol. 4, Issue 2 https://doi.org/10.1103/PhysRevResearch.4.023019	journal	April 2022
Noisy intermediate-scale quantum algorithms Bharti, Kishor; Cervera-Lierta, Alba; Kyaw, Thi Ha Reviews of Modern Physics, Vol. 94, Issue 1 https://doi.org/10.1103/RevModPhys.94.015004	journal	February 2022
Computational advantage of quantum random sampling Hangleiter, Dominik; Eisert, Jens Reviews of Modern Physics, Vol. 95, Issue 3 https://doi.org/10.1103/RevModPhys.95.035001	journal	July 2023
Quantum error mitigation Cai, Zhenyu; Babbush, Ryan; Benjamin, Simon C. Reviews of Modern Physics, Vol. 95, Issue 4 https://doi.org/10.1103/RevModPhys.95.045005	journal	December 2023
SupermarQ: A Scalable Quantum Benchmark Suite Tomesh, Teague; Gokhale, Pranav; Omole, Victory 2022 IEEE International Symposium on High-Performance Computer Architecture (HPCA) https://doi.org/10.1109/HPCA53966.2022.00050	conference	April 2022
Challenges and Opportunities of Near-Term Quantum Computing Systems Corcoles, Antonio D.; Kandala, Abhinav; Javadi-Abhari, Ali Proceedings of the IEEE, Vol. 108, Issue 8 https://doi.org/10.1109/JPROC.2019.2954005	journal	August 2020
QUARK: A Framework for Quantum Computing Application Benchmarking Finzgar, Jernej Rudi; Ross, Philipp; Holscher, Leonhard 2022 IEEE International Conference on Quantum Computing and Engineering (QCE) https://doi.org/10.1109/QCE53715.2022.00042	conference	September 2022
Evaluating the Q-score of Quantum Annealers Schoot, Ward van der; Leermakers, Daan; Wezeman, Robert 2022 IEEE International Conference on Quantum Software (QSW) https://doi.org/10.1109/QSW55613.2022.00017	conference	July 2022
Algorithms for quantum computation: discrete logarithms and factoring Shor, P. W. Proceedings 35th Annual Symposium on Foundations of Computer Science https://doi.org/10.1109/SFCS.1994.365700	conference	January 1994
Benchmarking Quantum Coprocessors in an Application-Centric, Hardware-Agnostic, and Scalable Way Martiel, Simon; Ayral, Thomas; Allouche, Cyril IEEE Transactions on Quantum Engineering, Vol. 2 https://doi.org/10.1109/TQE.2021.3090207	journal	January 2021
Application-Oriented Performance Benchmarks for Quantum Computing Lubinski, Thomas; Johri, Sonika; Varosy, Paul IEEE Transactions on Quantum Engineering, Vol. 4 https://doi.org/10.1109/TQE.2023.3253761	journal	January 2023
Scalable Full-Stack Benchmarks for Quantum Computers Hines, Jordan; Proctor, Timothy IEEE Transactions on Quantum Engineering, Vol. 5 https://doi.org/10.1109/TQE.2024.3404502	journal	January 2024
Learning a Quantum Computer's Capability Hothem, Daniel; Young, Kevin; Catanach, Tommie IEEE Transactions on Quantum Engineering, Vol. 5 https://doi.org/10.1109/TQE.2024.3430215	journal	January 2024
Fast and converged classical simulations of evidence for the utility of quantum computing before fault tolerance Begušić, Tomislav; Gray, Johnnie; Chan, Garnet Kin-Lic Science Advances, Vol. 10, Issue 3 https://doi.org/10.1126/sciadv.adk4321	journal	January 2024
Symmetrized Characterization of Noisy Quantum Processes Emerson, J.; Silva, M.; Moussa, O. Science, Vol. 317, Issue 5846 https://doi.org/10.1126/science.1145699	journal	September 2007
Effect of Cosmic Rays on Computer Memories Ziegler, J. F.; Lanford, W. A. Science, Vol. 206, Issue 4420 https://doi.org/10.1126/science.206.4420.776	journal	November 1979
Hartree-Fock on a superconducting qubit quantum computer Arute, Frank; Arya, Kunal; Babbush, Ryan Science, Vol. 369, Issue 6507 https://doi.org/10.1126/science.abb9811	journal	August 2020
Fault-Tolerant Quantum Computation with Constant Error Rate Aharonov, Dorit; Ben-Or, Michael SIAM Journal on Computing, Vol. 38, Issue 4 https://doi.org/10.1137/S0097539799359385	journal	January 2008
Full-stack, real-system quantum computer studies: architectural comparisons and design insights Murali, Prakash; Linke, Norbert Matthias; Martonosi, Margaret ISCA '19: The 46th Annual International Symposium on Computer Architecture, Proceedings of the 46th International Symposium on Computer Architecture https://doi.org/10.1145/3307650.3322273	conference	June 2019
Disentangling Hype from Practicality: On Realistically Achieving Quantum Advantage Hoefler, Torsten; Häner, Thomas; Troyer, Matthias Communications of the ACM, Vol. 66, Issue 5 https://doi.org/10.1145/3571725	journal	April 2023
Randomized benchmarking with gate-dependent noise Wallman, Joel J. Quantum, Vol. 2 https://doi.org/10.22331/q-2018-01-29-47	journal	January 2018
Quantum Computing in the NISQ era and beyond Preskill, John Quantum, Vol. 2 https://doi.org/10.22331/q-2018-08-06-79	journal	August 2018
Magic State Distillation: Not as Costly as You Think Litinski, Daniel Quantum, Vol. 3 https://doi.org/10.22331/q-2019-12-02-205	journal	December 2019
Detecting crosstalk errors in quantum information processors Sarovar, Mohan; Proctor, Timothy; Rudinger, Kenneth Quantum, Vol. 4 https://doi.org/10.22331/q-2020-09-11-321	journal	September 2020
A volumetric framework for quantum computer benchmarks Blume-Kohout, Robin; Young, Kevin C. Quantum, Vol. 4 https://doi.org/10.22331/q-2020-11-15-362	journal	November 2020
Application-Motivated, Holistic Benchmarking of a Full Quantum Computing Stack Mills, Daniel; Sivarajah, Seyon; Scholten, Travis L. Quantum, Vol. 5 https://doi.org/10.22331/q-2021-03-22-415	journal	March 2021
How to factor 2048 bit RSA integers in 8 hours using 20 million noisy qubits Gidney, Craig; Ekerå, Martin Quantum, Vol. 5 https://doi.org/10.22331/q-2021-04-15-433	journal	April 2021
Gate Set Tomography Nielsen, Erik; Gamble, John King; Rudinger, Kenneth Quantum, Vol. 5 https://doi.org/10.22331/q-2021-10-05-557	journal	October 2021
Randomized Benchmarking as Convolution: Fourier Analysis of Gate Dependent Errors Merkel, Seth T.; Pritchett, Emily J.; Fong, Bryan H. Quantum, Vol. 5 https://doi.org/10.22331/q-2021-11-16-581	journal	November 2021
Quantum simulation of battery materials using ionic pseudopotentials Shokrian Zini, Modjtaba; Delgado, Alain; dos Reis, Roberto Quantum, Vol. 7 https://doi.org/10.22331/q-2023-07-10-1049	journal	July 2023
MQT Bench: Benchmarking Software and Design Automation Tools for Quantum Computing Quetschlich, Nils; Burgholzer, Lukas; Wille, Robert Quantum, Vol. 7 https://doi.org/10.22331/q-2023-07-20-1062	journal	July 2023
Fault-tolerant quantum computation of molecular observables Steudtner, Mark; Morley-Short, Sam; Pol, William Quantum, Vol. 7 https://doi.org/10.22331/q-2023-11-06-1164	journal	November 2023
Qibolab: an open-source hybrid quantum operating system Efthymiou, Stavros; Orgaz-Fuertes, Alvaro; Carobene, Rodolfo Quantum, Vol. 8 https://doi.org/10.22331/q-2024-02-12-1247	journal	February 2024
Benchmarking a trapped-ion quantum computer with 30 qubits Chen, Jwo-Sy; Nielsen, Erik; Ebert, Matthew Quantum, Vol. 8 https://doi.org/10.22331/q-2024-11-07-1516	journal	November 2024
Large-Scale Simulation of Shor’s Quantum Factoring Algorithm Willsch, Dennis; Willsch, Madita; Jin, Fengping Mathematics, Vol. 11, Issue 19 https://doi.org/10.3390/math11194222	journal	October 2023
Logical Randomized Benchmarking Combes, Joshua; Granade, Christopher; Ferrie, Christopher arXiv https://doi.org/10.48550/arXiv.1702.03688	preprint	January 2017
QASMBench: A Low-level QASM Benchmark Suite for NISQ Evaluation and Simulation Li, Ang; Stein, Samuel; Krishnamoorthy, Sriram arXiv https://doi.org/10.48550/arXiv.2005.13018	preprint	January 2020
Scalable Benchmarks for Gate-Based Quantum Computers Cornelissen, Arjan; Bausch, Johannes; Gilyén, András arXiv https://doi.org/10.48550/arXiv.2104.10698	preprint	January 2021
Quantum Computer Benchmarking via Quantum Algorithms Georgopoulos, Konstantinos; Emary, Clive; Zuliani, Paolo arXiv https://doi.org/10.48550/arXiv.2112.09457	preprint	January 2021
Arline Benchmarks: Automated Benchmarking Platform for Quantum Compilers Kharkov, Y.; Ivanova, A.; Mikhantiev, E. arXiv https://doi.org/10.48550/arXiv.2202.14025	preprint	January 2022
Establishing trust in quantum computations Proctor, Timothy; Seritan, Stefan; Nielsen, Erik arXiv https://doi.org/10.48550/arXiv.2204.07568	preprint	January 2022
QPack Scores: Quantitative performance metrics for application-oriented quantum computer benchmarking Donkers, Huub; Mesman, Koen; Al-Ars, Zaid arXiv https://doi.org/10.48550/arXiv.2205.12142	preprint	January 2022
VeriQBench: A Benchmark for Multiple Types of Quantum Circuits Chen, Kean; Fang, Wang; Guan, Ji arXiv https://doi.org/10.48550/arXiv.2206.10880	preprint	January 2022
Randomized benchmarking with random quantum circuits Heinrich, Markus; Kliesch, Martin; Roth, Ingo arXiv https://doi.org/10.48550/arXiv.2212.06181	preprint	January 2022
Extending the Q-score to an Application-level Quantum Metric Framework van der Schoot, Ward; Wezeman, Robert; Neumann, Niels M. P. arXiv https://doi.org/10.48550/arXiv.2302.00639	preprint	January 2023
Optimization Applications as Quantum Performance Benchmarks Lubinski, Thomas; Coffrin, Carleton; McGeoch, Catherine arXiv https://doi.org/10.48550/arXiv.2302.02278	preprint	January 2023
Benchmarking Quantum Processor Performance at Scale McKay, David C.; Hincks, Ian; Pritchett, Emily J. arXiv https://doi.org/10.48550/arXiv.2311.05933	preprint	January 2023
Quantum Simulation of Realistic Materials in First Quantization Using Non-local Pseudopotentials Berry, Dominic W.; Rubin, Nicholas C.; Elnabawy, Ahmed O. arXiv https://doi.org/10.48550/arXiv.2312.07654	preprint	January 2023
Quantum Algorithm Exploration using Application-Oriented Performance Benchmarks Lubinski, Thomas; Goings, Joshua J.; Mayer, Karl arXiv https://doi.org/10.48550/arXiv.2402.08985	preprint	January 2024
Requirements for building effective Hamiltonians using quantum-enhanced density matrix downfolding Pathak, Shivesh; Russo, Antonio E.; Seritan, Stefan arXiv https://doi.org/10.48550/arXiv.2403.01043	preprint	January 2024
Exponential improvements in the simulation of lattice gauge theories using near-optimal techniques Rhodes, Mason L.; Kreshchuk, Michael; Pathak, Shivesh arXiv https://doi.org/10.48550/arXiv.2405.10416	text	January 2024
Simulating X-ray absorption spectroscopy of battery materials on a quantum computer Fomichev, Stepan; Hejazi, Kasra; Loaiza, Ignacio arXiv https://doi.org/10.48550/arXiv.2405.11015	preprint	January 2024
A generalized cycle benchmarking algorithm for characterizing mid-circuit measurements Zhang, Zhihan; Chen, Senrui; Liu, Yunchao arXiv https://doi.org/10.48550/arXiv.2406.02669	preprint	January 2024
Superconducting qubits in the millions: the potential and limitations of modularity Saadatmand, S. N.; Wilson, Tyler L.; Hodson, Mark J. arXiv https://doi.org/10.48550/arXiv.2406.06015	preprint	January 2024
Detailed assessment of calculating drag force with quantum computers: Explicit time-evolution precludes exponential advantage for nonlinear differential equations Penuel, John; Katabarwa, Amara; Johnson, Peter D. arXiv https://doi.org/10.48550/arXiv.2406.06323	preprint	January 2024
Feasibility of accelerating homogeneous catalyst discovery with fault-tolerant quantum computers Bellonzi, Nicole; Kunitsa, Alexander; Cantin, Joshua T. arXiv https://doi.org/10.48550/arXiv.2406.06335	preprint	January 2024
Quantifying fault tolerant simulation of strongly correlated systems using the Fermi-Hubbard model Agrawal, Anjali A.; Job, Joshua; Wilson, Tyler L. arXiv https://doi.org/10.48550/arXiv.2406.06511	preprint	January 2024
Pauli Noise Learning for Mid-Circuit Measurements Hines, Jordan; Proctor, Timothy arXiv https://doi.org/10.48550/arXiv.2406.09299	preprint	January 2024
Prospects for NMR Spectral Prediction on Fault-Tolerant Quantum Computers Elenewski, Justin E.; Camara, Christina M.; Kalev, Amir arXiv https://doi.org/10.48550/arXiv.2406.09340	preprint	January 2024
Quantum Resources Required for Binding Affinity Calculations of Amyloid beta Otten, Matthew; Watts, Thomas W.; Johnson, Samuel D. arXiv https://doi.org/10.48550/arXiv.2406.18744	preprint	January 2024
Quantum computing for corrosion-resistant materials and anti-corrosive coatings design Nguyen, Nam; Watts, Thomas W.; Link, Benjamin arXiv https://doi.org/10.48550/arXiv.2406.18759	preprint	January 2024
Achieving Energetic Superiority Through System-Level Quantum Circuit Simulation Fu, Rong; Su, Zhongling; Zhong, Han-Sen arXiv https://doi.org/10.48550/arXiv.2407.00769	preprint	January 2024
A Practical Introduction to Benchmarking and Characterization of Quantum Computers Hashim, Akel; Nguyen, Long B.; Goss, Noah arXiv https://doi.org/10.48550/arXiv.2408.12064	preprint	January 2024

Similar Records

Practical Introduction to Benchmarking and Characterization of Quantum Computers

Journal Article · Thu Aug 14 20:00:00 EDT 2025 · PRX Quantum · OSTI ID:3000676

Hashim, Akel; Nguyen, Long B.; Goss, Noah; +16 more

HamPerf: A Hamiltonian-Oriented Approach to Quantum Benchmarking

Conference · Mon Jul 01 00:00:00 EDT 2024 · OSTI ID:2567475

Butko, Anastasiia; Klymko, Katherine; Camps, Daan; +1 more

Using benchmarks for radiation testing of microprocessors and FPGAs

Journal Article · Wed Dec 16 19:00:00 EST 2015 · IEEE Transactions on Nuclear Science · OSTI ID:1312569

Quinn, Heather; Robinson, William H.; Rech, Paolo; +13 more

Title: Benchmarking quantum computers

Citation Formats

References (151)

Similar Records

Related Subjects