skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Measuring the capabilities of quantum computers

Journal Article · · Nature Physics

Quantum computers can now run interesting programs, but each processor’s capability—the set of programs that it can run successfully—is limited by hardware errors. These errors can be complicated, making it difficult to accurately predict a processor’s capability. Benchmarks can be used to measure capability directly, but current benchmarks have limited flexibility and scale poorly to many-qubit processors. We show how to construct scalable, efficiently verifiable benchmarks based on any program by using a technique that we call circuit mirroring. With it, we construct two flexible, scalable volumetric benchmarks based on randomized and periodically ordered programs. We use these benchmarks to map out the capabilities of twelve publicly available processors, and to measure the impact of program structure on each one. We find that standard error metrics are poor predictors of whether a program will run successfully on today’s hardware, and that current processors vary widely in their sensitivity to program structure.

Research Organization:
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
Grant/Contract Number:
NA0003525
OSTI ID:
1841976
Report Number(s):
SAND-2021-12259J; 700534
Journal Information:
Nature Physics, Vol. 18, Issue 1; ISSN 1745-2473
Publisher:
Nature Publishing Group (NPG)Copyright Statement
Country of Publication:
United States
Language:
English

References (44)

Benchmarking gate-based quantum computers journal November 2017
Validating quantum computers using randomized model circuits journal September 2019
Shorter gate sequences for quantum computing by mixing unitaries journal April 2017
Experimental comparison of two quantum computing architectures journal March 2017
Characterizing quantum supremacy in near-term devices journal April 2018
Scalable noise estimation with random unitary operators journal September 2005
Accrediting outputs of noisy intermediate-scale quantum computing devices journal November 2019
Performance of quantum error correction with coherent errors journal February 2019
Bounding the average gate fidelity of composite channels using the unitarity journal May 2019
Efficient learning of quantum noise journal August 2020
Quantum Theory of Electrical Transport Phenomena journal November 1957
Efficient Z gates for quantum computing journal August 2017
Measuring the Capabilities of Quantum Computers dataset January 2021
Fault-Tolerant Thresholds for the Surface Code in Excess of 5 % Under Biased Noise journal March 2020
Noise tailoring for scalable quantum computation via randomized compiling journal November 2016
Detecting crosstalk errors in quantum information processors journal September 2020
Benchmarking an 11-qubit quantum computer journal November 2019
Scalable and Robust Randomized Benchmarking of Quantum Processes journal May 2011
Quantum chemistry as a benchmark for near-term quantum computers journal November 2019
Quantum computing with realistically noisy devices journal March 2005
Probing quantum processor performance with pyGSTi journal July 2020
Quantum supremacy using a programmable superconducting processor journal October 2019
Comparing Experiments to the Fault-Tolerance Threshold journal October 2016
Characterizing large-scale quantum computers via cycle benchmarking journal November 2019
Ultrahigh Error Threshold for Surface Codes with Biased Noise journal January 2018
Experimental quantum verification in the presence of temporally correlated noise journal February 2018
Quantum Computing in the NISQ era and beyond journal August 2018
Controlling error orientation to improve quantum algorithm success rates journal March 2019
A volumetric framework for quantum computer benchmarks journal November 2020
Demonstration of qubit operations below a rigorous fault tolerance threshold with gate set tomography journal February 2017
Full-stack, real-system quantum computer studies: architectural comparisons and design insights
  • Murali, Prakash; Linke, Norbert Matthias; Martonosi, Margaret
  • ISCA '19: The 46th Annual International Symposium on Computer Architecture, Proceedings of the 46th International Symposium on Computer Architecture https://doi.org/10.1145/3307650.3322273
conference June 2019
Direct Randomized Benchmarking for Multiqubit Devices journal July 2019
Characterization of Addressability by Simultaneous Randomized Benchmarking journal December 2012
Detecting and tracking drift in quantum information processors journal October 2020
Quantum computational supremacy journal September 2017
Three-Qubit Randomized Benchmarking journal May 2019
Quantum supremacy using a programmable superconducting processor dataset January 2019
Measuring the Capabilities of Quantum Computers dataset January 2021
Quantum gate teleportation between separated qubits in a trapped-ion processor journal May 2019
Randomized benchmarking with gate-dependent noise journal January 2018
Characterizing Quantum Gates via Randomized Benchmarking text January 2011
Noise tailoring for scalable quantum computation via randomized compiling text January 2015
What randomized benchmarking actually measures text January 2017
A blueprint for demonstrating quantum supremacy with superconducting qubits text January 2017

Cited By (3)

Efficient flexible characterization of quantum processors with nested error models journal September 2021
Error-Robust Quantum Logic Optimization Using a Cloud Quantum Computer Interface journal June 2021
Fair Sampling Error Analysis on NISQ Devices text January 2021

Similar Records

Qubit Assignment Using Time Reversal
Journal Article · Thu Dec 22 00:00:00 EST 2022 · PRX Quantum · OSTI ID:1841976

Storage-Intensive Supercomputing Benchmark Study
Technical Report · Tue Oct 30 00:00:00 EDT 2007 · OSTI ID:1841976

Direct Randomized Benchmarking for Multiqubit Devices
Journal Article · Fri Jul 19 00:00:00 EDT 2019 · Physical Review Letters · OSTI ID:1841976