Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Generalization in quantum machine learning from few training data

Journal Article · · Nature Communications
Abstract

Modern quantum machine learning (QML) methods involve variationally optimizing a parameterized quantum circuit on a training data set, and subsequently making predictions on a testing data set (i.e., generalizing). In this work, we provide a comprehensive study of generalization performance in QML after training on a limited number N of training data points. We show that the generalization error of a quantum machine learning model with T trainable gates scales at worst as $$$$\sqrt{T/N}$$$$ T / N . When only K  ≪  T gates have undergone substantial change in the optimization process, we prove that the generalization error improves to $$$$\sqrt{K/N}$$$$ K / N . Our results imply that the compiling of unitaries into a polynomial number of native gates, a crucial application for the quantum computing industry that typically uses exponential-size training data, can be sped up significantly. We also show that classification of quantum states across a phase transition with a quantum convolutional neural network requires only a very small training data set. Other potential applications include learning quantum error correcting codes or quantum dynamical simulation. Our work injects new hope into the field of QML, as good generalization is guaranteed from few training data.

Research Organization:
Los Alamos National Laboratory (LANL)
Sponsoring Organization:
German Academic Scholarship Foundation; J. Yang & Family Foundation; Technical University of Munich; USDOE; USDOE Laboratory Directed Research and Development (LDRD) Program; USDOE National Nuclear Security Administration (NNSA); USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
Grant/Contract Number:
89233218CNA000001
OSTI ID:
1882759
Alternate ID(s):
OSTI ID: 1889979
Report Number(s):
LA-UR-21-31086; 4919; PII: 32550
Journal Information:
Nature Communications, Journal Name: Nature Communications Journal Issue: 1 Vol. 13; ISSN 2041-1723
Publisher:
Nature Publishing GroupCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (70)

Variational Quantum Generators: Generative Adversarial Quantum Machine Learning for Continuous Distributions journal December 2020
Quantum error correction via convex optimization journal July 2009
The quest for a Quantum Neural Network journal August 2014
Learning bounds for quantum circuits in the agnostic setting journal September 2021
Pseudo-dimension of quantum circuits journal November 2020
A practical introduction to tensor networks: Matrix product states and projected entangled pair states journal October 2014
High-Dimensional Probability: An Introduction with Applications in Data Science book September 2018
Quantum machine learning journal September 2017
Barren plateaus in quantum neural network training landscapes journal November 2018
An adaptive variational algorithm for exact molecular simulations on a quantum computer journal July 2019
Anomalous collapses of Nares Strait ice arches leads to enhanced export of Arctic sea ice journal January 2021
Cost function dependent barren plateaus in shallow parametrized quantum circuits journal March 2021
Quantum algorithmic measurement journal February 2022
Quantum generalisation of feedforward neural networks journal September 2017
IBM Q Experience as a versatile experimental testbed for simulating open quantum systems journal January 2020
Variational fast forwarding for quantum simulation beyond the coherence time journal September 2020
Quantum convolutional neural networks journal August 2019
A rigorous and robust quantum speed-up in supervised machine learning journal July 2021
Supervised learning with quantum-enhanced feature spaces journal March 2019
Variational quantum algorithms journal August 2021
The power of quantum neural networks journal June 2021
An introduction to quantum machine learning journal October 2014
Machine learning & artificial intelligence in the quantum domain: a review of recent progress journal June 2018
Efficient classical simulation of the quantum Fourier transform journal May 2007
Learning the quantum algorithm for state overlap journal November 2018
Noise resilience of variational quantum compiling journal April 2020
On barren plateaus and cost function locality in variational quantum algorithms journal May 2021
Quantum autoencoders for efficient compression of quantum data journal August 2017
Strategies for quantum computing molecular energies using the unitary coupled cluster ansatz journal October 2018
Large gradients via correlation in random parameterized quantum circuits journal January 2021
Higher order derivatives of quantum neural networks with barren plateaus journal June 2021
Sample complexity of learning parametric quantum circuits journal March 2022
Machine Learning of Noise-Resilient Quantum Circuits journal February 2021
Qubit-ADAPT-VQE: An Adaptive Algorithm for Constructing Hardware-Efficient Ansätze on a Quantum Processor journal April 2021
Entanglement-Induced Barren Plateaus journal October 2021
Generalization in Quantum Machine Learning: A Quantum Information Standpoint journal November 2021
Connecting Ansatz Expressibility to Gradient Magnitudes and Barren Plateaus journal January 2022
Representation Learning via Quantum Neural Tangent Kernels journal August 2022
Statistical complexity of quantum circuits journal June 2022
Structured near-optimal channel-adapted quantum error correction journal January 2008
Quantum generative adversarial networks journal July 2018
Perfect sampling with unitary tensor networks journal April 2012
One-dimensional symmetry protected topological phases and their transitions journal October 2017
Robust Quantum Error Correction via Convex Optimization journal January 2008
Quantum Generative Adversarial Learning journal July 2018
Variational Quantum Simulation of General Processes journal June 2020
Barren Plateaus Preclude Learning Scramblers journal May 2021
Information-Theoretic Bounds on Quantum Advantage in Machine Learning journal May 2021
Reformulation of the No-Free-Lunch Theorem for Entangled Datasets journal February 2022
Efficient Measure for the Expressivity of Variational Quantum Algorithms journal February 2022
Trainability of Dissipative Perceptron-Based Quantum Neural Networks journal May 2022
Density matrix formulation for quantum renormalization groups journal November 1992
Classical Simulation of Infinite-Size Quantum Lattice Systems in One Spatial Dimension journal February 2007
Entanglement devised barren plateau mitigation journal July 2021
Experimental quantum learning of a spectral decomposition journal August 2021
Variational quantum anomaly detection: Unsupervised mapping of phase diagrams on a physical quantum computer journal December 2021
Noisy intermediate-scale quantum algorithms journal February 2022
Channel-Adapted Quantum Error Correction for the Amplitude Damping Channel journal December 2008
Channel-Optimized Quantum Error Correction journal March 2010
On the Uniform Convergence of Relative Frequencies of Events to Their Probabilities journal January 1971
On the Expressibility and Overfitting of Quantum Circuit Learning journal July 2021
Some Limit Theorems for Empirical Processes journal November 1984
Unsupervised mapping of phase diagrams of 2D systems from infinite projected entangled-pair states via deep anomaly detection journal August 2021
Quantum Computing in the NISQ era and beyond journal August 2018
Quantum-assisted quantum compiling journal May 2019
Data re-uploading for a universal quantum classifier journal February 2020
An Adaptive Optimizer for Measurement-Frugal Variational Algorithms journal May 2020
Effect of barren plateaus on gradient-free optimization journal October 2021
Encoding-dependent generalization bounds for parametrized quantum circuits journal November 2021
Hybrid Quantum-Classical Algorithms and Quantum Error Mitigation journal March 2021

Similar Records

A quantum algorithm for string matching
Journal Article · Mon Feb 15 19:00:00 EST 2021 · npj Quantum Information · OSTI ID:1765937

Ion trap long-range XY model for quantum state transfer and optimal spatial search
Journal Article · Sun Jun 11 20:00:00 EDT 2023 · Quantum Science and Technology · OSTI ID:1984726

New physics in rare B decays after Moriond 2021
Journal Article · Wed Oct 27 20:00:00 EDT 2021 · European Physical Journal. C, Particles and Fields · OSTI ID:1828087