Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Subtleties in the trainability of quantum machine learning models

Journal Article · · Quantum Machine Intelligence
 [1];  [2];  [3];  [4];  [4]
  1. Los Alamos National Laboratory (LANL), Los Alamos, NM (United States); National Univ. of Singapore (Singapore); Ecole Polytechnique Federale Lausanne (EPFL) (Switzerland); Ministry of Higher Education, Science, Research and Innovation (Thailand)
  2. Los Alamos National Laboratory (LANL), Los Alamos, NM (United States); Imperial College, London (United Kingdom)
  3. Los Alamos National Laboratory (LANL), Los Alamos, NM (United States); State Univ. of New York (SUNY), Stony Brook, NY (United States)
  4. Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
A new paradigm for data science has emerged, with quantum data, quantum models, and quantum computational devices. This field, called quantum machine learning (QML), aims to achieve a speedup over traditional machine learning for data analysis. However, its success usually hinges on efficiently training the parameters in quantum neural networks, and the field of QML is still lacking theoretical scaling results for their trainability. Some trainability results have been proven for a closely related field called variational quantum algorithms (VQAs). While both fields involve training a parametrized quantum circuit, there are crucial differences that make the results for one setting not readily applicable to the other. In this work, we bridge the two frameworks and show that gradient scaling results for VQAs can also be applied to study the gradient scaling of QML models. Our results indicate that features deemed detrimental for VQA trainability can also lead to issues such as barren plateaus in QML. Consequently, our work has implications for several QML proposals in the literature. In addition, we provide theoretical and numerical evidence that QML models exhibit further trainability issues not present in VQAs, arising from the use of a training dataset. We refer to these as dataset-induced barren plateaus. These results are most relevant when dealing with classical data, as here the choice of embedding scheme (i.e., the map between classical data and quantum states) can greatly affect the gradient scaling.
Research Organization:
Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
Sponsoring Organization:
USDOE Laboratory Directed Research and Development (LDRD) Program; USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); USDOE National Nuclear Security Administration (NNSA)
Grant/Contract Number:
89233218CNA000001
OSTI ID:
2305307
Report Number(s):
LA-UR--21-30290
Journal Information:
Quantum Machine Intelligence, Journal Name: Quantum Machine Intelligence Journal Issue: 1 Vol. 5; ISSN 2524-4906
Publisher:
Springer NatureCopyright Statement
Country of Publication:
United States
Language:
English

References (52)

Principal Component Analysis book January 2005
Variational Quantum Factoring book January 2019
The quest for a Quantum Neural Network journal August 2014
Variational algorithms for linear algebra journal June 2021
Quantum machine learning journal September 2017
A variational eigenvalue solver on a photonic quantum processor journal July 2014
Barren plateaus in quantum neural network training landscapes journal November 2018
An adaptive variational algorithm for exact molecular simulations on a quantum computer journal July 2019
Training deep quantum neural networks journal February 2020
Anomalous collapses of Nares Strait ice arches leads to enhanced export of Arctic sea ice journal January 2021
Cost function dependent barren plateaus in shallow parametrized quantum circuits journal March 2021
Noise-induced barren plateaus in variational quantum algorithms journal November 2021
Quantum algorithmic measurement journal February 2022
Generalization in quantum machine learning from few training data journal August 2022
Quantum variational algorithms are swamped with traps journal December 2022
IBM Q Experience as a versatile experimental testbed for simulating open quantum systems journal January 2020
Quantum convolutional neural networks journal August 2019
A rigorous and robust quantum speed-up in supervised machine learning journal July 2021
Supervised learning with quantum-enhanced feature spaces journal March 2019
QDataSet, quantum datasets for machine learning journal September 2022
Variational quantum algorithms journal August 2021
The power of quantum neural networks journal June 2021
An introduction to quantum machine learning journal October 2014
Noise resilience of variational quantum compiling journal April 2020
Characterizing the loss landscape of variational quantum circuits journal February 2021
Higher order derivatives of quantum neural networks with barren plateaus journal June 2021
Equivalence of quantum barren plateaus to cost concentration and narrow gorges journal August 2022
Classical simulation of commuting quantum computations implies collapse of the polynomial hierarchy
  • Bremner, Michael J.; Jozsa, Richard; Shepherd, Dan J.
  • Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 467, Issue 2126 https://doi.org/10.1098/rspa.2010.0301
journal July 2010
Entanglement-Induced Barren Plateaus journal October 2021
Generalization in Quantum Machine Learning: A Quantum Information Standpoint journal November 2021
Connecting Ansatz Expressibility to Gradient Magnitudes and Barren Plateaus journal January 2022
Circuit-centric quantum classifiers journal March 2020
Robust data encodings for quantum classifiers journal September 2020
Training quantum embedding kernels on near-term quantum computers journal October 2022
Quantum circuit learning journal September 2018
Evaluating analytic gradients on quantum hardware journal March 2019
Variational Quantum Simulation of General Processes journal June 2020
Barren Plateaus Preclude Learning Scramblers journal May 2021
Information-Theoretic Bounds on Quantum Advantage in Machine Learning journal May 2021
Efficient Measure for the Expressivity of Variational Quantum Algorithms journal February 2022
Trainability of Dissipative Perceptron-Based Quantum Neural Networks journal May 2022
Presence and Absence of Barren Plateaus in Tensor-Network Based Machine Learning journal December 2022
Expressibility and trainability of parametrized analog quantum systems for machine learning applications journal December 2020
Entanglement devised barren plateau mitigation journal July 2021
Trainable Discrete Feature Embeddings for Quantum Machine Learning conference October 2021
On Hastings' Counterexamples to the Minimum Output Entropy Additivity Conjecture journal March 2010
Natural Gradient Works Efficiently in Learning journal February 1998
Quantum Computing in the NISQ era and beyond journal August 2018
Quantum-assisted quantum compiling journal May 2019
Analyzing the barren plateau phenomenon in training quantum neural networks with the ZX-calculus journal June 2021
Effect of barren plateaus on gradient-free optimization journal October 2021
Diagnosing Barren Plateaus with Tools from Quantum Optimal Control journal September 2022

Similar Records

On the practical usefulness of the Hardware Efficient Ansatz
Journal Article · Wed Jul 03 00:00:00 EDT 2024 · Quantum · OSTI ID:2391064

Trainability of Dissipative Perceptron-Based Quantum Neural Networks
Journal Article · Fri May 06 00:00:00 EDT 2022 · Physical Review Letters · OSTI ID:1992248