Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Infinite neural network quantum states: entanglement and training dynamics

Journal Article · · Machine Learning: Science and Technology
 [1];  [2]
  1. University of Illinois at Urbana-Champaign, IL (United States); Massachusetts Institute of Technology, Cambridge, MA (United States); Harvard, Cambridge, MA (United States)
  2. Northeastern University, Boston, MA (United States)
We study infinite limits of neural network quantum states (∞-NNQS), which exhibit representation power through ensemble statistics, and also tractable gradient descent dynamics. Ensemble averages of entanglement entropies are expressed in terms of neural network correlators, and architectures that exhibit volume-law entanglement are presented. The analytic calculations of entanglement entropy bound are tractable because the ensemble statistics are simplified in the Gaussian process limit. A general framework is developed for studying the gradient descent dynamics of neural network quantum states (NNQS), using a quantum state neural tangent kernel (QS-NTK). For ∞-NNQS the training dynamics is simplified, since the QS-NTK becomes deterministic and constant. An analytic solution is derived for quantum state supervised learning, which allows an ∞-NNQS to recover any target wavefunction. Numerical experiments on finite and infinite NNQS in the transverse field Ising model and Fermi Hubbard model demonstrate excellent agreement with theory. ∞-NNQS opens up new opportunities for studying entanglement and training dynamics in other physics applications, such as in finding ground states.
Research Organization:
Brookhaven National Laboratory (BNL), Upton, NY (United States); National Quantum Information Science (QIS) Research Centers (United States). Co-design Center for Quantum Advantage (C2QA)
Sponsoring Organization:
NSF CAREER; USDOE Office of Science (SC)
Grant/Contract Number:
SC0012704
OSTI ID:
2425540
Journal Information:
Machine Learning: Science and Technology, Journal Name: Machine Learning: Science and Technology Journal Issue: 2 Vol. 4; ISSN 2632-2153
Publisher:
IOP PublishingCopyright Statement
Country of Publication:
United States
Language:
English

References (37)

Approximation by superpositions of a sigmoidal function journal December 1989
Approximation capabilities of multilayer feedforward networks journal January 1991
Efficient representation of quantum many-body states with deep neural networks journal September 2017
Generalization properties of neural network approximations to frustrated magnet ground states journal March 2020
Classical variational simulation of the Quantum Approximate Optimization Algorithm journal June 2021
Neural-network quantum state tomography journal February 2018
Entanglement area law for shallow and deep quantum neural network states journal May 2020
Neural networks and quantum field theory journal April 2021
Calculating Rényi entropies with neural autoregressive quantum states journal December 2020
Two-dimensional frustrated J 1 − J 2 model studied with neural network quantum states journal September 2019
Phases of two-dimensional spinless lattice fermions with first-quantized deep neural-network quantum states journal November 2020
Entanglement transitions from restricted Boltzmann machines journal September 2021
Restricted Boltzmann machine learning for solving strongly correlated quantum systems journal November 2017
Efficient representation of topologically ordered states with restricted Boltzmann machines journal April 2019
Emergent statistical mechanics of entanglement in random unitary circuits journal May 2019
Constructing neural stationary states for open quantum many-body systems journal June 2019
Asymptotically unbiased estimation of physical observables with neural samplers journal February 2020
Measuring Renyi Entanglement Entropy in Quantum Monte Carlo Simulations journal April 2010
Quantum Entanglement in Deep Learning Architectures journal February 2019
Backflow Transformations via Neural Networks for Quantum Many-Body Wave Functions journal June 2019
Variational Quantum Monte Carlo Method with a Neural-Network Ansatz for Open Quantum Systems journal June 2019
Neural-Network Approach to Dissipative Quantum Many-Body Dynamics journal June 2019
Variational Neural-Network Ansatz for Steady States in Open Quantum Systems journal June 2019
Restricted Boltzmann Machines for Quantum States with Non-Abelian or Anyonic Symmetries journal March 2020
Quantum Many-Body Dynamics in Two Dimensions with Artificial Neural Networks journal September 2020
Estimation of Thermodynamic Observables in Lattice Field Theories with Deep Generative Models journal January 2021
Variational Monte Carlo Calculations of A ≤ 4 Nuclei with an Artificial Neural-Network Correlator Ansatz journal July 2021
Neural Network Representation of Tensor Network and Chiral States journal October 2021
Average entropy of a subsystem journal August 1993
Recurrent neural network wave functions journal June 2020
Ab initio solution of the many-electron Schrödinger equation with deep neural networks journal September 2020
Deep Quantum Geometry of Matrices journal March 2020
Broken-Symmetry Ground States of the Heisenberg Model on the Pyrochlore Lattice journal October 2021
Quantum Entanglement in Neural Network States journal May 2017
Neural-Network Quantum States, String-Bond States, and Chiral Topological States journal January 2018
Solving the quantum many-body problem with artificial neural networks journal February 2017
Any Target Function Exists in a Neighborhood of Any Sufficiently Wide Random Network: A Geometrical Perspective journal August 2020

Similar Records

When and why PINNs fail to train: A neural tangent kernel perspective
Journal Article · Sun Oct 10 20:00:00 EDT 2021 · Journal of Computational Physics · OSTI ID:1977272

Entanglement features of random neural network quantum states
Journal Article · Wed Sep 21 20:00:00 EDT 2022 · Physical Review. B · OSTI ID:1979815

Feature learning and generalization in deep networks with orthogonal weights
Journal Article · Wed Aug 06 20:00:00 EDT 2025 · Machine Learning: Science and Technology · OSTI ID:2575064