Simulation of Quantum Many-Body Dynamics with Tensor Processing Units: Floquet Prethermalization
Tensor processing units (TPUs) are specialized hardware accelerators developed by Google to support large-scale machine-learning tasks but they can also be leveraged to accelerate and scale other linear-algebra-intensive computations. In this paper, we demonstrate the usage of TPUs for massively parallel classical simulations of quantum many-body dynamics on long time scales. We apply our methods to study the phenomenon of Floquet prethermalization, i.e., exponentially slow heating in quantum spin chains subject to high-frequency periodic driving. We simulate the dynamics of L = 34 qubits for over 105 Floquet periods, corresponding to circuits with 4 ×1 06 nearest-neighbor two-qubit gates. The circuits simulated have no additional symmetries and represent a pure-state evolution in the full 2L-dimensional Hilbert space. This is achieved by distributing the computation over 128 TPU cores. On that size TPU cluster, we find speed-ups in wall-clock run time of 230 times and 15 times when compared to reference CPU and single-graphics-processing-unit (GPU) simulations, respectively, for shorter-time 30-qubit simulations that can be handled by all three platforms. We study the computational cost of the simulations, as a function of both the number of qubits and the number of TPU cores used, up to our maximum capacity of L = 40 qubits, which requires a “full pod” of 2048 TPU cores with tens of terabytes of memory in total. For these simulations, an eight-TPU-core machine is comparable to a single A100 GPU and thus the full TPU pod is comparable to a machine with hundreds of top-of-the-line GPUs. However, the TPU pod is more energy and cost efficient and readily accessible (via Google Cloud), unlike such large many-GPU configurations. We also study the accumulation of numerical error as a function of circuit depth in very deep circuits. Our work demonstrates that TPUs can offer significant advantages for state-of-the-art simulations of quantum many-body dynamics.
- Research Organization:
- Stanford Univ., CA (United States)
- Sponsoring Organization:
- USDOE Office of Science (SC), Basic Energy Sciences (BES); Sloan Foundation; Packard Foundation
- Grant/Contract Number:
- SC0021111
- OSTI ID:
- 1867298
- Alternate ID(s):
- OSTI ID: 1980379
- Journal Information:
- PRX Quantum, Journal Name: PRX Quantum Vol. 3 Journal Issue: 2; ISSN 2691-3399
- Publisher:
- American Physical SocietyCopyright Statement
- Country of Publication:
- United States
- Language:
- English
Similar Records
Quasi-Floquet Prethermalization in a Disordered Dipolar Spin Ensemble in Diamond
Floquet Prethermalization with Lifetime Exceeding 90 s in a Bulk Hyperpolarized Solid