Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

ExaTN: Scalable GPU-Accelerated High-Performance Processing of General Tensor Networks at Exascale

Journal Article · · Frontiers in Applied Mathematics and Statistics

We present ExaTN (Exascale Tensor Networks), a scalable GPU-accelerated C++ library which can express and process tensor networks on shared- as well as distributed-memory high-performance computing platforms, including those equipped with GPU accelerators. Specifically, ExaTN provides the ability to build, transform, and numerically evaluate tensor networks with arbitrary graph structures and complexity. It also provides algorithmic primitives for the optimization of tensor factors inside a given tensor network in order to find an extremum of a chosen tensor network functional, which is one of the key numerical procedures in quantum many-body theory and quantum-inspired machine learning. Numerical primitives exposed by ExaTN provide the foundation for composing rather complex tensor network algorithms. We enumerate multiple application domains which can benefit from the capabilities of our library, including condensed matter physics, quantum chemistry, quantum circuit simulations, as well as quantum and classical machine learning, for some of which we provide preliminary demonstrations and performance benchmarks just to emphasize a broad utility of our library.

Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
Sponsoring Organization:
USDOE; USDOE Laboratory Directed Research and Development (LDRD) Program; USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); USDOE Office of Science (SC), Basic Energy Sciences (BES)
Grant/Contract Number:
AC05-00OR22725
OSTI ID:
2325498
Alternate ID(s):
OSTI ID: 1876320
Journal Information:
Frontiers in Applied Mathematics and Statistics, Journal Name: Frontiers in Applied Mathematics and Statistics Vol. 8; ISSN 2297-4687
Publisher:
Frontiers Media SACopyright Statement
Country of Publication:
Switzerland
Language:
English

References (56)

The density-matrix renormalization group in the age of matrix product states journal January 2011
A practical introduction to tensor networks: Matrix product states and projected entangled pair states journal October 2014
An efficient tensor transpose algorithm for multicore CPU, Intel Xeon Phi, and NVidia Tesla GPU journal April 2015
An Ab Initio Exciton Model Including Charge-Transfer Excited States journal July 2017
Ab Initio Nonadiabatic Dynamics of Multichromophore Complexes: A Scalable Graphical-Processing-Unit-Accelerated Exciton Framework journal July 2014
A flexible high-performance simulator for verifying and benchmarking quantum circuits implemented on real hardware journal October 2019
Quantum supremacy using a programmable superconducting processor journal October 2019
Efficient tree tensor network states (TTNS) for quantum chemistry: Generalizations of the density matrix renormalization group algorithm journal April 2013
Matrix product operators, matrix product states, and ab initio density matrix renormalization group algorithms journal July 2016
Time-dependent density-matrix renormalization-group using adaptive effective Hilbert spaces journal April 2004
Renormalization and tensor product states in spin chains and lattices journal December 2009
XACC: a system-level software infrastructure for heterogeneous quantum–classical computing journal February 2020
Establishing the quantum supremacy frontier with a 281 Pflop/s simulation journal April 2020
Simple heuristics for efficient parallel tensor contraction and quantum circuit simulation journal December 2020
Valence-bond states for quantum computation journal December 2004
Classical simulation of quantum many-body systems with a tree tensor network journal August 2006
Faster identification of optimal contraction sequences for tensor networks journal September 2014
Class of Quantum Many-Body States That Can Be Efficiently Simulated journal September 2008
Tensor Network Renormalization journal October 2015
Quantum Computation of Electronic Transitions Using a Variational Quantum Eigensolver journal June 2019
Density matrix formulation for quantum renormalization groups journal November 1992
Efficient Classical Simulation of Slightly Entangled Quantum Computations journal October 2003
Real-Time Evolution Using the Density Matrix Renormalization Group journal August 2004
Computational Complexity and Fundamental Limitations to Fermionic Quantum Monte Carlo Simulations journal May 2005
Classical Simulation of Infinite-Size Quantum Lattice Systems in One Spatial Dimension journal February 2007
Entanglement Renormalization journal November 2007
Compressing deep neural networks by matrix product operators journal June 2020
Generative machine learning with tensor networks: Benchmarks on near-term quantum computers journal April 2021
What Limits the Simulation of Quantum Computers? journal November 2020
The density-matrix renormalization group journal April 2005
Efficient Quantum Circuits for Accurate State Preparation of Smooth, Differentiable Functions conference October 2020
Multilevel Algorithms for Multi-Constraint Graph Partitioning conference January 1998
Efficient 2D Tensor Network Simulation of Quantum Systems conference November 2020
Distributed-Memory DMRG via Sparse and Dense Parallel Tensor Contractions conference November 2020
Simulating Quantum Computation by Contracting Tensor Networks journal January 2008
Tensor-Train Decomposition journal January 2011
Advances on tensor network theory: symmetries, fermions, entanglement, and holography journal November 2014
Corner Transfer Matrix Renormalization Group Method journal April 1996
Tensor Completion Algorithms in Big Data Analytics journal January 2019
AutoHOOT: Automatic High-Order Optimization for Tensors
  • Ma, Linjian; Ye, Jiayu; Solomonik, Edgar
  • PACT '20: International Conference on Parallel Architectures and Compilation Techniques, Proceedings of the ACM International Conference on Parallel Architectures and Compilation Techniques https://doi.org/10.1145/3410463.3414647
conference September 2020
Validating quantum-classical programming models with tensor network simulations journal December 2018
Tensorized Embedding Layers conference January 2020
quimb: A python package for quantum information and many-body calculations journal September 2018
Efficient classical simulation of noisy random quantum circuits in one dimension journal September 2020
Hyper-optimized tensor network contraction journal March 2021
Tensor Network Quantum Virtual Machine for Simulating Quantum Circuits at Exascale preprint January 2021
NCON: A tensor network contractor for MATLAB preprint January 2014
cuTT: A High-Performance Tensor Transpose Library for CUDA Compatible GPUs preprint January 2017
TensorNetwork: A Library for Physics and Machine Learning preprint January 2019
Number-State Preserving Tensor Networks as Classifiers for Supervised Learning preprint January 2019
TensorTrace: an application to contract tensor networks preprint January 2019
A Multi-Scale Tensor Network Architecture for Classification and Regression preprint January 2020
Entanglement and Tensor Networks for Supervised Image Classification preprint January 2020
The ITensor Software Library for Tensor Network Calculations preprint January 2020
The landscape of software for tensor computations preprint January 2021
Multi-Tensor Contraction for XEB Verification of Quantum Circuits preprint January 2021

Similar Records

ExaTN
Software · Sun Sep 30 20:00:00 EDT 2018 · OSTI ID:code-45739

Tensor Network Quantum Virtual Machine for Simulating Quantum Circuits at Exascale
Journal Article · Thu Oct 20 20:00:00 EDT 2022 · ACM Transactions on Quantum Computing · OSTI ID:2583844