Title: Efficient tree decomposition of high-rank tensors [Efficient decomposition of high-rank tensors]

Journal Article · · Journal of Computational Physics

Tensors are a natural way to express correlations among many physical variables, but storing tensors in a computer naively requires memory which scales exponentially in the rank of the tensor. This is not optimal, as the required memory is actually set not by the rank but by the mutual information amongst the variables in question. Representations such as the tensor tree perform near-optimally when the tree decomposition is chosen to reflect the correlation structure in question, but making such a choice is non-trivial and good heuristics remain highly context-specific. In this work I present two new algorithms for choosing efficient tree decompositions, independent of the physical context of the tensor. The first is a brute-force algorithm which in most cases produces optimal decompositions but is generally impractical for high-rank tensors, as the number of possible choices grows exponentially in rank. Here, the second is a greedy algorithm, and while it is not optimal it performs extremely well in numerical experiments while having runtime which makes it practical even for tensors of very high rank.

Research Organization:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States). National Energy Research Scientific Computing Center (NERSC); Univ. of California, Oakland, CA (United States)
Sponsoring Organization:
USDOE
Grant/Contract Number:
AC02-05CH11231
OSTI ID:
1543563
Journal Information:
Journal of Computational Physics, Journal Name: Journal of Computational Physics Journal Issue: C Vol. 377; ISSN 0021-9991
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English

References (21)

The approximation of one matrix by another of lower rank journal September 1936
A New Scheme for the Tensor Representation journal October 2009
Tensor Networks and Hierarchical Tensors for the Solution of High-Dimensional Partial Differential Equations journal April 2016
Entanglement, tensor networks and black hole horizons journal October 2014
Tensor Network States and Geometry journal June 2011
A practical introduction to tensor networks: Matrix product states and projected entangled pair states journal October 2014
Black box approximation of tensors in hierarchical Tucker format journal January 2013
Efficient tree tensor network states (TTNS) for quantum chemistry: Generalizations of the density matrix renormalization group algorithm journal April 2013
Handbook of statistical genetics - 3rd Edn. Volumes 1 and 2 D. J. Balding, M. Bisho, C. Cannings (eds) journal November 2007
Algorithms for tensor network renormalization journal January 2017
Faster identification of optimal contraction sequences for tensor networks journal September 2014
Class of Quantum Many-Body States That Can Be Efficiently Simulated journal September 2008
Second Renormalization of Tensor-Network States journal October 2009
Renormalization Group Flows of Hamiltonians Using Tensor Networks journal June 2017
Matplotlib: A 2D Graphics Environment journal January 2007
The NumPy Array: A Structure for Efficient Numerical Computation journal March 2011
Generating Trees and Other Combinatorial Objects Lexicographically journal February 1979
Simulating Quantum Computation by Contracting Tensor Networks journal January 2008
Tensor Decompositions and Applications journal August 2009
Tree Adaptive Approximation in the Hierarchical Tensor Format journal January 2014
Singular Value Decomposition and Matrix Reorderings in Quantum Information Theory journal September 2011

Cited By (1)

Automatic contraction of unstructured tensor networks journal January 2020