Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

TuckerCompressMPI v. 1.0

Software ·
DOI:https://doi.org/10.11578/dc.20201001.6· OSTI ID:code-45231 · Code ID:45231

As parallel computing trends towards the exascale, scientific data produced by high-fidelity simulations are growing increasingly massive. For instance, a simulation on a three-dimensional spatial grid with 512 points per dimension that tracks 64 variables per grid point for 128 time steps yields 8 TB of data. By viewing the data as a dense five-way tensor, we can compute a Tucker decomposition to find inherent low-dimensional multilinear structure, achieving compression ratios of up to 10000 on real-world data sets with negligible loss in accuracy. So that we can operate on such massive data, we present the first-ever distributed-memory parallel implementation for the Tucker decomposition, whose key computations correspond to parallel linear algebra operations, albeit with nonstandard data layouts. Our approach specifies a data distribution for tensors that avoids any tensor data redistribution, either locally or in parallel. This software provides a method for compressing large-scale multiway data.

Short Name / Acronym:
TuckerCompressMPI
Site Accession Number:
SCR #2148.0; 7258
Software Type:
Scientific
License(s):
BSD 2-clause "Simplified" License
Programming Language(s):
C++; Shell; CMake; MATLAB; Makefile; Python
Research Organization:
Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States)
Sponsoring Organization:
USDOE

Primary Award/Contract Number:
AC04-94AL85000
DOE Contract Number:
AC04-94AL85000
Code ID:
45231
OSTI ID:
code-45231
Country of Origin:
United States

Similar Records

Parallel Tensor Compression for Large-Scale Scientific Data.
Technical Report · Thu Oct 01 00:00:00 EDT 2015 · OSTI ID:1226255

TuckerMPI: A Parallel C++/MPI Software Package for Large-scale Data Compression via the Tucker Tensor Decomposition
Journal Article · Thu Jun 11 00:00:00 EDT 2020 · ACM Transactions on Mathematical Software · OSTI ID:1639093

Multilinear operators for higher-order decompositions.
Technical Report · Fri Mar 31 23:00:00 EST 2006 · OSTI ID:923081

Related Subjects