TuckerCompressMPI v. 1.0
- Sandia National Laboratories
- Wake Forest University
As parallel computing trends towards the exascale, scientific data produced by high-fidelity simulations are growing increasingly massive. For instance, a simulation on a three-dimensional spatial grid with 512 points per dimension that tracks 64 variables per grid point for 128 time steps yields 8 TB of data. By viewing the data as a dense five-way tensor, we can compute a Tucker decomposition to find inherent low-dimensional multilinear structure, achieving compression ratios of up to 10000 on real-world data sets with negligible loss in accuracy. So that we can operate on such massive data, we present the first-ever distributed-memory parallel implementation for the Tucker decomposition, whose key computations correspond to parallel linear algebra operations, albeit with nonstandard data layouts. Our approach specifies a data distribution for tensors that avoids any tensor data redistribution, either locally or in parallel. This software provides a method for compressing large-scale multiway data.
- Short Name / Acronym:
- TuckerCompressMPI
- Site Accession Number:
- SCR #2148.0; 7258
- Software Type:
- Scientific
- License(s):
- BSD 2-clause "Simplified" License
- Programming Language(s):
- C++; Shell; CMake; MATLAB; Makefile; Python
- Research Organization:
- Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States)
- Sponsoring Organization:
- USDOEPrimary Award/Contract Number:AC04-94AL85000
- DOE Contract Number:
- AC04-94AL85000
- Code ID:
- 45231
- OSTI ID:
- code-45231
- Country of Origin:
- United States
Similar Records
TuckerMPI: A Parallel C++/MPI Software Package for Large-scale Data Compression via the Tucker Tensor Decomposition
Multilinear operators for higher-order decompositions.