skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: TuckerCompressMPI v. 1.0

Abstract

As parallel computing trends towards the exascale, scientific data produced by high-fidelity simulations are growing increasingly massive. For instance, a simulation on a three-dimensional spatial grid with 512 points per dimension that tracks 64 variables per grid point for 128 time steps yields 8 TB of data. By viewing the data as a dense five-way tensor, we can compute a Tucker decomposition to find inherent low-dimensional multilinear structure, achieving compression ratios of up to 10000 on real-world data sets with negligible loss in accuracy. So that we can operate on such massive data, we present the first-ever distributed-memory parallel implementation for the Tucker decomposition, whose key computations correspond to parallel linear algebra operations, albeit with nonstandard data layouts. Our approach specifies a data distribution for tensors that avoids any tensor data redistribution, either locally or in parallel. This software provides a method for compressing large-scale multiway data.

Authors:
 [1];  [1];  [2];  [1]
  1. Sandia National Laboratories
  2. Wake Forest University
Publication Date:
Research Org.:
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1331972
Report Number(s):
TuckerCompressMPI; 005040WKSTN00
SCR #2148
DOE Contract Number:  
AC04-94AL85000
Resource Type:
Software
Software Revision:
00
Software Package Number:
005040
Software CPU:
WKSTN
Open Source:
Yes
Source Code Available:
No
Other Software Info:
BSD-2 Open Source License
Related Software:
BLAS, LAPACK, MPI
Country of Publication:
United States

Citation Formats

Austin, Woody, Klinvex, Alicia, Ballard, Grey, and Kolda, Tamara G. TuckerCompressMPI v. 1.0. Computer software. https://www.osti.gov//servlets/purl/1331972. Vers. 00. USDOE. 21 Sep. 2016. Web.
Austin, Woody, Klinvex, Alicia, Ballard, Grey, & Kolda, Tamara G. (2016, September 21). TuckerCompressMPI v. 1.0 (Version 00) [Computer software]. https://www.osti.gov//servlets/purl/1331972.
Austin, Woody, Klinvex, Alicia, Ballard, Grey, and Kolda, Tamara G. TuckerCompressMPI v. 1.0. Computer software. Version 00. September 21, 2016. https://www.osti.gov//servlets/purl/1331972.
@misc{osti_1331972,
title = {TuckerCompressMPI v. 1.0, Version 00},
author = {Austin, Woody and Klinvex, Alicia and Ballard, Grey and Kolda, Tamara G.},
abstractNote = {As parallel computing trends towards the exascale, scientific data produced by high-fidelity simulations are growing increasingly massive. For instance, a simulation on a three-dimensional spatial grid with 512 points per dimension that tracks 64 variables per grid point for 128 time steps yields 8 TB of data. By viewing the data as a dense five-way tensor, we can compute a Tucker decomposition to find inherent low-dimensional multilinear structure, achieving compression ratios of up to 10000 on real-world data sets with negligible loss in accuracy. So that we can operate on such massive data, we present the first-ever distributed-memory parallel implementation for the Tucker decomposition, whose key computations correspond to parallel linear algebra operations, albeit with nonstandard data layouts. Our approach specifies a data distribution for tensors that avoids any tensor data redistribution, either locally or in parallel. This software provides a method for compressing large-scale multiway data.},
url = {https://www.osti.gov//servlets/purl/1331972},
doi = {},
year = {Wed Sep 21 00:00:00 EDT 2016},
month = {Wed Sep 21 00:00:00 EDT 2016},
note =
}

Software:
To order this software, request consultation services, or receive further information, please fill out the following request.

Save / Share:

To initiate an order for this software, request consultation services, or receive further information, fill out the request form below. You may also reach us by email at: .

OSTI staff will begin to process an order for scientific and technical software once the payment and signed site license agreement are received. If the forms are not in order, OSTI will contact you. No further action will be taken until all required information and/or payment is received. Orders are usually processed within three to five business days.

Software Request

(required)
(required)
(required)
(required)
(required)
(required)
(required)
(required)