skip to main content

DOE PAGESDOE PAGES

Title: Assessing the Effects of Data Compression in Simulations Using Physically Motivated Metrics

This paper examines whether lossy compression can be used effectively in physics simulations as a possible strategy to combat the expected data-movement bottleneck in future high performance computing architectures. We show that, for the codes and simulations we tested, compression levels of 3–5X can be applied without causing significant changes to important physical quantities. Rather than applying signal processing error metrics, we utilize physics-based metrics appropriate for each code to assess the impact of compression. We evaluate three different simulation codes: a Lagrangian shock-hydrodynamics code, an Eulerian higher-order hydrodynamics turbulence modeling code, and an Eulerian coupled laser-plasma interaction code. We compress relevant quantities after each time-step to approximate the effects of tightly coupled compression and study the compression rates to estimate memory and disk-bandwidth reduction. We find that the error characteristics of compression algorithms must be carefully considered in the context of the underlying physics being modeled.
Authors:
 [1] ;  [1] ;  [1] ;  [1] ;  [2]
  1. Lawrence Livermore Lab, Livermore, CA, USA
  2. Samplify, Campbell, CA, USA
Publication Date:
OSTI Identifier:
1198063
Grant/Contract Number:
AC52-07NA27344
Type:
Published Article
Journal Name:
Scientific Programming
Additional Journal Information:
Journal Volume: 22; Journal Issue: 2; Related Information: CHORUS Timestamp: 2016-08-23 11:02:41; Journal ID: ISSN 1058-9244
Publisher:
Hindawi Publishing Corporation
Sponsoring Org:
USDOE
Country of Publication:
Egypt
Language:
English