skip to main content

DOE PAGESDOE PAGES

Title: Data Reduction Techniques for Simulation, Visualization and Data Analysis

Data reduction is increasingly being applied to scientific data for numerical simulations, scientific visualizations, and data analyses. It is most often used to lower I/O and storage costs, and sometimes to lower in-memory data size as well. With this work, we consider five categories of data reduction techniques based on their information loss: 1) truly lossless, 2) near lossless, 3) lossy, 4) mesh reduction, and 5) derived representations. We then survey available techniques in each of these categories, summarize their properties from a practical point of view, and discuss relative merits within a category. We believe, in total, this work will enable simulation scientists and visualization/data analysis scientists to decide which data reduction techniques will be most helpful for their needs.
Authors:
ORCiD logo [1] ;  [2] ;  [3] ;  [4] ;  [5] ;  [2]
  1. National Center for Atmospheric Research, Boulder, CO (United States); Univ. of Oregon, Eugene, OR (United States)
  2. Univ. of Oregon, Eugene, OR (United States)
  3. Univ. of Kaiserslautern, (Germany)
  4. Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
  5. National Center for Atmospheric Research, Boulder, CO (United States)
Publication Date:
Grant/Contract Number:
SC0010652
Type:
Accepted Manuscript
Journal Name:
Computer Graphics Forum
Additional Journal Information:
Journal Volume: 37; Journal Issue: 6; Journal ID: ISSN 0167-7055
Publisher:
Wiley
Research Org:
Univ. of Oregon, Eugene, OR (United States); Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Sponsoring Org:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; data reduction techniques; simulation; data analysis; survey
OSTI Identifier:
1463451

Li, Shaomeng, Marsaglia, Nicole, Garth, Christoph, Woodring, Jonathan, Clyne, John, and Childs, Hank. Data Reduction Techniques for Simulation, Visualization and Data Analysis. United States: N. p., Web. doi:10.1111/cgf.13336.
Li, Shaomeng, Marsaglia, Nicole, Garth, Christoph, Woodring, Jonathan, Clyne, John, & Childs, Hank. Data Reduction Techniques for Simulation, Visualization and Data Analysis. United States. doi:10.1111/cgf.13336.
Li, Shaomeng, Marsaglia, Nicole, Garth, Christoph, Woodring, Jonathan, Clyne, John, and Childs, Hank. 2018. "Data Reduction Techniques for Simulation, Visualization and Data Analysis". United States. doi:10.1111/cgf.13336. https://www.osti.gov/servlets/purl/1463451.
@article{osti_1463451,
title = {Data Reduction Techniques for Simulation, Visualization and Data Analysis},
author = {Li, Shaomeng and Marsaglia, Nicole and Garth, Christoph and Woodring, Jonathan and Clyne, John and Childs, Hank},
abstractNote = {Data reduction is increasingly being applied to scientific data for numerical simulations, scientific visualizations, and data analyses. It is most often used to lower I/O and storage costs, and sometimes to lower in-memory data size as well. With this work, we consider five categories of data reduction techniques based on their information loss: 1) truly lossless, 2) near lossless, 3) lossy, 4) mesh reduction, and 5) derived representations. We then survey available techniques in each of these categories, summarize their properties from a practical point of view, and discuss relative merits within a category. We believe, in total, this work will enable simulation scientists and visualization/data analysis scientists to decide which data reduction techniques will be most helpful for their needs.},
doi = {10.1111/cgf.13336},
journal = {Computer Graphics Forum},
number = 6,
volume = 37,
place = {United States},
year = {2018},
month = {3}
}