skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: In-situ sampling of a large-scale particle simulation for interactive visualization and analysis

Abstract

We propose storing a random sampling of data from large scale particle simulations, such as the Roadrunner Universe MC{sup 3} cosmological simulation, to be used for interactive post-analysis and visualization. Simulation data generation rates will continue to be far greater than storage bandwidth rates and other limiting technologies by many orders of magnitude. This implies that only a very small fraction of data generated by the simulation can ever be stored and subsequently post-analyzed. The limiting technology in this situation is analogous to the problem in many population surveys: there aren't enough human resources to query a large population. To cope with the lack of resources, statistical sampling techniques are used to create a representative data set of a large population. Mirroring that situation, we propose to store a simulation-time random sampling of the particle data to cope with the bOlllenecks and support interactive, exploratory post-analysis. The particle samples are immediately stored in a level-ol-detail format for post-visualization and analysis, which amortizes the cost of post-processing for interactive visualization. Additionally, we incorporate a system for recording and visualizing sample approximation error information for confidence and importance highlighting.

Authors:
 [1];  [1];  [1]
  1. Los Alamos National Laboratory
Publication Date:
Research Org.:
Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1044139
Report Number(s):
LA-UR-10-08211; LA-UR-10-8211
TRN: US201214%%333
DOE Contract Number:  
AC52-06NA25396
Resource Type:
Journal Article
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICAL METHODS AND COMPUTING; APPROXIMATIONS; SAMPLING; SIMULATION; STORAGE

Citation Formats

Woodring, Jonathan L, Ahrens, James P, and Heitmann, Katrin. In-situ sampling of a large-scale particle simulation for interactive visualization and analysis. United States: N. p., 2010. Web.
Woodring, Jonathan L, Ahrens, James P, & Heitmann, Katrin. In-situ sampling of a large-scale particle simulation for interactive visualization and analysis. United States.
Woodring, Jonathan L, Ahrens, James P, and Heitmann, Katrin. 2010. "In-situ sampling of a large-scale particle simulation for interactive visualization and analysis". United States. https://www.osti.gov/servlets/purl/1044139.
@article{osti_1044139,
title = {In-situ sampling of a large-scale particle simulation for interactive visualization and analysis},
author = {Woodring, Jonathan L and Ahrens, James P and Heitmann, Katrin},
abstractNote = {We propose storing a random sampling of data from large scale particle simulations, such as the Roadrunner Universe MC{sup 3} cosmological simulation, to be used for interactive post-analysis and visualization. Simulation data generation rates will continue to be far greater than storage bandwidth rates and other limiting technologies by many orders of magnitude. This implies that only a very small fraction of data generated by the simulation can ever be stored and subsequently post-analyzed. The limiting technology in this situation is analogous to the problem in many population surveys: there aren't enough human resources to query a large population. To cope with the lack of resources, statistical sampling techniques are used to create a representative data set of a large population. Mirroring that situation, we propose to store a simulation-time random sampling of the particle data to cope with the bOlllenecks and support interactive, exploratory post-analysis. The particle samples are immediately stored in a level-ol-detail format for post-visualization and analysis, which amortizes the cost of post-processing for interactive visualization. Additionally, we incorporate a system for recording and visualizing sample approximation error information for confidence and importance highlighting.},
doi = {},
url = {https://www.osti.gov/biblio/1044139}, journal = {},
number = ,
volume = ,
place = {United States},
year = {2010},
month = {12}
}