Optimizing Scientist Time through In Situ Visualization and Analysis

doi:10.1109/MCG.2018.011461533

Title: Optimizing Scientist Time through In Situ Visualization and Analysis

Abstract

In situ processing produces reduced size persistent representations of a simulations state while the simulation is running. The need for in situ visualization and data analysis is often described in terms of supercomputer size and performance in relation to available storage size.

Authors:

^[1];

^[1]

Los Alamos National Lab. (LANL), Los Alamos, NM (United States)

Publication Date:: 2018-03-08

Research Org.:: Los Alamos National Lab. (LANL), Los Alamos, NM (United States)

Sponsoring Org.:: USDOE National Nuclear Security Administration (NNSA)

Contributing Org.:: Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States); Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States); Univ. of Kaiserslautern (Germany); Kitware Inc., Clifton Park, NY (United States)

OSTI Identifier:: 1463483

Report Number(s):: LA-UR-17-28785
Journal ID: ISSN 0272-1716

Grant/Contract Number:: AC52-06NA25396

Resource Type:: Accepted Manuscript

Journal Name:: IEEE Computer Graphics and Applications

Additional Journal Information:: Journal Volume: 38; Journal Issue: 1; Journal ID: ISSN 0272-1716

Publisher:: IEEE

Country of Publication:: United States

Language:: English

Subject:: 97 MATHEMATICS AND COMPUTING; visualization; in situ; data analysis; lossless compression; feature extraction; scientific computing; data visualization; computational modeling; atmospheric modeling; solar system; supercomputers; data models

Citation Formats


                    Patchett, John, and Ahrens, James. Optimizing Scientist Time through In Situ Visualization and Analysis.  United States: N. p., 2018. 
        Web.  doi:10.1109/MCG.2018.011461533.

Copy to clipboard


                    Patchett, John, & Ahrens, James. Optimizing Scientist Time through In Situ Visualization and Analysis.  United States.  doi:10.1109/MCG.2018.011461533.

Copy to clipboard


                    Patchett, John, and Ahrens, James. Thu .  
        "Optimizing Scientist Time through In Situ Visualization and Analysis".  United States.  doi:10.1109/MCG.2018.011461533.  https://www.osti.gov/servlets/purl/1463483.

Copy to clipboard


                    
@article{osti_1463483,

  title        = {Optimizing Scientist Time through In Situ Visualization and Analysis},

  author       = {Patchett, John and Ahrens, James},

  abstractNote = {In situ processing produces reduced size persistent representations of a simulations state while the simulation is running. The need for in situ visualization and data analysis is often described in terms of supercomputer size and performance in relation to available storage size.},

  doi          = {10.1109/MCG.2018.011461533},

  journal      = {IEEE Computer Graphics and Applications},

  number       = 1,

  volume       = 38,

  place        = {United States},

  year         = {2018},

  month        = {3}

}

Copy to clipboard

Journal Article:

Free Publicly Available Full Text

Accepted Manuscript (DOE)

Publisher's Version of Record

DOI: 10.1109/MCG.2018.011461533

Other availability

Search WorldCat to find libraries that may hold this journal

Figures / Tables:

Figure 1: An image from the Deep Water Impact Ensemble Data Set showing volume fraction of water with a highly customized color map to show structure as the water moves vertically into upper levels of the atmosphere. Water is a potent greenhouse

All figures and tables (5 total)

Save / Share:

Export Metadata

Save to My Library

Figures / Tables found in this record:

Figures/Tables have been extracted from DOE-funded journal article accepted manuscripts.

Similar records in OSTI.GOV collections:

A report documenting the completion of the Los Alamos National Laboratory portion of the ASC level II milestone ""Visualization on the supercomputing platform

Journal Article Ahrens, James P ; Patchett, John M ; Lo, Li - Ta ; ...

This report provides documentation for the completion of the Los Alamos portion of the ASC Level II 'Visualization on the Supercomputing Platform' milestone. This ASC Level II milestone is a joint milestone between Sandia National Laboratory and Los Alamos National Laboratory. The milestone text is shown in Figure 1 with the Los Alamos portions highlighted in boldfaced text. Visualization and analysis of petascale data is limited by several factors which must be addressed as ACES delivers the Cielo platform. Two primary difficulties are: (1) Performance of interactive rendering, which is the most computationally intensive portion of the visualization process. Formore »« less
Full Text Available
Visualization on supercomputing platform level II ASC milestone (3537-1B) results from Sandia.

Technical Report Geveci, Berk ; Fabian, Nathan ; Marion, Patrick ; ...

This report provides documentation for the completion of the Sandia portion of the ASC Level II Visualization on the platform milestone. This ASC Level II milestone is a joint milestone between Sandia National Laboratories and Los Alamos National Laboratories. This milestone contains functionality required for performing visualization directly on a supercomputing platform, which is necessary for peta-scale visualization. Sandia's contribution concerns in-situ visualization, running a visualization in tandem with a solver. Visualization and analysis of petascale data is limited by several factors which must be addressed as ACES delivers the Cielo platform. Two primary difficulties are: (1) Performance of interactivemore »« less
DOI: 10.2172/992321

Full Text Available
WarpIV: In situ visualization and analysis of ion accelerator simulations

Journal Article Rubel, Oliver ; Loring, Burlen ; Vay, Jean -Luc ; ... - IEEE Computer Graphics and Applications

The generation of short pulses of ion beams through the interaction of an intense laser with a plasma sheath offers the possibility of compact and cheaper ion sources for many applications--from fast ignition and radiography of dense targets to hadron therapy and injection into conventional accelerators. To enable the efficient analysis of large-scale, high-fidelity particle accelerator simulations using the Warp simulation suite, the authors introduce the Warp In situ Visualization Toolkit (WarpIV). WarpIV integrates state-of-the-art in situ visualization and analysis using VisIt with Warp, supports management and control of complex in situ visualization and analysis workflows, and implements integrated analyticsmore »« less
DOI: 10.1109/MCG.2016.62

Full Text Available
DynaM: Dynamic Multiresolution Data Representation for Large-Scale Scientific Analysis

Conference Tian, Yuan ; Klasky, Scott ; Yu, Weikuan ; ... - 2013 IEEE Eighth International Conference on Networking, Architecture and Storage: 17-19 July 2013; Xi'an, China

Fast growing large-scale systems enable scientific applications to run at a much larger scale and accordingly produce gigantic volumes of simulation output. Such data imposes a grand challenge to post-processing tasks such as visualization and data analysis, because these tasks are often performed at a host machine that is remotely located and equipped with much less memory and storage resources. During the simulation runs, it is also desirable for scientists to be able to interactively monitor and steer the progress of simulation. This requires scientific data to be represented in an efficient form for initial exploration and computation steering. Inmore »« less
DOI: 10.1109/NAS.2013.21
In-Situ Feature Extraction of Large Scale Combustion Simulations Using Segmented Merge Trees, In: SC '14: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis

Conference Landge, Aaditya G. ; Pascucci, Valerio ; Gyulassy, Attila ; ... - SC14: INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS

The ever increasing amount of data generated by scientific simulations coupled with system I/O constraints are fueling a need for in-situ analysis techniques. Of particular interest are approaches that produce reduced data representations while maintaining the ability to redefine, extract, and study features in a post-process to obtain scientific insights. This paper presents two variants of in-situ feature extraction techniques using segmented merge trees, which encode a wide range of threshold based features. The first approach is a fast, low communication cost technique that generates an exact solution but has limited scalability. The second is a scalable, local approximation thatmore »« less
DOI: 10.1109/SC.2014.88

Similar Records