Skip to main content
OSTI.GOVU.S. Department of Energy Office of Scientific and Technical Information
U.S. Department of Energy
Office of Scientific and Technical Information
 

Opportunities for Cost Savings with In-Transit Visualization

Conference ·
 [1];  [2];  [1];  [1];  [1];  [1];  [1];  [3];  [1]
  1. ORNL
  2. Lawrence Livermore National Laboratory (LLNL)
  3. University of Oregon
+ Show Author Affiliations
We analyze the opportunities for in-transit visualization to provide cost savings compared to in-line visualization. We begin by developing a cost model that includes factors related to both in-line and in-transit which allows comparisons to be made between the two methods. We then run a series of studies to create a corpus of data for our model. We run two different visualization algorithms, one that is computation heavy and one that is communication heavy with concurrencies up to 32, 768 cores. Our primary results are in exploring the cost model within the context of our corpus. Our findings show that in-transit consistently achieves significant cost efficiencies by running visualization algorithms at lower concurrency, and that in many cases these efficiencies are enough to offset other costs (transfer, blocking, and additional nodes) to be cost effective overall. Finally, this work informs future studies, which can focus on choosing ideal configurations for in-transit processing that can consistently achieve cost efficiencies.
Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
Sponsoring Organization:
USDOE
DOE Contract Number:
AC05-00OR22725
OSTI ID:
1649280
Country of Publication:
United States
Language:
English

References (16)

DataSpaces: an interaction and coordination framework for coupled simulation workflows journal February 2011
The ALPINE In Situ Infrastructure: Ascending from the Ashes of Strawman
  • Larsen, Matthew; Ahrens, James; Ayachit, Utkarsh
  • Proceedings of the In Situ Infrastructures on Enabling Extreme-Scale Analysis and Visualization - ISAV'17 https://doi.org/10.1145/3144769.3144778
conference January 2017
In Situ Visualization at Extreme Scale: Challenges and Opportunities journal November 2009
Optimal Execution of Co-analysis for Large-Scale Molecular Dynamics Simulations
  • Malakar, Preeti; Vishwanath, Venkatram; Knight, Christopher
  • SC16: International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2016.59
conference November 2016
In-situ processing and visualization for ultrascale simulations journal July 2007
In Situ Visualization for Computational Science journal November 2019
VTK-m: Accelerating the Visualization Toolkit for Massively Threaded Architectures journal May 2016
Hello ADIOS: the challenges and lessons of developing leadership class I/O frameworks: HELLO ADIOS journal August 2013
Comparing the Efficiency of In Situ Visualization Paradigms at Scale book January 2019
Evaluation of methods to integrate analysis into a large-scale shock shock physics code conference January 2014
In-memory staging and data-centric task placement for coupled scientific simulation workflows: In-memory staging and data-centric task placement for coupled scientific simulation workflows journal April 2017
Master of Puppets: Cooperative Multitasking for In Situ Processing conference January 2016
Optimal scheduling of in-situ analysis for large-scale scientific simulations
  • Malakar, Preeti; Vishwanath, Venkatram; Munson, Todd
  • Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '15 https://doi.org/10.1145/2807591.2807656
conference January 2015
In Situ Methods, Infrastructures, and Applications on High Performance Computing Platforms journal June 2016
In situ and in-transit analysis of cosmological simulations journal August 2016
Loosely Coupled In Situ Visualization: A Perspective on Why It's Here to Stay
  • Kress, James; Klasky, Scott; Podhorszki, Norbert
  • Proceedings of the First Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization - ISAV2015 https://doi.org/10.1145/2828612.2828623
conference January 2015

Similar Records

Comparing the Efficiency of In Situ Visualization Paradigms at Scale
Conference · Wed May 01 00:00:00 EDT 2019 · OSTI ID:1543212
Parallel Particle Advection Bake-Off for Scientific Visualization Workloads
Conference · Tue Sep 01 00:00:00 EDT 2020 · OSTI ID:1822095
A Pervasive Parallel Processing Framework for Data Visualization and Analysis at Extreme Scale
Technical Report · Tue Jan 31 23:00:00 EST 2017 · OSTI ID:1341896

Related Subjects