Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Python-based in situ analysis and visualization

Conference ·
 [1];  [1];  [1];  [1]
  1. Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)

This work focuses on enabling the use of Python-based methods for the purpose of performing in situ analysis and visualization. This approach facilitates access to and use of a rapidly growing collection of Python-based, third-party libraries for analysis and visualization, as well as lowering the barrier to entry for user-written Python analysis codes. Beginning with a simulation code that is instrumented to use the SENSEI in situ interface, we present how to couple it with a Python-based data consumer, which may be run in situ, and in parallel at the same concurrency as the simulation. We present two examples that demonstrate the new capability. One is an analysis of the reaction rate in a proxy simulation of a chemical reaction on a 2D substrate, while the other is a coupling of an AMR simulation to Yt, a parallel visualization and analysis library written in Python. In the examples, both the simulation and Python in situ method run in parallel on a large-scale HPC platform.

Research Organization:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)
DOE Contract Number:
AC02-05CH11231
OSTI ID:
1602814
Country of Publication:
United States
Language:
English

References (6)

The ALPINE In Situ Infrastructure: Ascending from the Ashes of Strawman
  • Larsen, Matthew; Ahrens, James; Ayachit, Utkarsh
  • Proceedings of the In Situ Infrastructures on Enabling Extreme-Scale Analysis and Visualization - ISAV'17 https://doi.org/10.1145/3144769.3144778
conference January 2017
VTK-m: Accelerating the Visualization Toolkit for Massively Threaded Architectures journal May 2016
Hello ADIOS: the challenges and lessons of developing leadership class I/O frameworks: HELLO ADIOS journal August 2013
Scientific Data Analysis and Visualization with Python, VTK, and ParaView conference January 2015
yt: A MULTI-CODE ANALYSIS TOOLKIT FOR ASTROPHYSICAL SIMULATION DATA journal December 2010
Improving the Start-Up Time of Python Applications on Large Scale HPC Systems conference January 2017

Similar Records

Analysis and Visualization of Multi-Scale Astrophysical Simulations using Python and NumPy
Conference · Tue Sep 30 00:00:00 EDT 2008 · OSTI ID:939104

libIS: a lightweight library for flexible in transit visualization
Conference · Sun Nov 11 23:00:00 EST 2018 · ISAV 2018: In Situ Infrastructures for Enabling Extreme-scale Analysis and Visualization · OSTI ID:1608433

In Situ Visualization and Production of Extract Databases
Journal Article · Wed Nov 30 23:00:00 EST 2016 · Supercomputing frontiers and innovations · OSTI ID:1567661

Related Subjects