ParaView Catalyst: Enabling In Situ Data Analysis and Visualization
Abstract
Computer simulations are growing in sophistication and producing results of ever greater fidelity. This trend has been enabled by advances in numerical methods and increasing computing power. However these advances come with several costs including massive increases in data size, difficulties examining output data, challenges in configuring simulation runs, and difficulty debugging running codes. Interactive visualization tools, like ParaView, have been used for post-processing of simulation results. However, the increasing data sizes, and limited storage and bandwidth make high fidelity post-processing impractical. In situ analysis is recognized as one of the ways to address these challenges. In situ analysis moves some of the post-processing tasks in line with the simulation code thus short circuiting the need to communicate the data between the simulation and analysis via storage. ParaView Catalyst is a data processing and visualization library that enables in situ analysis and visualization. Built on and designed to interoperate with the standard visualization toolkit VTK and the ParaView application, Catalyst enables simulations to intelligently perform analysis, generate relevant output data, and visualize results concurrent with a running simulation. Here, we provide an overview of the Catalyst framework and some of the success stories.
- Authors:
-
- Kitware, Inc., Clifton Park, NY (United States)
- Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
- Publication Date:
- Research Org.:
- Kitware, Inc., Clifton Park, NY (United States)
- Sponsoring Org.:
- USDOE Office of Nuclear Energy (NE); USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR). Scientific Discovery through Advanced Computing (SciDAC)
- OSTI Identifier:
- 1595008
- Grant/Contract Number:
- SC0012037
- Resource Type:
- Accepted Manuscript
- Journal Name:
- ISAV2015: Proceedings of the First Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization
- Additional Journal Information:
- Journal Volume: 2015; Conference: 27. International Conference for High Performance Computing, Networking, Storage and Analysis, Austin, TX (United States), 15-20 Nov 2018
- Publisher:
- Association for Computing Machinery
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING
Citation Formats
Ayachit, Utkarsh, Bauer, Andrew, Geveci, Berk, O'Leary, Patrick, Moreland, Kenneth, Fabian, Nathan, and Mauldin, Jeffrey. ParaView Catalyst: Enabling In Situ Data Analysis and Visualization. United States: N. p., 2015.
Web. doi:10.1145/2828612.2828624.
Ayachit, Utkarsh, Bauer, Andrew, Geveci, Berk, O'Leary, Patrick, Moreland, Kenneth, Fabian, Nathan, & Mauldin, Jeffrey. ParaView Catalyst: Enabling In Situ Data Analysis and Visualization. United States. https://doi.org/10.1145/2828612.2828624
Ayachit, Utkarsh, Bauer, Andrew, Geveci, Berk, O'Leary, Patrick, Moreland, Kenneth, Fabian, Nathan, and Mauldin, Jeffrey. Sun .
"ParaView Catalyst: Enabling In Situ Data Analysis and Visualization". United States. https://doi.org/10.1145/2828612.2828624. https://www.osti.gov/servlets/purl/1595008.
@article{osti_1595008,
title = {ParaView Catalyst: Enabling In Situ Data Analysis and Visualization},
author = {Ayachit, Utkarsh and Bauer, Andrew and Geveci, Berk and O'Leary, Patrick and Moreland, Kenneth and Fabian, Nathan and Mauldin, Jeffrey},
abstractNote = {Computer simulations are growing in sophistication and producing results of ever greater fidelity. This trend has been enabled by advances in numerical methods and increasing computing power. However these advances come with several costs including massive increases in data size, difficulties examining output data, challenges in configuring simulation runs, and difficulty debugging running codes. Interactive visualization tools, like ParaView, have been used for post-processing of simulation results. However, the increasing data sizes, and limited storage and bandwidth make high fidelity post-processing impractical. In situ analysis is recognized as one of the ways to address these challenges. In situ analysis moves some of the post-processing tasks in line with the simulation code thus short circuiting the need to communicate the data between the simulation and analysis via storage. ParaView Catalyst is a data processing and visualization library that enables in situ analysis and visualization. Built on and designed to interoperate with the standard visualization toolkit VTK and the ParaView application, Catalyst enables simulations to intelligently perform analysis, generate relevant output data, and visualize results concurrent with a running simulation. Here, we provide an overview of the Catalyst framework and some of the success stories.},
doi = {10.1145/2828612.2828624},
journal = {ISAV2015: Proceedings of the First Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization},
number = ,
volume = 2015,
place = {United States},
year = {Sun Nov 01 00:00:00 EDT 2015},
month = {Sun Nov 01 00:00:00 EDT 2015}
}
Free Publicly Available Full Text
Publisher's Version of Record
Other availability
Search WorldCat to find libraries that may hold this journal
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.
Works referenced in this record:
Scalable Implicit Flow Solver for Realistic Wing Simulations with Flow Control
journal, November 2014
- Rasquin, Michel; Smith, Cameron; Chitale, Kedar
- Computing in Science & Engineering, Vol. 16, Issue 6
In-situ visualization for global hybrid simulations
conference, January 2013
- Karimabadi, H.; Loring, B.; O'Leary, P.
- Proceedings of the Conference on Extreme Science and Engineering Discovery Environment Gateway to Discovery - XSEDE '13
A multi-resolution approach to global ocean modeling
journal, September 2013
- Ringler, Todd; Petersen, Mark; Higdon, Robert L.
- Ocean Modelling, Vol. 69
LANL CSSE L2: Case Study of In Situ Data Analysis in ASC Integrated Codes
report, August 2013
- Patchett, John M.; Ahrens, James P.; Nouanesengsy, Boonthanome
Evaluation of methods to integrate analysis into a large-scale shock shock physics code
conference, January 2014
- Oldfield, Ron A.; Moreland, Kenneth; Fabian, Nathan
- Proceedings of the 28th ACM international conference on Supercomputing - ICS '14
An Image-Based Approach to Extreme Scale in Situ Visualization and Analysis
conference, November 2014
- Ahrens, James; Jourdain, Sebastien; OLeary, Patrick
- SC14: International Conference for High Performance Computing, Networking, Storage and Analysis
Capability Enhancements in Version 3 of the Helios High-Fidelity Rotorcraft Simulation Code
conference, November 2012
- Wissink, Andrew; Jayaraman, Buvaneswari; Datta, Anubhav
- 50th AIAA Aerospace Sciences Meeting including the New Horizons Forum and Aerospace Exposition
ParaView: An End-User Tool for Large-Data Visualization
book, January 2005
- Ahrens, James; Geveci, Berk; Law, Charles
- Visualization Handbook, p. 717-731
The ParaView Coprocessing Library: A scalable, general purpose in situ visualization library
conference, October 2011
- Fabian, Nathan; Moreland, Kenneth; Thompson, David
- 2011 IEEE Symposium on Large Data Analysis and Visualization (LDAV)
Adaptable, metadata rich IO methods for portable high performance IO
conference, May 2009
- Lofstead, Jay; Zheng, Fang; Klasky, Scott
- Distributed Processing (IPDPS), 2009 IEEE International Symposium on Parallel & Distributed Processing
Works referencing / citing this record:
Streaming Live Neuronal Simulation Data into Visualization and Analysis
book, January 2018
- Oehrl, Simon; Müller, Jan; Schnathmeier, Jan
- High Performance Computing
On the Scalability of Data Reduction Techniques in Current and Upcoming HPC Systems from an Application Perspective
text, January 2017
- Huebl, Axel; Widera, Rene; Schmitt, Felix
- arXiv
In-Situ Visualization with Membrane Layer for Movie-Based Visualization
book, June 2019
- Yamamoto, Kohei; Kageyama, Akira; Rodrigues, João M. F.
- Computational Science – ICCS 2019: 19th International Conference, Faro, Portugal, June 12–14, 2019, Proceedings, Part V, p. 588-594
GEYSER: 3D thermo-hydrodynamic reactive transport numerical simulator including porosity and permeability evolution using GPU clusters
journal, September 2019
- Sohrabi, Reza; Omlin, Samuel; Miller, Stephen A.
- Computational Geosciences, Vol. 23, Issue 6
An In-Situ Visualization Approach for the K Computer Using Mesa 3D and KVS
book, January 2019
- Hayashi, Kengo; Sakamoto, Naohisa; Nonaka, Jorji
- High Performance Computing
The ALPINE In Situ Infrastructure: Ascending from the Ashes of Strawman
conference, January 2017
- Larsen, Matthew; Ahrens, James; Ayachit, Utkarsh
- Proceedings of the In Situ Infrastructures on Enabling Extreme-Scale Analysis and Visualization - ISAV'17
In situ visualization and data analysis for turbidity currents simulation
journal, January 2018
- Camata, Jose J.; Silva, Vítor; Valduriez, Patrick
- Computers & Geosciences, Vol. 110
Progressive Wasserstein Barycenters of Persistence Diagrams
journal, January 2019
- Vidal, Jules; Budin, Joseph; Tierny, Julien
- IEEE Transactions on Visualization and Computer Graphics
High-Performance Agent-Based Modeling Applied to Vocal Fold Inflammation and Repair
journal, April 2018
- Seekhao, Nuttiiya; Shung, Caroline; JaJa, Joseph
- Frontiers in Physiology, Vol. 9
Interactive Geometry Modification of High Performance Finite Element Simulations
preprint, January 2020
- Wetterer-Nelson, Corey; Jansen, Kenneth E.; Evans, John A.
- arXiv
Abelian-Higgs cosmic string evolution with multiple GPUs
preprint, January 2020
- Correia, J. R. C. C. C.; Martins, C. J. A. P.
- arXiv
SAVIME: An Array DBMS for Simulation Analysis and ML Models Prediction
journal, February 2021
- L. S. Lustosa, Hermano; C. Silva, Anderson; N. R. da Silva, Daniel
- Journal of Information and Data Management, Vol. 11, Issue 3