In Situ Analysis and Visualization of Fusion Simulations: Lessons Learned
Abstract
The trends in high performance computing, where far more data can be computed that can ever be stored, have made in situ techniques an important area of research and development. Simulation campaigns, where domain scientists work with computer scientists to run a simulation and perform in situ analysis and visualization are important, and complex undertakings. In this paper we report our experiences performing in situ analysis and visualization on two campaigns. The two campaigns were related, but had important differences in terms of the codes that were used, the types of analysis and visualization required, and the visualization tools used. Further, we report the lessons learned from each campaign.
- Authors:
-
- ORNL
- University of Oregon
- Kitware
- Argonne National Laboratory (ANL)
- Sandia National Laboratories (SNL)
- Princeton Plasma Physics Laboratory (PPPL)
- Publication Date:
- Research Org.:
- Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
- Sponsoring Org.:
- USDOE Office of Science (SC)
- OSTI Identifier:
- 1557470
- DOE Contract Number:
- AC05-00OR22725
- Resource Type:
- Conference
- Resource Relation:
- Journal Volume: 11203; Conference: Workshop on In Situ Visualization (WOIV) - Frankfurt, , Germany - 6/24/2018 12:00:00 PM-6/28/2018 4:00:00 PM
- Country of Publication:
- United States
- Language:
- English
Citation Formats
Kim, Mark B., Kress, James M., Choi, Jong Youl, Podhorszki, Norbert, Klasky, Scott A., Wolf, Matthew D., Mehta, Kshitij V., Huck, Kevin, Geveci, Berk, Phillip, Sujin, Maynard, Robert, Guo, Hanqi, Peterka, Tom, Moreland, Kenneth, Chang, Choong-Seock, Dominski, Julien, Churchill, Michael, and Pugmire, Dave. In Situ Analysis and Visualization of Fusion Simulations: Lessons Learned. United States: N. p., 2018.
Web. doi:10.1007/978-3-030-02465-9_16.
Kim, Mark B., Kress, James M., Choi, Jong Youl, Podhorszki, Norbert, Klasky, Scott A., Wolf, Matthew D., Mehta, Kshitij V., Huck, Kevin, Geveci, Berk, Phillip, Sujin, Maynard, Robert, Guo, Hanqi, Peterka, Tom, Moreland, Kenneth, Chang, Choong-Seock, Dominski, Julien, Churchill, Michael, & Pugmire, Dave. In Situ Analysis and Visualization of Fusion Simulations: Lessons Learned. United States. https://doi.org/10.1007/978-3-030-02465-9_16
Kim, Mark B., Kress, James M., Choi, Jong Youl, Podhorszki, Norbert, Klasky, Scott A., Wolf, Matthew D., Mehta, Kshitij V., Huck, Kevin, Geveci, Berk, Phillip, Sujin, Maynard, Robert, Guo, Hanqi, Peterka, Tom, Moreland, Kenneth, Chang, Choong-Seock, Dominski, Julien, Churchill, Michael, and Pugmire, Dave. 2018.
"In Situ Analysis and Visualization of Fusion Simulations: Lessons Learned". United States. https://doi.org/10.1007/978-3-030-02465-9_16. https://www.osti.gov/servlets/purl/1557470.
@article{osti_1557470,
title = {In Situ Analysis and Visualization of Fusion Simulations: Lessons Learned},
author = {Kim, Mark B. and Kress, James M. and Choi, Jong Youl and Podhorszki, Norbert and Klasky, Scott A. and Wolf, Matthew D. and Mehta, Kshitij V. and Huck, Kevin and Geveci, Berk and Phillip, Sujin and Maynard, Robert and Guo, Hanqi and Peterka, Tom and Moreland, Kenneth and Chang, Choong-Seock and Dominski, Julien and Churchill, Michael and Pugmire, Dave},
abstractNote = {The trends in high performance computing, where far more data can be computed that can ever be stored, have made in situ techniques an important area of research and development. Simulation campaigns, where domain scientists work with computer scientists to run a simulation and perform in situ analysis and visualization are important, and complex undertakings. In this paper we report our experiences performing in situ analysis and visualization on two campaigns. The two campaigns were related, but had important differences in terms of the codes that were used, the types of analysis and visualization required, and the visualization tools used. Further, we report the lessons learned from each campaign.},
doi = {10.1007/978-3-030-02465-9_16},
url = {https://www.osti.gov/biblio/1557470},
journal = {},
issn = {0302-9743},
number = ,
volume = 11203,
place = {United States},
year = {Fri Jun 01 00:00:00 EDT 2018},
month = {Fri Jun 01 00:00:00 EDT 2018}
}
Works referenced in this record:
The SENSEI Generic In Situ Interface
conference, November 2016
- Ayachit, Utkarsh; Whitlock, Brad; Wolf, Matthew
- 2016 Second Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization (ISAV)
ParaView Catalyst: Enabling In Situ Data Analysis and Visualization
conference, January 2015
- Ayachit, Utkarsh; Bauer, Andrew; Geveci, Berk
- Proceedings of the First Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization - ISAV2015
In Situ Methods, Infrastructures, and Applications on High Performance Computing Platforms
journal, June 2016
- Bauer, A. C.; Abbasi, H.; Ahrens, J.
- Computer Graphics Forum, Vol. 35, Issue 3
Compressed ion temperature gradient turbulence in diverted tokamak edge
journal, May 2009
- Chang, C. S.; Ku, S.; Diamond, P. H.
- Physics of Plasmas, Vol. 16, Issue 5
Flexpath: Type-Based Publish/Subscribe System for Large-Scale Science Analytics
conference, May 2014
- Dayal, Jai; Bratcher, Drew; Eisenhauer, Greg
- 2014 14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid)
Fast Error-Bounded Lossy HPC Data Compression with SZ
conference, May 2016
- Di, Sheng; Cappello, Franck
- 2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS)
DataSpaces: an interaction and coordination framework for coupled simulation workflows
journal, February 2011
- Docan, Ciprian; Parashar, Manish; Klasky, Scott
- Cluster Computing, Vol. 15, Issue 2
A tight-coupling scheme sharing minimum information across a spatial interface between gyrokinetic turbulence codes
journal, July 2018
- Dominski, J.; Ku, S.; Chang, C. -S.
- Physics of Plasmas, Vol. 25, Issue 7
The global version of the gyrokinetic turbulence code GENE
journal, August 2011
- Görler, T.; Lapillonne, X.; Brunner, S.
- Journal of Computational Physics, Vol. 230, Issue 18
Hello ADIOS: the challenges and lessons of developing leadership class I/O frameworks: HELLO ADIOS
journal, August 2013
- Liu, Qing; Logan, Jeremy; Tian, Yuan
- Concurrency and Computation: Practice and Experience, Vol. 26, Issue 7
VTK-m: Accelerating the Visualization Toolkit for Massively Threaded Architectures
journal, May 2016
- Moreland, Kenneth; Sewell, Christopher; Usher, William
- IEEE Computer Graphics and Applications, Vol. 36, Issue 3
SCIRun: a scientific programming environment for computational steering
conference, January 1995
- Parker, Steven G.; Johnson, Christopher R.
- Proceedings of the 1995 ACM/IEEE conference on Supercomputing (CDROM) - Supercomputing '95
The Tau Parallel Performance System
journal, May 2006
- Shende, Sameer S.; Malony, Allen D.
- The International Journal of High Performance Computing Applications, Vol. 20, Issue 2
Z-checker: A framework for assessing lossy compression of scientific data
journal, November 2017
- Tao, Dingwen; Di, Sheng; Guo, Hanqi
- The International Journal of High Performance Computing Applications, Vol. 33, Issue 2
ADIOS Visualization Schema: A First Step Towards Improving Interdisciplinary Collaboration in High Performance Computing
conference, October 2013
- Tchoua, Roselyne; Choi, Jong; Klasky, Scott
- 2013 IEEE 9th International Conference on eScience (eScience), 2013 IEEE 9th International Conference on e-Science
In-memory staging and data-centric task placement for coupled scientific simulation workflows: In-memory staging and data-centric task placement for coupled scientific simulation workflows
journal, April 2017
- Zhang, Fan; Jin, Tong; Sun, Qian
- Concurrency and Computation: Practice and Experience, Vol. 29, Issue 12