Abstract
Emerging HPC machines have given rise to enhanced compute power that far outstrips the machine's ability to save large scale results for post-processing. To combat this, in situ data analysis techniques are slowly being adopted. With in situ data management favoring workflows composed of multiple simulations and analyses connected in transit on heterogeneous machines, scientists and engineers need a tool that enables them to create data extracts, visualizations, and interactively monitor and steer their simulations. Scoreboard Phase II is a next generation analysis software that supports composite in transit workflows on heterogeneous architectures and restores interactivity to in situ data analysis through simulation monitoring and computational steering. Scoreboard provides a simulation dashboard with graphs of metrics over time, controls for setting custom simulation steering parameters, controls for managing the set of data extracts being produced in the simulation, as well as the ability to explore data extracts, all from a web browser. Realizing the vision outlined in this project required research into making a system that integrates end to end from simulations all the way to the user. In situ tools generally suffer from complexity and excessive software dependencies. Scoreboard, by contrast, is easy to build and integrate into simulation
More>>
- Developers:
-
[1]
;
Laganella, Chris
[1]
;
Sanderson, Allen
[2]
;
Burklund, Mike
[1]
;
Lawrence, Seth
- Intelligent Light
- University of Utah
- Release Date:
- 2021-09-23
- Project Type:
- Closed Source
- Software Type:
- Scientific
- Programming Languages:
-
Julia
C++
Fortran
Python
Python
- Sponsoring Org.:
-
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)Primary Award/Contract Number:SC0018633
- Code ID:
- 64348
- Research Org.:
- Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)
- Country of Origin:
- United States
Citation Formats
Whitlock, Brad J., Laganella, Chris, Sanderson, Allen R., Burklund, Mike, and Lawrence, Seth.
Scoreboard.
Computer Software.
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR).
23 Sep. 2021.
Web.
doi:10.11578/dc.20210923.1.
Whitlock, Brad J., Laganella, Chris, Sanderson, Allen R., Burklund, Mike, & Lawrence, Seth.
(2021, September 23).
Scoreboard.
[Computer software].
https://doi.org/10.11578/dc.20210923.1.
Whitlock, Brad J., Laganella, Chris, Sanderson, Allen R., Burklund, Mike, and Lawrence, Seth.
"Scoreboard." Computer software.
September 23, 2021.
https://doi.org/10.11578/dc.20210923.1.
@misc{
doecode_64348,
title = {Scoreboard},
author = {Whitlock, Brad J. and Laganella, Chris and Sanderson, Allen R. and Burklund, Mike and Lawrence, Seth},
abstractNote = {Emerging HPC machines have given rise to enhanced compute power that far outstrips the machine's ability to save large scale results for post-processing. To combat this, in situ data analysis techniques are slowly being adopted. With in situ data management favoring workflows composed of multiple simulations and analyses connected in transit on heterogeneous machines, scientists and engineers need a tool that enables them to create data extracts, visualizations, and interactively monitor and steer their simulations. Scoreboard Phase II is a next generation analysis software that supports composite in transit workflows on heterogeneous architectures and restores interactivity to in situ data analysis through simulation monitoring and computational steering. Scoreboard provides a simulation dashboard with graphs of metrics over time, controls for setting custom simulation steering parameters, controls for managing the set of data extracts being produced in the simulation, as well as the ability to explore data extracts, all from a web browser. Realizing the vision outlined in this project required research into making a system that integrates end to end from simulations all the way to the user. In situ tools generally suffer from complexity and excessive software dependencies. Scoreboard, by contrast, is easy to build and integrate into simulation codes and it provides first class FORTRAN support. The Scoreboard library is capable of in situ and in transit data analysis that can produce data extracts commonly needed for Computational Fluid Dynamics (CFD) analysis. Simulations can transparently stage data in transit to a Scoreboard Endpoint program, which can accept their data and produce the requested data extracts. This lets simulations return to their work while the Endpoint works on the analysis. Efficiently staging the data at scale was a topic of this research. Scoreboard provides the means to let the user manage data extracts and monitor/steer many simulations from a web browser. This area of the research focused on discovery of in transit network components to expose and control their steering parameters within an interactive browser-based user interface that includes: system topology, gathered metrics, notifications, dynamically-generated steering controls, and exploration of visualization data products.},
doi = {10.11578/dc.20210923.1},
url = {https://doi.org/10.11578/dc.20210923.1},
howpublished = {[Computer Software] \url{https://doi.org/10.11578/dc.20210923.1}},
year = {2021},
month = {sep}
}