Evaluating Emulation-based Models of Distributed Computing Systems
- Sandia National Lab. (SNL-NM), Albuquerque, NM (United States). Cyber Initiatives
- Sandia National Lab. (SNL-NM), Albuquerque, NM (United States). Emulytics Initiatives
Emulation-based models of distributed computing systems are collections of virtual ma- chines, virtual networks, and other emulation components configured to stand in for oper- ational systems when performing experimental science, training, analysis of design alterna- tives, test and evaluation, or idea generation. As with any tool, we should carefully evaluate whether our uses of emulation-based models are appropriate and justified. Otherwise, we run the risk of using a model incorrectly and creating meaningless results. The variety of uses of emulation-based models each have their own goals and deserve thoughtful evaluation. In this paper, we enumerate some of these uses and describe approaches that one can take to build an evidence-based case that a use of an emulation-based model is credible. Predictive uses of emulation-based models, where we expect a model to tell us something true about the real world, set the bar especially high and the principal evaluation method, called validation , is comensurately rigorous. We spend the majority of our time describing and demonstrating the validation of a simple predictive model using a well-established methodology inherited from decades of development in the compuational science and engineering community.
- Research Organization:
- Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
- Sponsoring Organization:
- USDOE National Nuclear Security Administration (NNSA)
- DOE Contract Number:
- AC04-94AL85000
- OSTI ID:
- 1398865
- Report Number(s):
- SAND-2017-10634; 657469
- Country of Publication:
- United States
- Language:
- English
Similar Records
Simulation and Emulation of X-Ray Diffraction from Dynamic Compression Experiments
Prometheus: Scalable and Accurate Emulation of Task-Based Applications on Many-Core Systems.