Combining Phase Identification and Statistic Modeling for Automated Parallel Benchmark Generation
- North Carolina State University (NCSU), Raleigh
- ORNL
Parallel application benchmarks are indispensable for evaluating/optimizing HPC software and hardware. However, it is very challenging and costly to obtain high-fidelity benchmarks reflecting the scale and complexity of state-of-the-art parallel applications. Hand-extracted synthetic benchmarks are time-and labor-intensive to create. Real applications themselves, while offering most accurate performance evaluation, are expensive to compile, port, reconfigure, and often plainly inaccessible due to security or ownership concerns. This work contributes APPRIME, a novel tool for trace-based automatic parallel benchmark generation. Taking as input standard communication-I/O traces of an application's execution, it couples accurate automatic phase identification with statistical regeneration of event parameters to create compact, portable, and to some degree reconfigurable parallel application benchmarks. Experiments with four NAS Parallel Benchmarks (NPB) and three real scientific simulation codes confirm the fidelity of APPRIME benchmarks. They retain the original applications' performance characteristics, in particular the relative performance across platforms.
- Research Organization:
- Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
- Sponsoring Organization:
- USDOE Office of Science (SC)
- DOE Contract Number:
- AC05-00OR22725
- OSTI ID:
- 1311257
- Resource Relation:
- Journal Volume: 50; Journal Issue: 8; Conference: PPoPP 2015 Proceedings of the 20th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, San Francisco, CA, USA, 20150207, 20150211
- Country of Publication:
- United States
- Language:
- English
The Nas Parallel Benchmarks
|
journal | September 1991 |
Automatic generation of benchmark and test workloads
|
conference | January 2010 |
ScalaBenchGen: Auto-Generation of Communication Benchmarks Traces
|
conference | May 2012 |
ScalaExtrap: trace-based communication extrapolation for spmd programs
|
conference | January 2011 |
Logicalization of communication traces from parallel execution
|
conference | October 2009 |
Similar Records
Enabling parallel simulation of large-scale HPC network systems
The NAS Parallel Benchmarks