MiniApps derived from production HPC applications using multiple programing models

doi:https://doi.org/10.1177/1094342016668241

Title: MiniApps derived from production HPC applications using multiple programing models

Abstract

Here, we have developed a set of reduced, proxy applications (“MiniApps”) based on large-scale application codes supported at the Oak Ridge Leadership Computing Facility (OLCF). The MiniApps are designed to encapsulate the details of the most important (i.e. the most time-consuming and/or unique) facets of the applications that run in production mode on the OLCF. In each case, we have produced or plan to produce individual versions of the MiniApps using different specific programing models (e.g., OpenACC, CUDA, OpenMP). We describe some of our initial observations regarding these different implementations along with estimates of how closely the MiniApps track the actual performance characteristics (in particular, the overall scalability) of the large-scale applications from which they are derived.

Authors:

^[1];

^[1]

Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)

Publication Date:: 2016-09-18

Research Org.:: Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)

Sponsoring Org.:: USDOE Office of Science (SC)

OSTI Identifier:: 1461070

Grant/Contract Number:: AC05-00OR22725

Resource Type:: Journal Article: Accepted Manuscript

Journal Name:: International Journal of High Performance Computing Applications

Additional Journal Information:: Journal Volume: 32; Journal Issue: 4; Journal ID: ISSN 1094-3420

Publisher:: SAGE

Country of Publication:: United States

Language:: English

Subject:: 97 MATHEMATICS AND COMPUTING

Citation Formats


                    Messer, O. E. Bronson, D'Azevedo, Ed F., Hill, Judy C., Joubert, Wayne, Berrill, Mark A., and Zimmer, Christopher J. MiniApps derived from production HPC applications using multiple programing models.  United States: N. p., 2016. 
        Web.  doi:10.1177/1094342016668241.

Copy to clipboard


                    Messer, O. E. Bronson, D'Azevedo, Ed F., Hill, Judy C., Joubert, Wayne, Berrill, Mark A., & Zimmer, Christopher J. MiniApps derived from production HPC applications using multiple programing models.  United States.  https://doi.org/10.1177/1094342016668241

Copy to clipboard


                    Messer, O. E. Bronson, D'Azevedo, Ed F., Hill, Judy C., Joubert, Wayne, Berrill, Mark A., and Zimmer, Christopher J. Sun .  
        "MiniApps derived from production HPC applications using multiple programing models".  United States.  https://doi.org/10.1177/1094342016668241.  https://www.osti.gov/servlets/purl/1461070.

Copy to clipboard


                    
@article{osti_1461070,

  title        = {MiniApps derived from production HPC applications using multiple programing models},

  author       = {Messer, O. E. Bronson and D'Azevedo, Ed F. and Hill, Judy C. and Joubert, Wayne and Berrill, Mark A. and Zimmer, Christopher J.},

  abstractNote = {Here, we have developed a set of reduced, proxy applications (“MiniApps”) based on large-scale application codes supported at the Oak Ridge Leadership Computing Facility (OLCF). The MiniApps are designed to encapsulate the details of the most important (i.e. the most time-consuming and/or unique) facets of the applications that run in production mode on the OLCF. In each case, we have produced or plan to produce individual versions of the MiniApps using different specific programing models (e.g., OpenACC, CUDA, OpenMP). We describe some of our initial observations regarding these different implementations along with estimates of how closely the MiniApps track the actual performance characteristics (in particular, the overall scalability) of the large-scale applications from which they are derived.},

  doi          = {10.1177/1094342016668241},

  url          = {https://www.osti.gov/biblio/1461070},
  journal      = {International Journal of High Performance Computing Applications},

  issn         = {1094-3420},

  number       = 4,

  volume       = 32,

  place        = {United States},

  year         = {2016},

  month        = {9}

}

Copy to clipboard

Journal Article:

Free Publicly Available Full Text

Accepted Manuscript (DOE)

Publisher's Version of Record

https://doi.org/10.1177/1094342016668241

Other availability

Search WorldCat to find libraries that may hold this journal

Save / Share:

Export Metadata

Save to My Library

Works referenced in this record:

Multidimensional, multiphysics simulations of core—collapse supernovae
journal, July 2008

Messer, O. E. B.; Bruenn, S. W.; Blondin, J. M.
Journal of Physics: Conference Series, Vol. 125
https://doi.org/10.1088/1742-6596/125/1/012010

The Gemini System Interconnect
conference, August 2010

Alverson, Robert; Roweth, Duncan; Kaplan, Larry
2010 IEEE 18th Annual Symposium on High-Performance Interconnects (HOTI), 2010 18th IEEE Symposium on High Performance Interconnects
https://doi.org/10.1109/HOTI.2010.23

Analysis of topology-dependent MPI performance on Gemini networks
conference, January 2013

Peña, Antonio J.; Carvalho, Ralf G. Correa; Dinan, James
Proceedings of the 20th European MPI Users' Group Meeting on - EuroMPI '13
https://doi.org/10.1145/2488551.2488564

The Nas Parallel Benchmarks
journal, September 1991

Bailey, D. H.; Barszcz, E.; Barton, J. T.
The International Journal of Supercomputing Applications, Vol. 5, Issue 3
https://doi.org/10.1177/109434209100500306

Denovo: A New Three-Dimensional Parallel Discrete Ordinates Code in SCALE
journal, August 2010

Evans, Thomas M.; Stafford, Alissa S.; Slaybaugh, Rachel N.
Nuclear Technology, Vol. 171, Issue 2
https://doi.org/10.13182/NT171-171

Advances in full-wave modeling of radio frequency heated, multidimensional plasmas
journal, May 2002

Jaeger, E. F.; Berry, L. A.; D’Azevedo, E.
Physics of Plasmas, Vol. 9, Issue 5
https://doi.org/10.1063/1.1455001

Parallel out-of-core cholesky and QR factorizations with POOCLAPACK
conference, January 2001

Gunter, B. C.; Reiley, W. C.; van de Geijn, R. A.
IEEE International Symposium on Parallel and Distributed Processing, Proceedings 15th International Parallel and Distributed Processing Symposium. IPDPS 2001
https://doi.org/10.1109/IPDPS.2001.925180

Poster: mini-applications: vehicles for co-design
conference, January 2011

Barrett, Richard F.; Heroux, Michael A.; Lin, Paul T.
Proceedings of the 2011 companion on High Performance Computing Networking, Storage and Analysis Companion - SC '11 Companion
https://doi.org/10.1145/2148600.2148602

The design and implementation of the parallel out-of-core ScaLAPACK LU, QR, and Cholesky factorization routines
journal, December 2000

D'Azevedo, Eduardo; Dongarra, Jack
Concurrency: Practice and Experience, Vol. 12, Issue 15
https://doi.org/10.1002/1096-9128(20001225)12:15<1481::AID-CPE540>3.0.CO;2-V

High performance radiation transport simulations: Preparing for TITAN
conference, November 2012

Baker, C.; Davidson, G.; Evans, T. M.
2012 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis
https://doi.org/10.1109/SC.2012.64

Hardware-independent application characterization
conference, September 2013

Pakin, Scott; McCormick, Patrick
2013 IEEE International Symposium on Workload Characterization (IISWC)
https://doi.org/10.1109/IISWC.2013.6704676

Phase-coherent, injection-seeded, table-top soft-X-ray lasers at 18.9 nm and 13.9 nm
journal, January 2008

Wang, Y.; Granados, E.; Pedaci, F.
Nature Photonics, Vol. 2, Issue 2
https://doi.org/10.1038/nphoton.2007.280

Similar records in OSTI.GOV collections:

Developing MiniApps on Modern Platforms Using Multiple Programming Models, In: 2015 IEEE International Conference on Cluster Computing

Conference Messer, O.E.B. ; DAzevedo, E. ; Hill, J. ; ... - 2015 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING - CLUSTER 2015

We have developed a set of reduced, proxy applications ("MiniApps") based on large-scale application codes supported at the Oak Ridge Leadership Computing Facility (OLCF). The MiniApps are designed to encapsulate the details of the most important (i.e. the most time-consuming and/or unique) facets of the applications that run in production mode on the OLCF. In each case, we have produced or plan to produce individual versions of the MiniApps using different specific programming models (e.g., OpenACC, CUDA, OpenMP). We describe some of our initial observations regarding these different implementations along with estimates of how closely the MiniApps track the actualmore »« less
https://doi.org/10.1109/CLUSTER.2015.130
GUIDE: a scalable information directory service to collect, federate, and analyze logs for operational insights into a leadership HPC facility

Conference Vazhkudai, Sudharshan S. ; Miller, Ross ; Tiwari, Devesh ; ...

In this paper, we describe the GUIDE framework used to collect, federate, and analyze log data from the Oak Ridge Leadership Computing Facility (OLCF), and how we use that data to derive insights into facility operations. We collect system logs and extract monitoring data at every level of the various OLCF subsystems, and have developed a suite of pre-processing tools to make the raw data consumable. The cleansed logs are then ingested and federated into a central, scalable data warehouse, Splunk, that offers storage, indexing, querying, and visualization capabilities. We have further developed and deployed a set of tools tomore »« less
https://doi.org/10.1145/3126908.3126946
Multicore and Accelerator Development for a Leadership-Class Stellar Astrophysics Code

Conference Messer, Bronson ; Harris, James A ; Parete-Koon, Suzanne T ; ...

We describe recent development work on the core-collapse supernova code CHIMERA. CHIMERA has consumed more than 100 million cpu-hours on Oak Ridge Leadership Computing Facility (OLCF) platforms in the past 3 years, ranking it among the most important applications at the OLCF. Most of the work described has been focused on exploiting the multicore nature of the current platform (Jaguar) via, e.g., multithreading using OpenMP. In addition, we have begun a major effort to marshal the computational power of GPUs with CHIMERA. The impending upgrade of Jaguar to Titan a 20+ PF machine with an NVIDIA GPU on many nodesmore » makes this work essential.« less
Multicore and Accelerator Development for a Leadership-Class Stellar Astrophysics Code

Conference Messer, O. E. Bronson ; Harris, J. Austin ; Parete-Koon, Suzanne ; ...

We describe recent development work on the core-collapse supernova code CHIMERA. CHIMERA has consumed more than 100 million cpu-hours on Oak Ridge Leadership Computing Facility (OLCF) platforms in the past 3 years, ranking it among the most important applications at the OLCF (1). Most of the work described has been focused on exploiting the multicore nature of the current platform (Jaguar) via, e.g., multithreading using OpenMP. In addition, we have begun a major effort to marshal the computational power of GPUs with CHIMERA. The impending upgrade of Jaguar to Titan – a 20+ PF machine with an NVIDIA GPU onmore »« less
https://doi.org/10.1007/978-3-642-35893-7_2
BEAM: A computational workflow system for managing and modeling material characterization data in HPC environments

Conference Lingerfelt, Eric J ; Endeve, Eirik ; Ovchinnikov, Oleg S ; ...

Improvements in scientific instrumentation allow imaging at mesoscopic to atomic length scales, many spectroscopic modes, and now with the rise of multimodal acquisition systems and the associated processing capability the era of multidimensional, informationally dense data sets has arrived. Technical issues in these combinatorial scientific fields are exacerbated by computational challenges best summarized as a necessity for drastic improvement in the capability to transfer, store, and analyze large volumes of data. The Bellerophon Environment for Analysis of Materials (BEAM) platform provides material scientists the capability to directly leverage the integrated computational and analytical power of High Performance Computing (HPC) tomore »« less
https://doi.org/10.1016/j.procs.2016.05.410

Full Text Available

Similar Records

Title: MiniApps derived from production HPC applications using multiple programing models

Abstract

Citation Formats

Multidimensional, multiphysics simulations of core—collapse supernovae journal, July 2008

The Gemini System Interconnect conference, August 2010

Analysis of topology-dependent MPI performance on Gemini networks conference, January 2013

The Nas Parallel Benchmarks journal, September 1991

Denovo: A New Three-Dimensional Parallel Discrete Ordinates Code in SCALE journal, August 2010

Advances in full-wave modeling of radio frequency heated, multidimensional plasmas journal, May 2002

Parallel out-of-core cholesky and QR factorizations with POOCLAPACK conference, January 2001

Poster: mini-applications: vehicles for co-design conference, January 2011

The design and implementation of the parallel out-of-core ScaLAPACK LU, QR, and Cholesky factorization routines journal, December 2000

High performance radiation transport simulations: Preparing for TITAN conference, November 2012

Hardware-independent application characterization conference, September 2013

Phase-coherent, injection-seeded, table-top soft-X-ray lasers at 18.9 nm and 13.9 nm journal, January 2008

Multidimensional, multiphysics simulations of core—collapse supernovae
journal, July 2008

The Gemini System Interconnect
conference, August 2010

Analysis of topology-dependent MPI performance on Gemini networks
conference, January 2013

The Nas Parallel Benchmarks
journal, September 1991

Denovo: A New Three-Dimensional Parallel Discrete Ordinates Code in SCALE
journal, August 2010

Advances in full-wave modeling of radio frequency heated, multidimensional plasmas
journal, May 2002

Parallel out-of-core cholesky and QR factorizations with POOCLAPACK
conference, January 2001

Poster: mini-applications: vehicles for co-design
conference, January 2011

The design and implementation of the parallel out-of-core ScaLAPACK LU, QR, and Cholesky factorization routines
journal, December 2000

High performance radiation transport simulations: Preparing for TITAN
conference, November 2012

Hardware-independent application characterization
conference, September 2013

Phase-coherent, injection-seeded, table-top soft-X-ray lasers at 18.9 nm and 13.9 nm
journal, January 2008