Runtime Techniques to Enable a Highly-Scalable Global Address Space Model for Petascale Computing

Tipparaju, Vinod; Apra, Edoardo; Yu, Weikuan; Que, Xinyu; Vetter, Jeffrey S.

doi:10.1007/s10766-012-0214-9

Runtime Techniques to Enable a Highly-Scalable Global Address Space Model for Petascale Computing

Journal Article · Sun Sep 02 00:00:00 EDT 2012 · International Journal of Parallel Programming

DOI:https://doi.org/10.1007/s10766-012-0214-9· OSTI ID:1564954

Tipparaju, Vinod; Apra, Edoardo; Yu, Weikuan; Que, Xinyu; Vetter, Jeffrey S.

Over the past decade, the trajectory to the petascale has been built on increased complexity and scale of the underlying parallel architectures. Meanwhile, software developers have struggled to provide tools that maintain the productivity of computational science teams using these new systems. In this regard, Global Address Space (GAS) programming models provide a straightforward and easy to use addressing model, which can lead to improved productivity. However, the scalability of GAS depends directly on the design and implementation of the runtime system on the target petascale distributed-memory architecture. In this paper, we describe the design, implementation, and optimization of the Aggregate Remote Memory Copy Interface (ARMCI) runtime library on the Cray XT5 2.3 PetaFLOPs computer at Oak Ridge National Laboratory. We optimized our implementation with the flow intimation technique that we have introduced in this paper. Our optimized ARMCI implementation improves scalability of both the Global Arrays programming model and a real-world chemistry application—NWChem—from small jobs up through 180,000 cores.

Research Organization:: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF); UT-Battelle LLC/ORNL, Oak Ridge, TN (Unted States)

Sponsoring Organization:: USDOE Office of Science

DOE Contract Number:: AC05-00OR22725

OSTI ID:: 1564954

Journal Information:: International Journal of Parallel Programming, Journal Name: International Journal of Parallel Programming Journal Issue: 6 Vol. 40; ISSN 0885-7458

Publisher:: Springer

Country of Publication:: United States

Language:: English

References (20)

Protocols and strategies for optimizing performance of remote memory operations on clusters Nieplocha, J.; Tipparaju, V.; Saify, A. Proceedings 16th International Parallel and Distributed Processing Symposium. IPDPS 2002 https://doi.org/10.1109/IPDPS.2002.1016563	conference	January 2002
Host-assisted zero-copy remote memory access communication on InfiniBand Tipparaju, V.; Santhanaraman, G.; Nieplocha, J. 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings. https://doi.org/10.1109/IPDPS.2004.1302943	conference	January 2004
Advances, Applications and Performance of the Global Arrays Shared Memory Programming Toolkit Nieplocha, Jarek; Palmer, Bruce; Tipparaju, Vinod The International Journal of High Performance Computing Applications, Vol. 20, Issue 2 https://doi.org/10.1177/1094342006064503	journal	May 2006
Scaling communication-intensive applications on BlueGene/P using one-sided communication and overlap Nishtala, Rajesh; Hargrove, Paul H.; Bonachea, Dan O. Distributed Processing (IPDPS), 2009 IEEE International Symposium on Parallel & Distributed Processing https://doi.org/10.1109/IPDPS.2009.5161076	conference	May 2009
A direct coupled cluster algorithm for massively parallel computers Kobayashi, Rika; Rendell, Alistair P. Chemical Physics Letters, Vol. 265, Issue 1-2 https://doi.org/10.1016/S0009-2614(96)01387-5	journal	January 1997
Liquid water: obtaining the right answer for the right reasons Aprà, Edoardo; Rendell, Alistair P.; Harrison, Robert J. Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis - SC '09 https://doi.org/10.1145/1654059.1654127	conference	January 2009
Analysis of Implementation Options for MPI-2 One-Sided Barrett, Brian W.; Shipman, Galen M.; Lumsdaine, Andrew Recent Advances in Parallel Virtual Machine and Message Passing Interface https://doi.org/10.1007/978-3-540-75416-9_35	book	January 2007
Thermodynamic Properties of the C 5 , C 6 , and C 8 n -Alkanes from ab Initio Electronic Structure Theory Pollack, Lisa; Windus, Theresa L.; de Jong, Wibe A. The Journal of Physical Chemistry A, Vol. 109, Issue 31 https://doi.org/10.1021/jp044564r	journal	August 2005
Optimizing strided remote memory access operations on the Quadrics QsNetII network interconnect Nieplocha, J.; Tipparaju, V.; Krishnan, M. Eighth International Conference on High-Performance Computing in Asia-Pacific Region (HPCASIA'05) https://doi.org/10.1109/HPCASIA.2005.62	conference	January 2005
High Performance Remote Memory Access Communication: The Armci Approach Nieplocha, J.; Tipparaju, V.; Krishnan, M. The International Journal of High Performance Computing Applications, Vol. 20, Issue 2 https://doi.org/10.1177/1094342006064504	journal	May 2006
Portals 3.0: protocol building blocks for low overhead communication Brightwell, R.; Riesen, R.; Lawry, B. Proceedings 16th International Parallel and Distributed Processing Symposium. IPDPS 2002 https://doi.org/10.1109/IPDPS.2002.1016564	conference	January 2002
Generalized Portable SHMEM Library for High Performance Computing Parzyszek, Krzysztof https://doi.org/10.2172/816447	report	January 2003
An Evaluation of Two Implementation Strategies for Optimizing One-Sided Atomic Reduction Nieplocha, J.; Tipparaju, V.; Apra, E. 19th IEEE International Parallel and Distributed Processing Symposium https://doi.org/10.1109/IPDPS.2005.96	conference	January 2005
Blue Gene system software---Design and implementation of a one-sided communication interface for the IBM eServer Blue Gene® supercomputer Blocksome, M.; Castaños, J.; Lieber, D. Proceedings of the 2006 ACM/IEEE conference on Supercomputing - SC '06 https://doi.org/10.1145/1188455.1188580	conference	January 2006
Evaluation of Remote Memory Access Communication on the IBM Blue Gene/P Supercomputer Krishnan, Manojkumar; Nieplocha, Jarek; Blocksome, Michael 2008 International Conference on Parallel Processing Workshops (ICPP-W), 2008 International Conference on Parallel Processing - Workshops https://doi.org/10.1109/ICPP-W.2008.34	conference	September 2008
Scalable MPI design over InfiniBand using eXtended Reliable Connection Koop, Matthew J.; Sridhar, Jaidev K.; Panda, Dhabaleswar K. 2008 IEEE International Conference on Cluster Computing (CLUSTER) https://doi.org/10.1109/CLUSTR.2008.4663773	conference	September 2008
Evaluation of Remote Memory Access Communication on the Cray XT3 Tipparaju, V.; Kot, A.; Nieplocha, J. 2007 IEEE International Parallel and Distributed Processing Symposium https://doi.org/10.1109/IPDPS.2007.370478	conference	March 2007
Gaussian basis sets for use in correlated molecular calculations. I. The atoms boron through neon and hydrogen Dunning, Thom H. The Journal of Chemical Physics, Vol. 90, Issue 2 https://doi.org/10.1063/1.456153	journal	January 1989
The deep computing messaging framework: generalized scalable message passing on the blue gene/P supercomputer Kumar, Sameer; Ratterman, Joseph; Smith, Brian Proceedings of the 22nd annual international conference on Supercomputing - ICS '08 https://doi.org/10.1145/1375527.1375544	conference	January 2008
Multi-platform co-array fortran compiler * Dotsenko, Y.; Coarfa, C.; Mellor-Crummey, J. Proceedings. 13th International Conference on Parallel Architecture and Compilation Techniques, 2004. PACT 2004. https://doi.org/10.1109/PACT.2004.1342539	conference	January 2004

Similar Records

Enabling a Highly-Scalable Global Address Space Model for Petascale Computing

Conference · Thu Dec 31 23:00:00 EST 2009 · OSTI ID:979618

Cooperative Server Clustering for a Scalable GAS Model on petascale cray XT5 Systems

Journal Article · Thu Dec 31 23:00:00 EST 2009 · Computer Science - Research and Development · OSTI ID:982405

Cooperative Server Clustering for a Scalable GAS Model on Petascale Cray XT5 Systems

Conference · Sat May 01 00:00:00 EDT 2010 · OSTI ID:981439

Related Subjects

Computer Science

Runtime Techniques to Enable a Highly-Scalable Global Address Space Model for Petascale Computing

Citation Formats

References (20)

Similar Records

Related Subjects