An implementation and evaluation of the MPI 3.0 one-sided communication interface

Dinan, James S.; Balaji, Pavan; Buntinas, Darius T.; Goodell, David J.; Gropp, William D.; Thakur, Rajeev

doi:10.1002/cpe.3758

An implementation and evaluation of the MPI 3.0 one-sided communication interface

Journal Article · Fri Jan 08 23:00:00 EST 2016 · Concurrency and Computation. Practice and Experience

DOI:https://doi.org/10.1002/cpe.3758· OSTI ID:1346728

^[1]; Balaji, Pavan ^[1]; Buntinas, Darius T. ^[1]; Goodell, David J. ^[1]; Gropp, William D. ^[2]; Thakur, Rajeev ^[1]

Argonne National Lab. (ANL), Lemont, IL (United States)
Univ. of Illinois at Urbana-Champaign, Urbana, IL (United States)

The Q1 Message Passing Interface (MPI) 3.0 standard includes a significant revision to MPI’s remote memory access (RMA) interface, which provides support for one-sided communication. MPI-3 RMA is expected to greatly enhance the usability and performance ofMPI RMA.We present the first complete implementation of MPI-3 RMA and document implementation techniques and performance optimization opportunities enabled by the new interface. Our implementation targets messaging-based networks and is publicly available in the latest release of the MPICH MPI implementation. Here using this implementation, we explore the performance impact of new MPI-3 functionality and semantics. Results indicate that the MPI-3 RMA interface provides significant advantages over the MPI-2 interface by enabling increased communication concurrency through relaxed semantics in the interface and additional routines that provide new window types, synchronization modes, and atomic operations.

View Accepted Manuscript (DOE)

Research Organization:: Argonne National Laboratory (ANL)

Sponsoring Organization:: USDOE Office of Science (SC); Argonne National Laboratory - Argonne Leadership Computing Facility

Grant/Contract Number:: AC02-06CH11357

OSTI ID:: 1346728

Alternate ID(s):: OSTI ID: 1400534

Journal Information:: Concurrency and Computation. Practice and Experience, Journal Name: Concurrency and Computation. Practice and Experience Journal Issue: 17 Vol. 28; ISSN 1532-0626

Publisher:: WileyCopyright Statement

Country of Publication:: United States

Language:: English

References (28)

An Evaluation of Implementation Options for MPI One-Sided Communication Gropp, William; Thakur, Rajeev Recent Advances in Parallel Virtual Machine and Message Passing Interface https://doi.org/10.1007/11557265_53	book	January 2005
Implementing MPI’s One-Sided Communications for WMPI Mourão, Fernando Elson; Silva, João Gabriel Recent Advances in Parallel Virtual Machine and Message Passing Interface https://doi.org/10.1007/3-540-48158-3_29	book	January 1999
Efficient Implementation of MPI-2 Passive One-Sided Communication on InfiniBand Clusters Jiang, Weihang; Liu, Jiuxing; Jin, Hyun-Wook Recent Advances in Parallel Virtual Machine and Message Passing Interface https://doi.org/10.1007/978-3-540-30218-6_16	book	January 2004
Analysis of Implementation Options for MPI-2 One-Sided Barrett, Brian W.; Shipman, Galen M.; Lumsdaine, Andrew Recent Advances in Parallel Virtual Machine and Message Passing Interface https://doi.org/10.1007/978-3-540-75416-9_35	book	January 2007
Revealing the Performance of MPI RMA Implementations Gropp, William D.; Thakur, Rajeev Recent Advances in Parallel Virtual Machine and Message Passing Interface https://doi.org/10.1007/978-3-540-75416-9_38	book	January 2007
PMI: A Scalable Parallel Process-Management Interface for Extreme-Scale Systems Balaji, Pavan; Buntinas, Darius; Goodell, David Recent Advances in the Message Passing Interface https://doi.org/10.1007/978-3-642-15646-5_4	book	January 2010
Leveraging MPI’s One-Sided Communication Interface for Shared-Memory Programming Hoefler, Torsten; Dinan, James; Buntinas, Darius Recent Advances in the Message Passing Interface https://doi.org/10.1007/978-3-642-33518-1_18	book	January 2012
Adaptive Strategy for One-Sided Communication in MPICH2 Zhao, Xin; Santhanaraman, Gopalakrishnan; Gropp, William Recent Advances in the Message Passing Interface https://doi.org/10.1007/978-3-642-33518-1_7	book	January 2012
ARMCI: A portable remote memory copy library for distributed array libraries and compiler run-time systems Nieplocha, Jarek; Carpenter, Bryan Lecture Notes in Computer Science https://doi.org/10.1007/BFb0097937	book	January 1999
Designing truly one-sided MPI-2 RMA intra-node communication on multi-core systems Lai, Ping; Sur, Sayantan; Panda, Dhabaleswar K. Computer Science - Research and Development, Vol. 25, Issue 1-2 https://doi.org/10.1007/s00450-010-0115-3	journal	April 2010
NWChem: A comprehensive and scalable open-source solution for large scale molecular simulations Valiev, M.; Bylaska, E. J.; Govind, N. Computer Physics Communications, Vol. 181, Issue 9, p. 1477-1489 https://doi.org/10.1016/j.cpc.2010.04.018	journal	September 2010
Implementing MPI-IO atomic mode without file system support Ross, R.; Latham, R.; Gropp, W. CCGrid 2005. IEEE International Symposium on Cluster Computing and the Grid, 2005. https://doi.org/10.1109/CCGRID.2005.1558687	conference	January 2005
Exploiting transparent remote memory access for non-contiguous- and one-sided-communication Worringen, J.; Gaer, A.; Reker, F. Proceedings 16th International Parallel and Distributed Processing Symposium. IPDPS 2002 https://doi.org/10.1109/IPDPS.2002.1016562	conference	January 2002
Supporting the Global Arrays PGAS Model Using MPI One-Sided Communication Dinan, James; Balaji, Pavan; Hammond, Jeff R. 2012 IEEE International Symposium on Parallel & Distributed Processing (IPDPS), 2012 IEEE 26th International Parallel and Distributed Processing Symposium https://doi.org/10.1109/IPDPS.2012.72	conference	May 2012
The Implementation of MPI-2 One-Sided Communication for the NEC SX-5 Traff, J. L.; Ritzdorf, H.; Hempel, R. ACM/IEEE SC 2000 Conference (SC'00) https://doi.org/10.1109/SC.2000.10023	conference	January 2000
Scalable Earthquake Simulation on Petascale Supercomputers Cui, Yifeng; Olsen, Kim B.; Jordan, Thomas H. 2010 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2010.45	conference	November 2010
ScalaBLAST: A Scalable Implementation of BLAST for High-Performance Data-Intensive Bioinformatics Analysis Oehmen, C.; Nieplocha, J. IEEE Transactions on Parallel and Distributed Systems, Vol. 17, Issue 8 https://doi.org/10.1109/TPDS.2006.112	journal	August 2006
Algorithms for scalable synchronization on shared-memory multiprocessors Mellor-Crummey, John M.; Scott, Michael L. ACM Transactions on Computer Systems, Vol. 9, Issue 1 https://doi.org/10.1145/103727.103729	journal	February 1991
X10: an object-oriented approach to non-uniform cluster computing Charles, Philippe; Grothoff, Christian; Saraswat, Vijay Proceedings of the 20th annual ACM SIGPLAN conference on Object oriented programming systems languages and applications - OOPSLA '05 https://doi.org/10.1145/1094811.1094852	conference	January 2005
X10: an object-oriented approach to non-uniform cluster computing Charles, Philippe; Grothoff, Christian; Saraswat, Vijay ACM SIGPLAN Notices, Vol. 40, Issue 10 https://doi.org/10.1145/1103845.1094852	journal	October 2005
A new vision for coarray Fortran Mellor-Crummey, John; Adhianto, Laksono; Scherer, William N. Proceedings of the Third Conference on Partitioned Global Address Space Programing Models - PGAS '09 https://doi.org/10.1145/1809961.1809969	conference	January 2009
Co-array Fortran for parallel programming Numrich, Robert W.; Reid, John ACM SIGPLAN Fortran Forum, Vol. 17, Issue 2 https://doi.org/10.1145/289918.289920	journal	August 1998
Optimizing the Synchronization Operations in Message Passing Interface One-Sided Communication Thakur, Rajeev; Gropp, William; Toonen, Brian The International Journal of High Performance Computing Applications, Vol. 19, Issue 2 https://doi.org/10.1177/1094342005054258	journal	May 2005
Advances, Applications and Performance of the Global Arrays Shared Memory Programming Toolkit Nieplocha, Jarek; Palmer, Bruce; Tipparaju, Vinod The International Journal of High Performance Computing Applications, Vol. 20, Issue 2 https://doi.org/10.1177/1094342006064503	journal	May 2006
Implementing MPI-IO Atomic Mode and Shared File Pointers Using MPI One-Sided Communication Latham, Robert; Ross, Robert; Thakur, Rajeev The International Journal of High Performance Computing Applications, Vol. 21, Issue 2 https://doi.org/10.1177/1094342007077859	journal	May 2007
Parallel Programmability and the Chapel Language Chamberlain, B. L.; Callahan, D.; Zima, H. P. The International Journal of High Performance Computing Applications, Vol. 21, Issue 3 https://doi.org/10.1177/1094342007078442	journal	August 2007
Problems with using MPI 1.1 and 2.0 as compilation targets for parallel language implementations Bonachea, Dan; Duell, Jason International Journal of High Performance Computing and Networking, Vol. 1, Issue 1/2/3 https://doi.org/10.1504/IJHPCN.2004.007569	journal	January 2004
Using MPI-2 Gropp, William; Lusk, Ewing; Thakur, Rajeev https://doi.org/10.7551/mitpress/7055.001.0001	book	January 1999

Cited By (4)

Evaluation of parallel programming teaching methodologies: On‐campus versus online methodologies Cantabella, Magdalena; Guillén, Miguel Ángel; López, Belén Computer Applications in Engineering Education, Vol. 28, Issue 2 https://doi.org/10.1002/cae.22187	journal	December 2019
Leveraging MPI RMA to optimize halo‐swapping communications in MONC on Cray machines Brown, Nick; Bareford, Michael; Weiland, Michèle Concurrency and Computation: Practice and Experience https://doi.org/10.1002/cpe.5008	journal	September 2018
WOMBAT: A Scalable and High-performance Astrophysical Magnetohydrodynamics Code Mendygral, P. J.; Radcliffe, N.; Kandalla, K. The Astrophysical Journal Supplement Series, Vol. 228, Issue 2 https://doi.org/10.3847/1538-4365/aa5b9c	journal	February 2017
Leveraging MPI RMA to optimise halo-swapping communications in MONC on Cray machines Brown, Nick; Bareford, Michael; Weiland, Michèle arXiv https://doi.org/10.48550/arxiv.2010.13437	text	January 2020

Similar Records

Implementing One Sided Partitioned Communication in Open MPI

Technical Report · Sun Sep 01 00:00:00 EDT 2024 · OSTI ID:2462981

Users guide for mpich, a portable implementation of MPI

Technical Report · Mon Jul 01 00:00:00 EDT 1996 · OSTI ID:378910

Related Subjects

97 MATHEMATICS AND COMPUTING
MPICH
Message Passing Interface (MPI)
one-sided communication
remote memory access
remote memory access (RMA)

An implementation and evaluation of the MPI 3.0 one-sided communication interface

Citation Formats

References (28)

Cited By (4)

Similar Records

Related Subjects