Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Performance Characterization of a Hierarchical MPI Implementations on Large-scale Distributed-memory Platforms

Conference ·
OSTI ID:1024230
The building blocks of emerging Petascale massively parallel processing (MPP) systems are multi-core processors with four or more cores as a single processing element and a customized network interface. The resulting memory and communication hierarchy of these platforms are now exposed to application developers and end users by creating a hierarchical or multi-core aware message-passing (MPI) programming interface and by providing a handful of runtime, tunable parameters that allows mapping and control of MPI tasks and message handling. We characterize performance of MPI communication patterns and present strategies for optimizing applications performance on Cray XT series systems that are composed of contemporary AMD processors and a proprietary network infrastructure. We highlight dependencies in its memory and network subsystems, which could influence production-level applications performance. We demonstrate that MPI micro-benchmarks could mislead an application developer or end user since these benchmarks often do not expose the interplay between memory allocation and usage in the user space, which depends on the number of tasks or cores and workload characteristics. Our studies show performance improvements compared to the default options for our target scientific benchmarks and production-level applications.
Research Organization:
Oak Ridge National Laboratory (ORNL); Center for Computational Sciences
Sponsoring Organization:
SC USDOE - Office of Science (SC)
DOE Contract Number:
AC05-00OR22725
OSTI ID:
1024230
Country of Publication:
United States
Language:
English

Similar Records

Evaluating the Potential of Cray Gemini Interconnect for PGAS Communication Runtime Systems
Conference · Wed Aug 24 00:00:00 EDT 2011 · OSTI ID:1239518

A uGNI-Based Asynchronous Message-driven Runtime System for Cray Supercomputers with Gemini Interconnect
Conference · Sat Dec 31 23:00:00 EST 2011 · OSTI ID:1056922

A uGNI-based Asynchronous Message-driven Runtime System for Cray Supercomputers with Gemini Interconnect
Conference · Thu Aug 16 00:00:00 EDT 2012 · 2012 IEEE 26TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS) · OSTI ID:1567313