Cooperative Server Clustering for a Scalable GAS Model on Petascale Cray XT5 Systems

Conference · Sat May 01 04:00:00 EDT 2010

OSTI ID:981439

Yu, Weikuan ^[1]; Que, Xinyu ^[1]; Tipparaju, Vinod ^[1]; Graham, Richard L ^[1]; Vetter, Jeffrey S ^[1]

---

1. ORNL

Global Address Space (GAS) programming models are attractive because they retain the easy-to-use addressing model that is the characteristic of shared-memory style load and store operations. The scalability of GAS models depends directly on the design and implementation of runtime libraries on the targeted platforms. In this paper, we examine the memory requirement of a popular GAS run-time library, Aggregate Remote Memory Copy Interface (ARMCI) on petascale Cray XT 5 systems. Then we describe a new technique, cooperative server clustering, that enhances the memory scalability of ARMCI communication servers. In cooperative server clustering, ARMCI servers are organized into clusters, and cooperatively process incoming communication requests among them. A request intervention scheme is also designed to expedite the return of responses to the initiating processes. Our experimental results demonstrate that, with very little impact on ARMCI communication latency and bandwidth, cooperative server clustering is able to significantly reduce the memory requirement of ARMCI communication servers, thereby enabling highly scalable scientific applications. In particular, it dramatically reduces the total execution time of a scientific application, NWChem, by 45% on 2400 processes.

• Research Organization: Oak Ridge National Laboratory (ORNL); Center for Computational Sciences
• Sponsoring Organization: SC USDOE - Office of Science (SC)
• DOE Contract Number: AC05-00OR22725
• OSTI ID: 981439
• Country of Publication: United States
• Language: English

Related Subjects

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION
ADMINISTRATIVE PROCEDURES
COMMERCIAL BUILDINGS
COMMUNICATIONS
COOPERATIVES
DESIGN
IMPLEMENTATION
INTERFACES
LIBRARIES
MEETINGS
PROGRAMMING