Design and Implementation of Broadcast Algorithms for Extreme-Scale Systems

Conference · Sat Jan 01 04:00:00 EST 2011

OSTI ID:1042820

Shamis, Pavel ^[1]; Graham, Richard L ^[1]; Gorentla Venkata, Manjunath ^[2]; Ladd, Joshua ^[2]

---

1. ORNL
2. Oak Ridge National Laboratory (ORNL)

The scalability and performance of collective communication operations limit the scalability and performance of many scientific applications. This paper presents two new blocking and nonblocking Broadcast algorithms for communicators with arbitrary communication topology, and studies their performance. These algorithms benefit from increased concurrency and a reduced memory footprint, making them suitable for use on large-scale systems. Measuring small, medium, and large data Broadcasts on a Cray-XT5, using 24,576 MPI processes, the Cheetah algorithms outperform the native MPI on that system by 51%, 69%, and 9%, respectively, at the same process count. These results demonstrate an algorithmic approach to the implementation of the important class of collective communications, which is high performing, scalable, and also uses resources in a scalable manner.

• Research Organization: Oak Ridge National Laboratory (ORNL)
• Sponsoring Organization: SC USDOE - Office of Science (SC)
• DOE Contract Number: AC05-00OR22725
• OSTI ID: 1042820
• Country of Publication: United States
• Language: English

Related Subjects

99 GENERAL AND MISCELLANEOUS
ALGORITHMS
COMMUNICATIONS
DESIGN
IMPLEMENTATION
PERFORMANCE
TOPOLOGY