Comparing the Performance of Blue Gene/Q with Leading Cray XE6 and InfiniBand Systems
Abstract—Three types of systems dominate the current High Performance Computing landscape: the Cray XE6, the IBM Blue Gene, and commodity clusters using InfiniBand. These systems have quite different characteristics making the choice for a particular deployment difficult. The XE6 uses Cray’s proprietary Gemini 3-D torus interconnect with two nodes at each network endpoint. The latest IBM Blue Gene/Q uses a single socket integrating processor and communication in a 5-D torus network. InfiniBand provides the flexibility of using nodes from many vendors connected in many possible topologies. The performance characteristics of each vary vastly along with their utilization model. In this work we compare the performance of these three systems using a combination of micro-benchmarks and a set of production applications. In particular we discuss the causes of variability in performance across the systems and also quantify where performance is lost using a combination of measurements and models. Our results show that significant performance can be lost in normal production operation of the Cray XT6 and InfiniBand Clusters in comparison to Blue Gene/Q.
- Research Organization:
- Pacific Northwest National Lab. (PNNL), Richland, WA (United States)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC05-76RL01830
- OSTI ID:
- 1089075
- Report Number(s):
- PNNL-SA-91632; KJ0403000
- Resource Relation:
- Conference: Proceedings of 18th IEEE International Conference on Parallel and Distributed Systems (ICPADS), December 17-19, 2012, Singapore, 556-563
- Country of Publication:
- United States
- Language:
- English
Similar Records
Investigating the impact of the cielo cray XE6 architecture on scientific application codes.
A uGNI-based Asynchronous Message-driven Runtime System for Cray Supercomputers with Gemini Interconnect