Optimizing Strided Remote Memory Access Operations on the Quadrics QsNetII Network Interconnect
This paper describes and evaluates protocols for optimizing strided non-contiguous communication on the Quadrics QsNetII high-performance network interconnect. Most of previous related studies focused primarily on NIC-based or host-based protocols. This paper discusses merits for using both approaches and tries to determine for types and data sizes in the communication operations these protocols should be used. We focus on the Quadrics QsNetII-II network which offers powerful communication processors on the network interface card (NIC) and practical and flexible opportunities for exploiting them in context of user. Furthermore, the paper focuses on non-contiguous data remote memory access (RMA) transfers and performs the evaluation in context of standalone communication and application microbenchmarks. In comparison to the vendor provided noncontiguous interfaces, proposed approach achieved very significant performance improvement in context of microbenchmarks as well as application kernels- dense matrix multiplication and the Co-Array Fortran version of the NAS BT parallel benchmark. For example, for NAS BT Class B 54 % improvement in overall communication time and a 42% improvement in matrix multiplication was achieved for 64 processes.
- Research Organization:
- Pacific Northwest National Lab. (PNNL), Richland, WA (United States)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC05-76RL01830
- OSTI ID:
- 894870
- Report Number(s):
- PNNL-SA-46161; KJ0101030; TRN: US200702%%391
- Resource Relation:
- Conference: Proceedings of the Eighth International Conference on High-Performance Computing in Asia-Pacific Region, 2005, 28-35
- Country of Publication:
- United States
- Language:
- English
Similar Records
An Evaluation of Two Implementation Strategies for Optimizing One-Sided Atomic Reduction
Optimizing Mechanisms for Latency Tolerance in Remote Memory Access Communication on Clusters