Advanced Search

Browse by Discipline

Scientific Societies

E-print Alerts

Add E-prints

E-print Network

  Advanced Search  

Process Arrival Pattern and Shared Memory Aware Alltoall on InfiniBand

Summary: Process Arrival Pattern and Shared Memory
Aware Alltoall on InfiniBand
Ying Qian and Ahmad Afsahi
Department of Electrical and Computer Engineering
Queen's University
Kingston, ON, CANADA K7L 3N6
ying.qian@ece.queensu.ca ahmad.afsahi@queensu.ca
Abstract. Recent studies have shown that processes in real applica-
tions can arrive at the collective calls at different times. This imbalanced
process arrival pattern can significantly affect the performance of the
collective operations. MPI Alltoall() is a communication-intensive col-
lective operation that is used in many parallel scientific applications.
Its efficient implementation under different process arrival patterns is
critical to the performance of applications that use them frequently. In
this paper, we propose novel RDMA-based process arrival pattern aware
MPI Alltoall() algorithms over InfiniBand clusters. We extend the algo-
rithms to be shared memory aware for small to medium size messages.
The micro-benchmark and application results indicate that the proposed
algorithms outperform the native implementation as well as their non-
process arrival pattern aware counterparts when processes arrive at dif-


Source: Afsahi, Ahmad - Department of Electrical and Computer Engineering, Queen's University (Kingston)


Collections: Computer Technologies and Information Sciences