skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A Case Study of MPI Over Long Distance Connections

Abstract

Scientific workflows are increasingly being distributed across wide-area networks, and their code executions are expected to span across geographically dispersed computing systems. MPI has been extensively used to support communications for distributed computations, typically, over compute clusters and high-performance systems within a single facility. We present a case study of performance of MPI basic operations over long distance connections, wherein TCP is used for the underlying transport. We present measurements of execution times of MPI codes that utilize MPI Sendrecv operations over emulated 10Gbps connections with 0-366ms round-trip times, including the longest one spanning the globe. They demonstrate that basic MPI codes can be sustained over long distance connections under external packet loss rates up to 10%. They also highlight the qualitative effects of losses which manifest as increased execution times as a consequence of TCP’s loss recovery process.

Authors:
ORCiD logo [1]; ORCiD logo [1]; ORCiD logo [1]
  1. ORNL
Publication Date:
Research Org.:
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
Sponsoring Org.:
USDOE National Nuclear Security Administration (NNSA); USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)
OSTI Identifier:
1559642
DOE Contract Number:  
AC05-00OR22725
Resource Type:
Conference
Resource Relation:
Conference: 13th Annual IEEE International Systems Conference (SysCon 2019) - Orlando, Florida, United States of America - 4/8/2019 8:00:00 AM-4/11/2019 8:00:00 AM
Country of Publication:
United States
Language:
English

Citation Formats

Rao, Nageswara S., Imam, Neena, and Boehm, Swen. A Case Study of MPI Over Long Distance Connections. United States: N. p., 2019. Web.
Rao, Nageswara S., Imam, Neena, & Boehm, Swen. A Case Study of MPI Over Long Distance Connections. United States.
Rao, Nageswara S., Imam, Neena, and Boehm, Swen. Mon . "A Case Study of MPI Over Long Distance Connections". United States. https://www.osti.gov/servlets/purl/1559642.
@article{osti_1559642,
title = {A Case Study of MPI Over Long Distance Connections},
author = {Rao, Nageswara S. and Imam, Neena and Boehm, Swen},
abstractNote = {Scientific workflows are increasingly being distributed across wide-area networks, and their code executions are expected to span across geographically dispersed computing systems. MPI has been extensively used to support communications for distributed computations, typically, over compute clusters and high-performance systems within a single facility. We present a case study of performance of MPI basic operations over long distance connections, wherein TCP is used for the underlying transport. We present measurements of execution times of MPI codes that utilize MPI Sendrecv operations over emulated 10Gbps connections with 0-366ms round-trip times, including the longest one spanning the globe. They demonstrate that basic MPI codes can be sustained over long distance connections under external packet loss rates up to 10%. They also highlight the qualitative effects of losses which manifest as increased execution times as a consequence of TCP’s loss recovery process.},
doi = {},
url = {https://www.osti.gov/biblio/1559642}, journal = {},
number = ,
volume = ,
place = {United States},
year = {2019},
month = {4}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: