skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Technologies and tools for high-performance distributed computing. Final report

Abstract

In this project we studied the practical use of the MPI message-passing interface in advanced distributed computing environments. We built on the existing software infrastructure provided by the Globus Toolkit{trademark}, the MPICH portable implementation of MPI, and the MPICH-G integration of MPICH with Globus. As a result of this project we have replaced MPICH-G with its successor MPICH-G2, which is also an integration of MPICH with Globus. MPICH-G2 delivers significant improvements in message passing performance when compared to its predecessor MPICH-G and was based on superior software design principles resulting in a software base that was much easier to make the functional extensions and improvements we did. Using Globus services we replaced the default implementation of MPI's collective operations in MPICH-G2 with more efficient multilevel topology-aware collective operations which, in turn, led to the development of a new timing methodology for broadcasts [8]. MPICH-G2 was extended to include client/server functionality from the MPI-2 standard [23] to facilitate remote visualization applications and, through the use of MPI idioms, MPICH-G2 provided application-level control of quality-of-service parameters as well as application-level discovery of underlying Grid-topology information. Finally, MPICH-G2 was successfully used in a number of applications including an award-winning record-setting computation in numericalmore » relativity. In the sections that follow we describe in detail the accomplishments of this project, we present experimental results quantifying the performance improvements, and conclude with a discussion of our applications experiences. This project resulted in a significant increase in the utility of MPICH-G2.« less

Authors:
Publication Date:
Research Org.:
Department of Computer Science, Northern Illinois University, DeKalb, IL (US)
Sponsoring Org.:
USDOE Office of Energy Research (ER) (US)
OSTI Identifier:
808724
DOE Contract Number:  
FC02-99ER25398
Resource Type:
Technical Report
Resource Relation:
Other Information: Exploiting Hierarchy in Par. Comp. Networks to Optim. Coll. Oper. Perf. (IPDPS); PBD: 1 May 2000
Country of Publication:
United States
Language:
English
Subject:
99 GENERAL AND MISCELLANEOUS//MATHEMATICS, COMPUTING, AND INFORMATION SCIENCE; DESIGN; PERFORMANCE; M CODES; PROGRAMMING; DATA TRANSMISSION; PROGRESS REPORT; COMPUTER NETWORKS

Citation Formats

Karonis, Nicholas T. Technologies and tools for high-performance distributed computing. Final report. United States: N. p., 2000. Web. doi:10.2172/808724.
Karonis, Nicholas T. Technologies and tools for high-performance distributed computing. Final report. United States. doi:10.2172/808724.
Karonis, Nicholas T. Mon . "Technologies and tools for high-performance distributed computing. Final report". United States. doi:10.2172/808724. https://www.osti.gov/servlets/purl/808724.
@article{osti_808724,
title = {Technologies and tools for high-performance distributed computing. Final report},
author = {Karonis, Nicholas T.},
abstractNote = {In this project we studied the practical use of the MPI message-passing interface in advanced distributed computing environments. We built on the existing software infrastructure provided by the Globus Toolkit{trademark}, the MPICH portable implementation of MPI, and the MPICH-G integration of MPICH with Globus. As a result of this project we have replaced MPICH-G with its successor MPICH-G2, which is also an integration of MPICH with Globus. MPICH-G2 delivers significant improvements in message passing performance when compared to its predecessor MPICH-G and was based on superior software design principles resulting in a software base that was much easier to make the functional extensions and improvements we did. Using Globus services we replaced the default implementation of MPI's collective operations in MPICH-G2 with more efficient multilevel topology-aware collective operations which, in turn, led to the development of a new timing methodology for broadcasts [8]. MPICH-G2 was extended to include client/server functionality from the MPI-2 standard [23] to facilitate remote visualization applications and, through the use of MPI idioms, MPICH-G2 provided application-level control of quality-of-service parameters as well as application-level discovery of underlying Grid-topology information. Finally, MPICH-G2 was successfully used in a number of applications including an award-winning record-setting computation in numerical relativity. In the sections that follow we describe in detail the accomplishments of this project, we present experimental results quantifying the performance improvements, and conclude with a discussion of our applications experiences. This project resulted in a significant increase in the utility of MPICH-G2.},
doi = {10.2172/808724},
journal = {},
number = ,
volume = ,
place = {United States},
year = {2000},
month = {5}
}