skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Running Infiniband on the Cray XT3

Abstract

In an effort to utilize the performance and cost benefits of the infiniband interconnect, this paper will discuss what was needed to install and load a single data rate infiniband host channel adapter into a service node on the Cray XT3. Along with the discussion on how to do it, this paper will also provide some performance numbers achieved from this connection to a remote system.

Authors:
 [1]
  1. ORNL
Publication Date:
Research Org.:
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Center for Computational Sciences
Sponsoring Org.:
USDOE Office of Science (SC)
OSTI Identifier:
932611
Report Number(s):
ORNL/TM-2006/620
KJ0502000; ERKJZN1; TRN: US200814%%659
DOE Contract Number:
DE-AC05-00OR22725
Resource Type:
Technical Report
Country of Publication:
United States
Language:
English
Subject:
97; 99 GENERAL AND MISCELLANEOUS//MATHEMATICS, COMPUTING, AND INFORMATION SCIENCE; PERFORMANCE; SUPERCOMPUTERS; EQUIPMENT INTERFACES; CRAY COMPUTERS; Cray; XT3; infiniband; Voltaire; linux; OFED; OpenFabrics

Citation Formats

Minich, Makia. Running Infiniband on the Cray XT3. United States: N. p., 2007. Web. doi:10.2172/932611.
Minich, Makia. Running Infiniband on the Cray XT3. United States. doi:10.2172/932611.
Minich, Makia. Tue . "Running Infiniband on the Cray XT3". United States. doi:10.2172/932611. https://www.osti.gov/servlets/purl/932611.
@article{osti_932611,
title = {Running Infiniband on the Cray XT3},
author = {Minich, Makia},
abstractNote = {In an effort to utilize the performance and cost benefits of the infiniband interconnect, this paper will discuss what was needed to install and load a single data rate infiniband host channel adapter into a service node on the Cray XT3. Along with the discussion on how to do it, this paper will also provide some performance numbers achieved from this connection to a remote system.},
doi = {10.2172/932611},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Tue May 01 00:00:00 EDT 2007},
month = {Tue May 01 00:00:00 EDT 2007}
}

Technical Report:

Save / Share:
  • The CRAY X-MP/48 at the National Center for Atmospheric Research (NCAR) was installed and became operational in the fourth quarter of 1986. By the end of the second quarter of 1988, the X-MP was saturated. It is expected that NCAR will replace the X-MP with the next generation supercomputer sometime in 1990-1992. The users of NCAR's computing facilities have been using the batch-oriented Cray Operating System (COS) since the installation of NCAR's first CRAY-1 in 1977. Concerns have been expressed about the impact of UNIX on supercomputer performance, particularly on the performance of applications that require substantial amounts of inputmore » and output (I/O) operations.« less
  • This Validation Summary Report describes the extent to which a specific Ada compiler conforms to the Ada Standard, ANSI/MIL-STD-1815A. The report explains all technical terms used within it and thoroughly reports the results of testing this compiler using the Ada Compiler Validation Capability. An Ada compiler must be implemented according to the Ada Standard, and any implementation-dependent features must conform to the requirements of the Ada Standard. The Ada Standard must be implemented in its entirety, and nothing can be implemented that is not in the Standard. Even though all validated Ada compilers conform to the Ada Standard, it mustmore » be understood that some differences do exist between implementations. The Ada Standard permits some implementation dependencies - for example, the maximum length of identifiers or the maximum values of integer types. Other differences between compilers result from the characteristics of particular operating systems, hardware, or implementation strategies. All the dependencies observed during the process of testing this compiler are given in this report. The information in this report is derived from the test results produced during validation testing. The validation process includes submitting a suite of standardized tests, the ACVC, as inputs to an Ada compiler and evaluating the results.« less
  • This Validation Summary Report (VSR) for the Cray Research, Inc., CRAY FORTRAN Translator (CFT) Version 1.11 Bugfix 1 running under the CRAY Operating System (COS) Version 1.12 provides a consolidated summary of the results obtained from the validation of the subject compiler against the 1978 FORTRAN Standard (X3.9-1978/FIPS PUB 69). The compiler was validated against the Full Level FORTRAN level of FIPS PUB 69. The VSR is made up of several sections showing all the discrepancies found -if any. These include an overview of the validation which lists all categories of discrepancies together with the tests which failed.
  • This Validation Summary Report describes the extent to which a specific Ada compiler conforms to the Ada Standard, ANSI-MIL-STD-1815A. The report explains all technical terms used within it and thoroughly reports the results of testing this compiler using the Ada Compiler Validation Capability. An Ada compiler must be implemented according to the Ada Standard, and any implementation-dependent features must conform to the requirements of the Ada Standard. The Ada Standard must be implemented in its entirety, and nothing can be implemented that is not in the Standard. Even though all validated Ada compilers conform to the Ada Standard, it mustmore » be understood that some differences do exist between implementations. The Ada Standard permits some implementation dependencies - for example, the maximum length of identifiers or the maximum values of integer types. Other differences between compilers result from the characteristics of particular operating systems, hardware, or implementation strategies. All the dependencies observed during the process of testing this compiler are given in this report. The information in this report is derived from the test results produced during validation testing. The validation process includes submitting a suite of standardized tests, the ACVC, as inputs to an Ada compiler and evaluating the results.« less
  • The Resource Allocation and Tracking System (RATS) is a suite of software components designed to provide resource management capabilities for high performance computing environments. RATS is currently supporting resource allocation management on the Cray X1E, XT3 and XD1 platforms at Oak Ridge National Laboratory. In this paper, the design and implementation of RATS is given with respect to the Cray platforms with an emphasis on the flexibility of the design. Future directions will also be explored.