Evaluating Trade-offs in Potential Exascale Interconnect Technologies

Hemmert, Karl Scott; Bair, Ray; Bhatale, Abhinav; Groves, Taylor; Jain, Nikhil; Lewis, Cannada; Mubarak, Misbah; Pakin, Scott D.; Ross, Robert; Wilke, Jeremiah J.

doi:10.2172/1592888

Title: Evaluating Trade-offs in Potential Exascale Interconnect Technologies

Full Record
Other Related Research

Abstract

This report details work to study trade-offs in topology and network bandwidth for potential interconnects in the exascale (2021-2022) timeframe. The work was done using multiple interconnect models across two parallel discrete event simulators. Results from each independent simulator are shown and discussed and the areas of agreement and disagreement are explored.

Authors:

Hemmert, Karl Scott ^[1]; Bair, Ray ^[1]; Bhatale, Abhinav ^[1]; Groves, Taylor ^[2]; Jain, Nikhil ^[2]; Lewis, Cannada ^[1]; Mubarak, Misbah ^[1]; Pakin, Scott D. ^[3]; Ross, Robert ^[1]; Wilke, Jeremiah J. ^[4]

Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Sandia National Lab. (SNL-CA), Livermore, CA (United States)

Publication Date:: 2020-12-01

Research Org.:: Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States); Sandia National Lab. (SNL-NM), Albuquerque, NM (United States); Sandia National Lab. (SNL-CA), Livermore, CA (United States)

Sponsoring Org.:: USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); USDOE National Nuclear Security Administration (NNSA)

OSTI Identifier:: 1592888

Report Number(s):: SAND-2019-15168R
682118

DOE Contract Number:: AC04-94AL85000; AC52-07NA27344; NA0003525

Resource Type:: Technical Report

Country of Publication:: United States

Language:: English

Subject:: 97 MATHEMATICS AND COMPUTING

Citation Formats


                    Hemmert, Karl Scott, Bair, Ray, Bhatale, Abhinav, Groves, Taylor, Jain, Nikhil, Lewis, Cannada, Mubarak, Misbah, Pakin, Scott D., Ross, Robert, and Wilke, Jeremiah J.. Evaluating Trade-offs in Potential Exascale Interconnect Technologies.  United States: N. p., 2020. 
        Web.  doi:10.2172/1592888.

Copy to clipboard


                    Hemmert, Karl Scott, Bair, Ray, Bhatale, Abhinav, Groves, Taylor, Jain, Nikhil, Lewis, Cannada, Mubarak, Misbah, Pakin, Scott D., Ross, Robert, & Wilke, Jeremiah J.. Evaluating Trade-offs in Potential Exascale Interconnect Technologies.  United States.  https://doi.org/10.2172/1592888

Copy to clipboard


                    Hemmert, Karl Scott, Bair, Ray, Bhatale, Abhinav, Groves, Taylor, Jain, Nikhil, Lewis, Cannada, Mubarak, Misbah, Pakin, Scott D., Ross, Robert, and Wilke, Jeremiah J.. 2020.  
        "Evaluating Trade-offs in Potential Exascale Interconnect Technologies".  United States.  https://doi.org/10.2172/1592888.  https://www.osti.gov/servlets/purl/1592888.

Copy to clipboard


                    
@article{osti_1592888,

  title        = {Evaluating Trade-offs in Potential Exascale Interconnect Technologies},

  author       = {Hemmert, Karl Scott and Bair, Ray and Bhatale, Abhinav and Groves, Taylor and Jain, Nikhil and Lewis, Cannada and Mubarak, Misbah and Pakin, Scott D. and Ross, Robert and Wilke, Jeremiah J.},

  abstractNote = {This report details work to study trade-offs in topology and network bandwidth for potential interconnects in the exascale (2021-2022) timeframe. The work was done using multiple interconnect models across two parallel discrete event simulators. Results from each independent simulator are shown and discussed and the areas of agreement and disagreement are explored.},

  doi          = {10.2172/1592888},

  url          = {https://www.osti.gov/biblio/1592888},
  journal      = {},
number       = ,

  volume       = ,

  place        = {United States},

  year         = {2020},

  month        = {12}

}

Copy to clipboard

Technical Report:

View Technical Report (11.25 MB)

https://doi.org/10.2172/1592888

Save / Share:

Export Metadata

Save to My Library

Similar records in OSTI.GOV collections:

Evaluating Trade-offs in Potential Exascale Interconnect Topologies

Technical Report Bhatele, A.

This study looks at the high-level trade-offs for interconnect architectures that are likely to be available in HPC machines in the 2021-2022 timeframe. The study uses multiple simulation models to look at the effects of varying machine size, injection bandwidth and topology for a selected set of benchmark communication patterns. The studies show the sensitivity of various applications to these network parameters. This study can help inform decisions on node size versus number of nodes, which topology is most efficient for our applications, how much injection bandwidth to provision, etc. These simulations only look at interconnects with maximally configured globalmore »« less
https://doi.org/10.2172/1468904

Full Text Available
Performance trade-offs in reconfigurable networks for HPC

Journal Article Teh, Min; Wu, Zhenguo; Glick, Madeleine; ... - Journal of Optical Communications and Networking

Designing efficient interconnects to support high-bandwidth and low-latency communication is critical toward realizing high performance computing (HPC) and data center (DC) systems in the exascale era. At extreme computing scales, providing the requisite bandwidth through overprovisioning becomes impractical. These challenges have motivated studies exploring reconfigurable network architectures that can adapt to traffic patterns at runtime using optical circuit switching. Despite the plethora of proposed architectures, surprisingly little is known about the relative performances and trade-offs among different reconfigurable network designs. We aim to bridge this gap by tackling two key issues in reconfigurable network design. First, we study how cost,more »« less
https://doi.org/10.1364/JOCN.451760
Data Movement Dominates: Advanced Memory Technology to Address the Real Exascale Power Problem

Technical Report Bergman, Keren

Energy is the fundamental barrier to Exascale supercomputing and is dominated by the cost of moving data from one point to another, not computation. Similarly, performance is dominated by data movement, not computation. The solution to this problem requires three critical technologies: 3D integration, optical chip-to-chip communication, and a new communication model. The central goal of the Sandia led "Data Movement Dominates" project aimed to develop memory systems and new architectures based on these technologies that have the potential to lower the cost of local memory accesses by orders of magnitude and provide substantially more bandwidth. Only through these transformationalmore »« less
https://doi.org/10.2172/1151423

Full Text Available
Analysis of the trade-offs between conventional and superconducting interconnections

Journal Article Frye, R - IEEE Circuits Devices; (United States)

Superconductivity can now be achieved at temperatures compatible with semiconductor device operation. This raises the interesting possibility of using the new, high-temperature superconducting ceramics for interconnections in electronic systems. This paper examines some of the consequences of a resistance-free interconnection medium. A problem with conventional conductors in electronic systems is that the resistance of wires increases quadratically as the wire dimensions are scaled down. Below some minimum cross-sectional area, determined by the metal resistivity and wire length, the resistance in these lines begins to severely limit their bandwidth. Superconductors, on the other hand, are not constrained by the same scalingmore »« less
https://doi.org/10.1109/101.25028
Scientific Application Requirements for Leadership Computing at the Exascale

Technical Report Ahern, Sean; Alam, Sadaf; Fahey, Mark; ...

The Department of Energy s Leadership Computing Facility, located at Oak Ridge National Laboratory s National Center for Computational Sciences, recently polled scientific teams that had large allocations at the center in 2007, asking them to identify computational science requirements for future exascale systems (capable of an exaflop, or 1018 floating point operations per second). These requirements are necessarily speculative, since an exascale system will not be realized until the 2015 2020 timeframe, and are expressed where possible relative to a recent petascale requirements analysis of similar science applications [1]. Our initial findings, which beg further data collection, validation, andmore »« less
https://doi.org/10.2172/1081802

Full Text Available

Similar Records