DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Flexspander: augmenting expander networks in high-performance systems with optical bandwidth steering

Abstract

Communication efficiency is one of the deciding factors in determining many of today’s high-performance computing (HPC) applications. Traditionally, HPC systems have been on static network topologies, making them inflexible to the variety of skewed traffic demands that may arise due to the spatial locality inherent in many applications. To handle traffic locality, researchers have proposed integrating optical circuit switches (OCSs) into the network architecture, which reconfigures the network topology to alter and dynamically adapt to the predicted traffic. In this paper, we present a novel reconfigurable network topology called Flexspander. Beyond offering a flexible interconnect, Flexspander also offers full flexibility in terms of construction and can be built with any arbitrary combination of commercial electrical packet switches and OCSs. We evaluate Flexspander performance through extensive simulations with multiple network traces, and our results show improved performance for Flexspander over currently proposed static and reconfigurable topologies in terms of the flow completion time.

Authors:
; ;
Publication Date:
Sponsoring Org.:
USDOE Advanced Research Projects Agency - Energy (ARPA-E)
OSTI Identifier:
1601693
Grant/Contract Number:  
AR00000843; B621301
Resource Type:
Publisher's Accepted Manuscript
Journal Name:
Journal of Optical Communications and Networking
Additional Journal Information:
Journal Name: Journal of Optical Communications and Networking Journal Volume: 12 Journal Issue: 4; Journal ID: ISSN 1943-0620
Publisher:
Optical Society of America
Country of Publication:
United States
Language:
English

Citation Formats

Teh, Min Yee, Wu, Zhenguo, and Bergman, Keren. Flexspander: augmenting expander networks in high-performance systems with optical bandwidth steering. United States: N. p., 2020. Web. doi:10.1364/JOCN.379487.
Teh, Min Yee, Wu, Zhenguo, & Bergman, Keren. Flexspander: augmenting expander networks in high-performance systems with optical bandwidth steering. United States. https://doi.org/10.1364/JOCN.379487
Teh, Min Yee, Wu, Zhenguo, and Bergman, Keren. Fri . "Flexspander: augmenting expander networks in high-performance systems with optical bandwidth steering". United States. https://doi.org/10.1364/JOCN.379487.
@article{osti_1601693,
title = {Flexspander: augmenting expander networks in high-performance systems with optical bandwidth steering},
author = {Teh, Min Yee and Wu, Zhenguo and Bergman, Keren},
abstractNote = {Communication efficiency is one of the deciding factors in determining many of today’s high-performance computing (HPC) applications. Traditionally, HPC systems have been on static network topologies, making them inflexible to the variety of skewed traffic demands that may arise due to the spatial locality inherent in many applications. To handle traffic locality, researchers have proposed integrating optical circuit switches (OCSs) into the network architecture, which reconfigures the network topology to alter and dynamically adapt to the predicted traffic. In this paper, we present a novel reconfigurable network topology called Flexspander. Beyond offering a flexible interconnect, Flexspander also offers full flexibility in terms of construction and can be built with any arbitrary combination of commercial electrical packet switches and OCSs. We evaluate Flexspander performance through extensive simulations with multiple network traces, and our results show improved performance for Flexspander over currently proposed static and reconfigurable topologies in terms of the flow completion time.},
doi = {10.1364/JOCN.379487},
journal = {Journal of Optical Communications and Networking},
number = 4,
volume = 12,
place = {United States},
year = {2020},
month = {2}
}

Works referenced in this record:

Network traffic characteristics of data centers in the wild
conference, January 2010

  • Benson, Theophilus; Akella, Aditya; Maltz, David A.
  • IMC '10 Proceedings of the 10th ACM SIGCOMM conference on Internet measurement
  • DOI: 10.1145/1879141.1879175

Ramanujan graphs
journal, September 1988

  • Lubotzky, A.; Phillips, R.; Sarnak, P.
  • Combinatorica, Vol. 8, Issue 3
  • DOI: 10.1007/BF02126799

Xpander: Unveiling the Secrets of High-Performance Datacenters
conference, November 2015

  • Valadarsky, Asaf; Dinitz, Michael; Schapira, Michael
  • HotNets-XIV: The 14th ACM Workshop on Hot Topics in Networks, Proceedings of the 14th ACM Workshop on Hot Topics in Networks
  • DOI: 10.1145/2834050.2834059

Inside the Social Network's (Datacenter) Network
conference, August 2015

  • Roy, Arjun; Zeng, Hongyi; Bagga, Jasmeet
  • SIGCOMM '15: ACM SIGCOMM 2015 Conference, Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication
  • DOI: 10.1145/2785956.2787472

ProjecToR: Agile Reconfigurable Data Center Interconnect
conference, August 2016

  • Ghobadi, Monia; Mahajan, Ratul; Phanishayee, Amar
  • SIGCOMM '16: ACM SIGCOMM 2016 Conference, Proceedings of the 2016 ACM SIGCOMM Conference
  • DOI: 10.1145/2934872.2934911

Reconfigurable hybrid interconnection for static and dynamic scientific applications
conference, January 2007

  • Kamil, Shoaib; Pinar, Ali; Gunter, Daniel
  • Proceedings of the 4th international conference on Computing frontiers - CF '07
  • DOI: 10.1145/1242531.1242559

A scalable, commodity data center network architecture
conference, January 2008

  • Al-Fares, Mohammad; Loukissas, Alexander; Vahdat, Amin
  • Proceedings of the ACM SIGCOMM 2008 conference on Data communication - SIGCOMM '08
  • DOI: 10.1145/1402958.1402967

Xpander: Towards Optimal-Performance Datacenters
conference, January 2016

  • Valadarsky, Asaf; Shahaf, Gal; Dinitz, Michael
  • Proceedings of the 12th International on Conference on emerging Networking EXperiments and Technologies - CoNEXT '16
  • DOI: 10.1145/2999572.2999580

Finding the K Shortest Loopless Paths in a Network
journal, July 1971


Understanding data center traffic characteristics
conference, January 2009

  • Benson, Theophilus; Anand, Ashok; Akella, Aditya
  • Proceedings of the 1st ACM workshop on Research on enterprise networking - WREN '09
  • DOI: 10.1145/1592681.1592692

Fat-trees: Universal networks for hardware-efficient supercomputing
journal, October 1985


Bandwidth steering in HPC using silicon nanophotonics
conference, November 2019

  • Michelogiannakis, George; Shen, Yiwen; Teh, Min Yee
  • SC '19: The International Conference for High Performance Computing, Networking, Storage, and Analysis, Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis
  • DOI: 10.1145/3295500.3356145

HyperX: topology, routing, and packaging of efficient large-scale networks
conference, January 2009

  • Ahn, Jung Ho; Binkert, Nathan; Davis, Al
  • Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis - SC '09
  • DOI: 10.1145/1654059.1654101

Three-dimensional Statistical Data Security Problems
journal, February 1994


Entropy Waves, the Zig-Zag Graph Product, and New Constant-Degree Expanders
journal, January 2002

  • Reingold, Omer; Vadhan, Salil; Wigderson, Avi
  • The Annals of Mathematics, Vol. 155, Issue 1
  • DOI: 10.2307/3062153

VL2: a scalable and flexible data center network
conference, January 2009

  • Greenberg, Albert; Hamilton, James R.; Jain, Navendu
  • Proceedings of the ACM SIGCOMM 2009 conference on Data communication - SIGCOMM '09
  • DOI: 10.1145/1592568.1592576

Integrating microsecond circuit switching into the data center
conference, August 2013

  • Porter, George; Strong, Richard; Farrington, Nathan
  • SIGCOMM'13: ACM SIGCOMM 2013 Conference, Proceedings of the ACM SIGCOMM 2013 conference on SIGCOMM
  • DOI: 10.1145/2486001.2486007

B4: experience with a globally-deployed software defined wan
conference, August 2013

  • Jain, Sushant; Kumar, Alok; Mandal, Subhasree
  • SIGCOMM'13: ACM SIGCOMM 2013 Conference, Proceedings of the ACM SIGCOMM 2013 conference on SIGCOMM
  • DOI: 10.1145/2486001.2486019

The nature of data center traffic: measurements & analysis
conference, January 2009

  • Kandula, Srikanth; Sengupta, Sudipta; Greenberg, Albert
  • Proceedings of the 9th ACM SIGCOMM conference on Internet measurement conference - IMC '09
  • DOI: 10.1145/1644893.1644918

pFabric: minimal near-optimal datacenter transport
conference, August 2013

  • Alizadeh, Mohammad; Yang, Shuang; Sharif, Milad
  • SIGCOMM'13: ACM SIGCOMM 2013 Conference, Proceedings of the ACM SIGCOMM 2013 conference on SIGCOMM
  • DOI: 10.1145/2486001.2486031