Flexspander: augmenting expander networks in high-performance systems with optical bandwidth steering
Abstract
Communication efficiency is one of the deciding factors in determining many of today’s high-performance computing (HPC) applications. Traditionally, HPC systems have been on static network topologies, making them inflexible to the variety of skewed traffic demands that may arise due to the spatial locality inherent in many applications. To handle traffic locality, researchers have proposed integrating optical circuit switches (OCSs) into the network architecture, which reconfigures the network topology to alter and dynamically adapt to the predicted traffic. In this paper, we present a novel reconfigurable network topology called Flexspander. Beyond offering a flexible interconnect, Flexspander also offers full flexibility in terms of construction and can be built with any arbitrary combination of commercial electrical packet switches and OCSs. We evaluate Flexspander performance through extensive simulations with multiple network traces, and our results show improved performance for Flexspander over currently proposed static and reconfigurable topologies in terms of the flow completion time.
- Authors:
- Publication Date:
- Sponsoring Org.:
- USDOE Advanced Research Projects Agency - Energy (ARPA-E)
- OSTI Identifier:
- 1601693
- Grant/Contract Number:
- AR00000843; B621301
- Resource Type:
- Publisher's Accepted Manuscript
- Journal Name:
- Journal of Optical Communications and Networking
- Additional Journal Information:
- Journal Name: Journal of Optical Communications and Networking Journal Volume: 12 Journal Issue: 4; Journal ID: ISSN 1943-0620
- Publisher:
- Optical Society of America
- Country of Publication:
- United States
- Language:
- English
Citation Formats
Teh, Min Yee, Wu, Zhenguo, and Bergman, Keren. Flexspander: augmenting expander networks in high-performance systems with optical bandwidth steering. United States: N. p., 2020.
Web. doi:10.1364/JOCN.379487.
Teh, Min Yee, Wu, Zhenguo, & Bergman, Keren. Flexspander: augmenting expander networks in high-performance systems with optical bandwidth steering. United States. https://doi.org/10.1364/JOCN.379487
Teh, Min Yee, Wu, Zhenguo, and Bergman, Keren. Fri .
"Flexspander: augmenting expander networks in high-performance systems with optical bandwidth steering". United States. https://doi.org/10.1364/JOCN.379487.
@article{osti_1601693,
title = {Flexspander: augmenting expander networks in high-performance systems with optical bandwidth steering},
author = {Teh, Min Yee and Wu, Zhenguo and Bergman, Keren},
abstractNote = {Communication efficiency is one of the deciding factors in determining many of today’s high-performance computing (HPC) applications. Traditionally, HPC systems have been on static network topologies, making them inflexible to the variety of skewed traffic demands that may arise due to the spatial locality inherent in many applications. To handle traffic locality, researchers have proposed integrating optical circuit switches (OCSs) into the network architecture, which reconfigures the network topology to alter and dynamically adapt to the predicted traffic. In this paper, we present a novel reconfigurable network topology called Flexspander. Beyond offering a flexible interconnect, Flexspander also offers full flexibility in terms of construction and can be built with any arbitrary combination of commercial electrical packet switches and OCSs. We evaluate Flexspander performance through extensive simulations with multiple network traces, and our results show improved performance for Flexspander over currently proposed static and reconfigurable topologies in terms of the flow completion time.},
doi = {10.1364/JOCN.379487},
journal = {Journal of Optical Communications and Networking},
number = 4,
volume = 12,
place = {United States},
year = {Fri Feb 28 00:00:00 EST 2020},
month = {Fri Feb 28 00:00:00 EST 2020}
}
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.1364/JOCN.379487
https://doi.org/10.1364/JOCN.379487
Other availability
Search WorldCat to find libraries that may hold this journal
Cited by: 14 works
Citation information provided by
Web of Science
Web of Science
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.
Works referenced in this record:
Network traffic characteristics of data centers in the wild
conference, January 2010
- Benson, Theophilus; Akella, Aditya; Maltz, David A.
- IMC '10 Proceedings of the 10th ACM SIGCOMM conference on Internet measurement
Ramanujan graphs
journal, September 1988
- Lubotzky, A.; Phillips, R.; Sarnak, P.
- Combinatorica, Vol. 8, Issue 3
Xpander: Unveiling the Secrets of High-Performance Datacenters
conference, November 2015
- Valadarsky, Asaf; Dinitz, Michael; Schapira, Michael
- HotNets-XIV: The 14th ACM Workshop on Hot Topics in Networks, Proceedings of the 14th ACM Workshop on Hot Topics in Networks
Inside the Social Network's (Datacenter) Network
conference, August 2015
- Roy, Arjun; Zeng, Hongyi; Bagga, Jasmeet
- SIGCOMM '15: ACM SIGCOMM 2015 Conference, Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication
ProjecToR: Agile Reconfigurable Data Center Interconnect
conference, August 2016
- Ghobadi, Monia; Mahajan, Ratul; Phanishayee, Amar
- SIGCOMM '16: ACM SIGCOMM 2016 Conference, Proceedings of the 2016 ACM SIGCOMM Conference
Reconfigurable hybrid interconnection for static and dynamic scientific applications
conference, January 2007
- Kamil, Shoaib; Pinar, Ali; Gunter, Daniel
- Proceedings of the 4th international conference on Computing frontiers - CF '07
A scalable, commodity data center network architecture
conference, January 2008
- Al-Fares, Mohammad; Loukissas, Alexander; Vahdat, Amin
- Proceedings of the ACM SIGCOMM 2008 conference on Data communication - SIGCOMM '08
Xpander: Towards Optimal-Performance Datacenters
conference, January 2016
- Valadarsky, Asaf; Shahaf, Gal; Dinitz, Michael
- Proceedings of the 12th International on Conference on emerging Networking EXperiments and Technologies - CoNEXT '16
Finding the K Shortest Loopless Paths in a Network
journal, July 1971
- Yen, Jin Y.
- Management Science, Vol. 17, Issue 11
Understanding data center traffic characteristics
conference, January 2009
- Benson, Theophilus; Anand, Ashok; Akella, Aditya
- Proceedings of the 1st ACM workshop on Research on enterprise networking - WREN '09
Fat-trees: Universal networks for hardware-efficient supercomputing
journal, October 1985
- Leiserson, Charles E.
- IEEE Transactions on Computers, Vol. C-34, Issue 10
Bandwidth steering in HPC using silicon nanophotonics
conference, November 2019
- Michelogiannakis, George; Shen, Yiwen; Teh, Min Yee
- SC '19: The International Conference for High Performance Computing, Networking, Storage, and Analysis, Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis
HyperX: topology, routing, and packaging of efficient large-scale networks
conference, January 2009
- Ahn, Jung Ho; Binkert, Nathan; Davis, Al
- Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis - SC '09
Three-dimensional Statistical Data Security Problems
journal, February 1994
- Irving, Robert W.; Jerrum, Mark R.
- SIAM Journal on Computing, Vol. 23, Issue 1
Entropy Waves, the Zig-Zag Graph Product, and New Constant-Degree Expanders
journal, January 2002
- Reingold, Omer; Vadhan, Salil; Wigderson, Avi
- The Annals of Mathematics, Vol. 155, Issue 1
VL2: a scalable and flexible data center network
conference, January 2009
- Greenberg, Albert; Hamilton, James R.; Jain, Navendu
- Proceedings of the ACM SIGCOMM 2009 conference on Data communication - SIGCOMM '09
Integrating microsecond circuit switching into the data center
conference, August 2013
- Porter, George; Strong, Richard; Farrington, Nathan
- SIGCOMM'13: ACM SIGCOMM 2013 Conference, Proceedings of the ACM SIGCOMM 2013 conference on SIGCOMM
B4: experience with a globally-deployed software defined wan
conference, August 2013
- Jain, Sushant; Kumar, Alok; Mandal, Subhasree
- SIGCOMM'13: ACM SIGCOMM 2013 Conference, Proceedings of the ACM SIGCOMM 2013 conference on SIGCOMM
The nature of data center traffic: measurements & analysis
conference, January 2009
- Kandula, Srikanth; Sengupta, Sudipta; Greenberg, Albert
- Proceedings of the 9th ACM SIGCOMM conference on Internet measurement conference - IMC '09
pFabric: minimal near-optimal datacenter transport
conference, August 2013
- Alizadeh, Mohammad; Yang, Shuang; Sharif, Milad
- SIGCOMM'13: ACM SIGCOMM 2013 Conference, Proceedings of the ACM SIGCOMM 2013 conference on SIGCOMM