skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Virtual Environment for Testing Software-Defined Networking Solutions for Scientific Workflows

Abstract

Recent developments in software-defined infrastructures promise that scientific workflows utilizing supercomputers, instruments, and storage systems will be dynamically composed and orchestrated using software at unprecedented speed and scale in the near future. Testing of the underlying networking software, particularly during initial exploratory stages, remains a challenge due to potential disruptions, and resource allocation and coordination needed over the multi-domain physical infrastructure. To overcome these challenges, we develop the Virtual Science Network Environment (VSNE) that emulates the multi-site host, storage, and network infrastructure using Virtual Machines (VMs), wherein the production and nascent software can be tested. Within each VM, which represents a site, the hosts and local-area networks are emulated using Mininet, and the Software-Defined Network (SDN) controllers and service daemon codes are natively run to support dynamic provisioning of network connections. Additionally, Lustre filesystem support at the sites and an emulation of the long-haul network using Mininet, are provided using separate VMs. As case studies, we describe Lustre file transfers using XDD, Red5 streaming service demonstration, and an emulated experiment with remote monitoring and steering modules, all supported over dynamically configured connections using SDN controllers.

Authors:
;
Publication Date:
Research Org.:
Brookhaven National Lab. (BNL), Upton, NY (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Advanced Scientific Computing Research (SC-21)
OSTI Identifier:
1619257
Report Number(s):
BNL-209115-2018-PUCP
DOE Contract Number:  
SC0012704
Resource Type:
Conference
Resource Relation:
Conference: ACM HPDC 2018 (The 27th International Symposium on High-Performance Parallel and Distributed Computing), Tempe, AZ, 6/11/2018 - 6/15/2018
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING

Citation Formats

Liu, Qiang, and Katramatos, Dimitrios. Virtual Environment for Testing Software-Defined Networking Solutions for Scientific Workflows. United States: N. p., 2018. Web. doi:10.1145/3217197.3217202.
Liu, Qiang, & Katramatos, Dimitrios. Virtual Environment for Testing Software-Defined Networking Solutions for Scientific Workflows. United States. doi:10.1145/3217197.3217202.
Liu, Qiang, and Katramatos, Dimitrios. Mon . "Virtual Environment for Testing Software-Defined Networking Solutions for Scientific Workflows". United States. doi:10.1145/3217197.3217202. https://www.osti.gov/servlets/purl/1619257.
@article{osti_1619257,
title = {Virtual Environment for Testing Software-Defined Networking Solutions for Scientific Workflows},
author = {Liu, Qiang and Katramatos, Dimitrios},
abstractNote = {Recent developments in software-defined infrastructures promise that scientific workflows utilizing supercomputers, instruments, and storage systems will be dynamically composed and orchestrated using software at unprecedented speed and scale in the near future. Testing of the underlying networking software, particularly during initial exploratory stages, remains a challenge due to potential disruptions, and resource allocation and coordination needed over the multi-domain physical infrastructure. To overcome these challenges, we develop the Virtual Science Network Environment (VSNE) that emulates the multi-site host, storage, and network infrastructure using Virtual Machines (VMs), wherein the production and nascent software can be tested. Within each VM, which represents a site, the hosts and local-area networks are emulated using Mininet, and the Software-Defined Network (SDN) controllers and service daemon codes are natively run to support dynamic provisioning of network connections. Additionally, Lustre filesystem support at the sites and an emulation of the long-haul network using Mininet, are provided using separate VMs. As case studies, we describe Lustre file transfers using XDD, Red5 streaming service demonstration, and an emulated experiment with remote monitoring and steering modules, all supported over dynamically configured connections using SDN controllers.},
doi = {10.1145/3217197.3217202},
journal = {},
number = ,
volume = ,
place = {United States},
year = {2018},
month = {6}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: