Virtual Environment for Testing Software-Defined Networking Solutions for Scientific Workflows
Recent developments in software-defined infrastructures promise that scientific workflows utilizing supercomputers, instruments, and storage systems will be dynamically composed and orchestrated using software at unprecedented speed and scale in the near future. Testing of the underlying networking software, particularly during initial exploratory stages, remains a challenge due to potential disruptions, and resource allocation and coordination needed over the multi-domain physical infrastructure. To overcome these challenges, we develop the Virtual Science Network Environment (VSNE) that emulates the multi-site host, storage, and network infrastructure using Virtual Machines (VMs), wherein the production and nascent software can be tested. Within each VM, which represents a site, the hosts and local-area networks are emulated using Mininet, and the Software-Defined Network (SDN) controllers and service daemon codes are natively run to support dynamic provisioning of network connections. Additionally, Lustre filesystem support at the sites and an emulation of the long-haul network using Mininet, are provided using separate VMs. As case studies, we describe Lustre file transfers using XDD, Red5 streaming service demonstration, and an emulated experiment with remote monitoring and steering modules, all supported over dynamically configured connections using SDN controllers.
- Research Organization:
- Brookhaven National Lab. (BNL), Upton, NY (United States)
- Sponsoring Organization:
- USDOE Office of Science (SC), Advanced Scientific Computing Research (SC-21)
- DOE Contract Number:
- SC0012704
- OSTI ID:
- 1619257
- Report Number(s):
- BNL-209115-2018-PUCP
- Resource Relation:
- Conference: ACM HPDC 2018 (The 27th International Symposium on High-Performance Parallel and Distributed Computing), Tempe, AZ, 6/11/2018 - 6/15/2018
- Country of Publication:
- United States
- Language:
- English
Similar Records
Software-Defined Network Solutions for Science Scenarios: Performance Testing Framework and Measurements
So ware-Defined Network Solutions for Science Scenarios: Performance Testing Framework and Measurements