skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Exascale Virtualized and Programmable Distributed Cyber Resource Control: Final Scientific Technical Report

Abstract

Extreme-science drives the need for distributed exascale processing and communications that are carefully, yet flexibly, managed. Exponential growth of data for scientific simulations, experimental data, collaborative data analyses, remote visualization and GRID computing requirements of scientists in fields as diverse as high energy physics, climate change, genomics, fusion, synchrotron radiation, material science, medicine, and other scientific disciplines cannot be accommodated by simply applying existing transport protocols to faster pipes. Further, scientific challenges today demand diverse research teams, heightening the need for and increasing the complexity of collaboration. To address these issues within the network layer and physical layer, we have performed a number of research activities surrounding effective allocation and management of elastic optical network (EON) resources, particularly focusing on FlexGrid transponders. FlexGrid transponders support the opportunity to build Layer-1 connections at a wide range of bandwidths and to reconfigure them rapidly. The new flexibility supports complex new ways of using the physical layer that must be carefully managed and hidden from the scientist end-users. FlexGrid networks utilize flexible (or elastic) spectral bandwidths for each data link without using fixed wavelength grids. The flexibility in spectrum allocation brings many appealing features to network operations. Current networks are designed for themore » worst case impairments in transmission performance and the assigned spectrum is over-provisioned. In contrast, the FlexGrid networks can operate with the highest spectral efficiency and minimum bandwidth for the given traffic demand while meeting the minimum quality of transmission (QoT) requirement. Two primary focuses of our research are: (1) resource and spectrum allocation (RSA) for IP traffic over EONs, and (2) RSA for cross-domain optical networks. Previous work concentrates primarily on large file transfers within a single domain. Adding support for IP traffic changes the nature of the RSA problem: instead of choosing to accept or deny each request for network support, IP traffic is inherently elastic and thus lends itself to a bandwidth maximization formulation. We developed a number of algorithms that could be easily deployed within existing and new FlexGrid networks, leading to networks that better support scientific collaboration. Cross-domain RSA research is essential to support large-scale FlexGrid networks, since configuration information is generally not shared or coordinated across domains. The results presented here are in their early stages. They are technically feasible and practical, but still require coordination among organizations and equipment owners and a higher-layer framework for managing network requests.« less

Authors:
 [1];  [2]
  1. Univ. of California, Davis, CA (United States)
  2. Raytheon BBN Technologies, Minneapolis, MN (United States)
Publication Date:
Research Org.:
Univ. of California, Davis, CA (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)
OSTI Identifier:
1333871
Report Number(s):
DoE-UCDavis-10727
DOE Contract Number:  
SC0010727
Resource Type:
Technical Report
Country of Publication:
United States
Language:
English
Subject:
42 ENGINEERING; 97 MATHEMATICS AND COMPUTING; elastic optical networks; exascale applications; software defined networks

Citation Formats

Yoo, S.J.Ben, and Lauer, Gregory S. Exascale Virtualized and Programmable Distributed Cyber Resource Control: Final Scientific Technical Report. United States: N. p., 2016. Web. doi:10.2172/1333871.
Yoo, S.J.Ben, & Lauer, Gregory S. Exascale Virtualized and Programmable Distributed Cyber Resource Control: Final Scientific Technical Report. United States. doi:10.2172/1333871.
Yoo, S.J.Ben, and Lauer, Gregory S. Fri . "Exascale Virtualized and Programmable Distributed Cyber Resource Control: Final Scientific Technical Report". United States. doi:10.2172/1333871. https://www.osti.gov/servlets/purl/1333871.
@article{osti_1333871,
title = {Exascale Virtualized and Programmable Distributed Cyber Resource Control: Final Scientific Technical Report},
author = {Yoo, S.J.Ben and Lauer, Gregory S.},
abstractNote = {Extreme-science drives the need for distributed exascale processing and communications that are carefully, yet flexibly, managed. Exponential growth of data for scientific simulations, experimental data, collaborative data analyses, remote visualization and GRID computing requirements of scientists in fields as diverse as high energy physics, climate change, genomics, fusion, synchrotron radiation, material science, medicine, and other scientific disciplines cannot be accommodated by simply applying existing transport protocols to faster pipes. Further, scientific challenges today demand diverse research teams, heightening the need for and increasing the complexity of collaboration. To address these issues within the network layer and physical layer, we have performed a number of research activities surrounding effective allocation and management of elastic optical network (EON) resources, particularly focusing on FlexGrid transponders. FlexGrid transponders support the opportunity to build Layer-1 connections at a wide range of bandwidths and to reconfigure them rapidly. The new flexibility supports complex new ways of using the physical layer that must be carefully managed and hidden from the scientist end-users. FlexGrid networks utilize flexible (or elastic) spectral bandwidths for each data link without using fixed wavelength grids. The flexibility in spectrum allocation brings many appealing features to network operations. Current networks are designed for the worst case impairments in transmission performance and the assigned spectrum is over-provisioned. In contrast, the FlexGrid networks can operate with the highest spectral efficiency and minimum bandwidth for the given traffic demand while meeting the minimum quality of transmission (QoT) requirement. Two primary focuses of our research are: (1) resource and spectrum allocation (RSA) for IP traffic over EONs, and (2) RSA for cross-domain optical networks. Previous work concentrates primarily on large file transfers within a single domain. Adding support for IP traffic changes the nature of the RSA problem: instead of choosing to accept or deny each request for network support, IP traffic is inherently elastic and thus lends itself to a bandwidth maximization formulation. We developed a number of algorithms that could be easily deployed within existing and new FlexGrid networks, leading to networks that better support scientific collaboration. Cross-domain RSA research is essential to support large-scale FlexGrid networks, since configuration information is generally not shared or coordinated across domains. The results presented here are in their early stages. They are technically feasible and practical, but still require coordination among organizations and equipment owners and a higher-layer framework for managing network requests.},
doi = {10.2172/1333871},
journal = {},
number = ,
volume = ,
place = {United States},
year = {2016},
month = {9}
}

Works referenced in this record:

Incentive-Driven Bidding Strategy for Brokers to Compete for Service Provisioning Tasks in Multi-Domain SD-EONs
journal, August 2016

  • Chen, Xiaoliang; Zhu, Zuqing; Sun, Lu
  • Journal of Lightwave Technology, Vol. 34, Issue 16
  • DOI: 10.1109/JLT.2016.2586141

Brokered Orchestration for End-to-End Service Provisioning Across Heterogeneous Multi-Operator (Multi-AS) Optical Networks
journal, December 2016

  • Castro, Alberto; Velasco, Luis; Gifre, Lluis
  • Journal of Lightwave Technology, Vol. 34, Issue 23
  • DOI: 10.1109/JLT.2016.2610964

Demonstration of Cooperative Resource Allocation in an OpenFlow-Controlled Multidomain and Multinational SD-EON Testbed
journal, April 2015

  • Zhu, Zuqing; Chen, Cen; Chen, Xiaoliang
  • Journal of Lightwave Technology, Vol. 33, Issue 8
  • DOI: 10.1109/JLT.2015.2389526

Elastic Optical Networking by Dynamic Optical Arbitrary Waveform Generation and Measurement
journal, January 2016

  • Proietti, Roberto; Qin, Chuan; Guan, Binbin
  • Journal of Optical Communications and Networking, Vol. 8, Issue 7
  • DOI: 10.1364/JOCN.8.00A171