skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Software Defined Cyberinfrastructure

Abstract

Within and across thousands of science labs, researchers and students struggle to manage data produced in experiments, simulations, and analyses. Largely manual research data lifecycle management processes mean that much time is wasted, research results are often irreproducible, and data sharing and reuse remain rare. In response, we propose a new approach to data lifecycle management in which researchers are empowered to define the actions to be performed at individual storage systems when data are created or modified: actions such as analysis, transformation, copying, and publication. We term this approach software-defined cyberinfrastructure because users can implement powerful data management policies by deploying rules to local storage systems, much as software-defined networking allows users to configure networks by deploying rules to switches.We argue that this approach can enable a new class of responsive distributed storage infrastructure that will accelerate research innovation by allowing any researcher to associate data workflows with data sources, whether local or remote, for such purposes as data ingest, characterization, indexing, and sharing. We report on early experiments with this approach in the context of experimental science, in which a simple if-trigger-then-action (IFTA) notation is used to define rules.

Authors:
; ; ;
Publication Date:
Research Org.:
Argonne National Lab. (ANL), Argonne, IL (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Basic Energy Sciences (BES) (SC-22)
OSTI Identifier:
1393831
DOE Contract Number:
AC02-06CH11357
Resource Type:
Conference
Resource Relation:
Conference: 37th IEEE International Conference on Distributed Computing Systems, 06/05/17 - 06/08/17, Atlanta, GA, US
Country of Publication:
United States
Language:
English

Citation Formats

Foster, Ian, Blaiszik, Ben, Chard, Kyle, and Chard, Ryan. Software Defined Cyberinfrastructure. United States: N. p., 2017. Web. doi:10.1109/ICDCS.2017.333.
Foster, Ian, Blaiszik, Ben, Chard, Kyle, & Chard, Ryan. Software Defined Cyberinfrastructure. United States. doi:10.1109/ICDCS.2017.333.
Foster, Ian, Blaiszik, Ben, Chard, Kyle, and Chard, Ryan. Mon . "Software Defined Cyberinfrastructure". United States. doi:10.1109/ICDCS.2017.333.
@article{osti_1393831,
title = {Software Defined Cyberinfrastructure},
author = {Foster, Ian and Blaiszik, Ben and Chard, Kyle and Chard, Ryan},
abstractNote = {Within and across thousands of science labs, researchers and students struggle to manage data produced in experiments, simulations, and analyses. Largely manual research data lifecycle management processes mean that much time is wasted, research results are often irreproducible, and data sharing and reuse remain rare. In response, we propose a new approach to data lifecycle management in which researchers are empowered to define the actions to be performed at individual storage systems when data are created or modified: actions such as analysis, transformation, copying, and publication. We term this approach software-defined cyberinfrastructure because users can implement powerful data management policies by deploying rules to local storage systems, much as software-defined networking allows users to configure networks by deploying rules to switches.We argue that this approach can enable a new class of responsive distributed storage infrastructure that will accelerate research innovation by allowing any researcher to associate data workflows with data sources, whether local or remote, for such purposes as data ingest, characterization, indexing, and sharing. We report on early experiments with this approach in the context of experimental science, in which a simple if-trigger-then-action (IFTA) notation is used to define rules.},
doi = {10.1109/ICDCS.2017.333},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Mon Jul 17 00:00:00 EDT 2017},
month = {Mon Jul 17 00:00:00 EDT 2017}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: