Storage Systems and Input/Output: Organizing, Storing, and Accessing Data for Scientific Discovery. Report for the DOE ASCR Workshop on Storage Systems and I/O. [Full Workshop Report]

Ross, Robert; Ward, Lee; Carns, Philip; Grider, Gary; Klasky, Scott; Koziol, Quincey; Lockwood, Glenn K.; Mohror, Kathryn; Settlemyer, Bradley; Wolf, Matthew

doi:10.2172/1491994

Title: Storage Systems and Input/Output: Organizing, Storing, and Accessing Data for Scientific Discovery. Report for the DOE ASCR Workshop on Storage Systems and I/O. [Full Workshop Report]

Abstract

In September, 2018, the Department of Energy, Office of Science, Advanced Scientific Computing Research Program convened a workshop to identify key challenges and define research directions that will advance the field of storage systems and I/O over the next 5–7 years. The workshop concluded that addressing these combined challenges and opportunities requires tools and techniques that greatly extend traditional approaches and require new research directions. Key research opportunities were identified.

Authors:

Ross, Robert ^[1]; Ward, Lee ^[2]; Carns, Philip ^[1]; Grider, Gary ^[3]; Klasky, Scott ^[4]; Koziol, Quincey ^[5]; Lockwood, Glenn K. ^[5]; Mohror, Kathryn ^[6]; Settlemyer, Bradley ^[3]; Wolf, Matthew ^[4]

Argonne National Lab. (ANL), Argonne, IL (United States)
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)

Publication Date:: 2018-09-19

Research Org.:: USDOE Office of Science (SC) (United States)

Sponsoring Org.:: USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)

OSTI Identifier:: 1491994

Resource Type:: Technical Report

Resource Relation:: Conference: Storage Systems and I/O: Organizing, Storing, and Accessing Data for Scientific Discovery, Gaithersburg, MD, 19-20 Sep 2018

Country of Publication:: United States

Language:: English

Subject:: 97 MATHEMATICS AND COMPUTING

Citation Formats


                    Ross, Robert, Ward, Lee, Carns, Philip, Grider, Gary, Klasky, Scott, Koziol, Quincey, Lockwood, Glenn K., Mohror, Kathryn, Settlemyer, Bradley, and Wolf, Matthew. Storage Systems and Input/Output: Organizing, Storing, and Accessing Data for Scientific Discovery. Report for the DOE ASCR Workshop on Storage Systems and I/O. [Full Workshop Report].  United States: N. p., 2018. 
        Web.  doi:10.2172/1491994.

Copy to clipboard


                    Ross, Robert, Ward, Lee, Carns, Philip, Grider, Gary, Klasky, Scott, Koziol, Quincey, Lockwood, Glenn K., Mohror, Kathryn, Settlemyer, Bradley, & Wolf, Matthew. Storage Systems and Input/Output: Organizing, Storing, and Accessing Data for Scientific Discovery. Report for the DOE ASCR Workshop on Storage Systems and I/O. [Full Workshop Report].  United States.  https://doi.org/10.2172/1491994

Copy to clipboard


                    Ross, Robert, Ward, Lee, Carns, Philip, Grider, Gary, Klasky, Scott, Koziol, Quincey, Lockwood, Glenn K., Mohror, Kathryn, Settlemyer, Bradley, and Wolf, Matthew. 2018.  
        "Storage Systems and Input/Output: Organizing, Storing, and Accessing Data for Scientific Discovery. Report for the DOE ASCR Workshop on Storage Systems and I/O. [Full Workshop Report]".  United States.  https://doi.org/10.2172/1491994.  https://www.osti.gov/servlets/purl/1491994.

Copy to clipboard


                    
@article{osti_1491994,

  title        = {Storage Systems and Input/Output: Organizing, Storing, and Accessing Data for Scientific Discovery. Report for the DOE ASCR Workshop on Storage Systems and I/O. [Full Workshop Report]},

  author       = {Ross, Robert and Ward, Lee and Carns, Philip and Grider, Gary and Klasky, Scott and Koziol, Quincey and Lockwood, Glenn K. and Mohror, Kathryn and Settlemyer, Bradley and Wolf, Matthew},

  abstractNote = {In September, 2018, the Department of Energy, Office of Science, Advanced Scientific Computing Research Program convened a workshop to identify key challenges and define research directions that will advance the field of storage systems and I/O over the next 5–7 years. The workshop concluded that addressing these combined challenges and opportunities requires tools and techniques that greatly extend traditional approaches and require new research directions. Key research opportunities were identified.},

  doi          = {10.2172/1491994},

  url          = {https://www.osti.gov/biblio/1491994},
  journal      = {},
number       = ,

  volume       = ,

  place        = {United States},

  year         = {2018},

  month        = {9}

}

Copy to clipboard

Technical Report:

View Technical Report (1.77 MB)

https://doi.org/10.2172/1491994

Save / Share:

Export Metadata

Save to My Library

Works referenced in this record:

Reducing I/O variability using dynamic I/O path characterization in petascale storage systems
journal, November 2016

Son, Seung Woo; Sehrish, Saba; Liao, Wei-keng
The Journal of Supercomputing, Vol. 73, Issue 5, p. 2069-2097
https://doi.org/10.1007/s11227-016-1904-7

The design and realisation of the $^{my}$Experiment Virtual Research Environment for social sharing of workflows
journal, May 2009

De Roure, David; Goble, Carole; Stevens, Robert
Future Generation Computer Systems, Vol. 25, Issue 5, p. 561-567
https://doi.org/10.1016/j.future.2008.06.010

Simulating parallel programs on application and system level
journal, May 2012

Kunkel, Julian M.
Computer Science - Research and Development, Vol. 28, Issue 2-3, p. 167-174
https://doi.org/10.1007/s00450-012-0208-2

Examining extended and scientific metadata for scalable index designs
conference, January 2013

Parker-Wood, Aleatha; Long, Darrell D. E.; Madden, Brian A.
Proceedings of the 6th International Systems and Storage Conference on - SYSTOR '13, Article No. 4
https://doi.org/10.1145/2485732.2485754

Active disks for large-scale data processing
journal, June 2001

Riedel, E.; Faloutsos, C.; Gibson, G.A.
Computer, Vol. 34, Issue 6, p. 68-74
https://doi.org/10.1109/2.928624

Similar records in OSTI.GOV collections:

Storage Systems and Input/Output: Organizing, Storing, and Accessing Data for Scientific Discovery. Report for the DOE ASCR Workshop on Storage Systems and I/O. [Summary Brief]

Technical Report Ross, Robert; Ward, Lee; Carns, Philip; ...

In September, 2018, the Department of Energy, Office of Science, Advanced Scientific Computing Research Program convened a workshop to identify key challenges and define research directions that will advance the field of storage systems and I/O over the next 5-7 years.The workshop concluded that addressing these combined challenges and opportunities requires tools and techniques that greatly extend traditional approaches and require new research directions. Key research opportunities were identified. This summary brief highlights three areas: The Impact of Storage and I/O, Research Opportunities, and, A new and productive Storage and I/O Environment. The full report from the workshop can bemore » viewed at DOI: 10.2172/1491994.« less
https://doi.org/10.2172/1544750

Full Text Available
Extreme Heterogeneity 2018: Productive Computational Science in the Era of Extreme Heterogeneity Report for DOE ASCR Basic Research Needs Workshop on Extreme Heterogeneity January 23–25, 2018

Technical Report Vetter, Jeffrey; Brightwell, Ron; Gokhale, Maya; ...

Providing a software environment that can overcome the complexities of changes in how future supercomputers will be designed plays a key role in improving the nation’s rate of scientific discovery and innovation. In the past three decades, advances in computer technology have allowed the performance and functionality of processors to double every 2 years. This trend, known as Moore’s Law, has enabled both computational and experimental science to leverage the so far unending growth of the broad computing industry with very little change to the supporting software environment. But as computer chip manufacturing techniques reach the limits of the atomicmore »« less
https://doi.org/10.2172/1473756

Full Text Available
ASCR Workshop on In Situ Data Management: Enabling Scientific Discovery from Diverse Data Sources

Technical Report Peterka, Tom; Bard, Deborah; Bennett, Janine; ...

In January 2019, the U.S. Department of Energy, Office of Science program in Advanced Scientific Computing Research, convened a workshop to identify priority research directions for in situ data management (ISDM). The workshop defined ISDM as the practices, capabilities, and procedures to control the organization of data and enable the coordination and communication among heterogeneous tasks, executing simultaneously in a high-performance computing system, cooperating toward a common objective. The workshop revealed two primary, interdependent motivations for processing and managing data in situ. The first motivation is that the in situ methodology enables scientific discovery from a broad range of datamore »« less
https://doi.org/10.2172/1493245

Full Text Available
Extreme Heterogeneity 2018 - Productive Computational Science in the Era of Extreme Heterogeneity: Report for DOE ASCR Workshop on Extreme Heterogeneity

Technical Report Vetter, Jeffrey; Brightwell, Ron; Gokhale, Maya; ...

The 2018 Basic Research Needs Workshop on Extreme Heterogeneity identified five Priority Research Directions for realizing the capabilities needed to address the challenges posed in this era of rapid technological change. This report captures the outcomes of that workshop. In the context of extreme heterogeneity, it defines basic research needs and opportunities in computer science research to develop smart and trainable operating and runtime systems, programming environments, and predictive tools that will make future systems easier to adapt to scientists’ computing needs and easier for facilities to deploy securely.
https://doi.org/10.2172/1473756

Full Text Available
Frontiers in Soil Science Research: Report of a Workshop

Other

Referred to as Earth’s living skin, soil provides support for both natural and human systems. Soil is a biogeochemically dynamic natural resource that supports all critical components of ecosystems. There has been renewed interest in soil and soil science in recent years because of its role in global climate change, land degradation and remediation, the fate and transport of nutrients and contaminants, soil and water conservation, soil and water quality, food sufficiency and safety, global carrying capacity, wetlands function, and many other issues pertinent to the stewardship and conservation of land and water resources. Despite this attention, soil remains anmore »« less

Similar Records
Related Works
report (1)

Title: Storage Systems and Input/Output: Organizing, Storing, and Accessing Data for Scientific Discovery. Report for the DOE ASCR Workshop on Storage Systems and I/O. [Full Workshop Report]

Abstract

Citation Formats

Reducing I/O variability using dynamic I/O path characterization in petascale storage systems journal, November 2016

The design and realisation of the $^{my}$Experiment Virtual Research Environment for social sharing of workflows journal, May 2009

Simulating parallel programs on application and system level journal, May 2012

Examining extended and scientific metadata for scalable index designs conference, January 2013

Active disks for large-scale data processing journal, June 2001

Reducing I/O variability using dynamic I/O path characterization in petascale storage systems
journal, November 2016

The design and realisation of the $^{my}$Experiment Virtual Research Environment for social sharing of workflows
journal, May 2009

Simulating parallel programs on application and system level
journal, May 2012

Examining extended and scientific metadata for scalable index designs
conference, January 2013

Active disks for large-scale data processing
journal, June 2001