Working Group on Virtual Data Integration

Technical Report · Thu Feb 04 04:00:00 EST 2016

DOI:https://doi.org/10.2172/1239196· OSTI ID:1239196

Williams, D. N. ^[1]; Palanisamy, G. ^[1]; van Dam, K. K. ^[1]

---

1. Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)

This report is the outcome of a workshop commissioned by the U.S. Department of Energy’s (DOE) Climate and Environmental Sciences Division (CESD) to examine current and future data infrastructure requirements foundational for achieving CESD scientific mission goals in advancing a robust, predictive understanding of Earth’s climate and environmental systems. Over the past several years, data volumes in CESD disciplines have risen sharply to unprecedented levels (tens of petabytes). Moreover, the complexity and diversity of this research data— including simulations, observations, and reanalysis— have grown significantly, posing new challenges for data capture, storage, verification, analysis, and integration. With the trends of increased data volume (in the hundreds of petabytes), more complex analysis processes, and growing cross-disciplinary collaborations, it is timely to investigate whether the CESD community has the computational and data support needed to fully realize the scientific potential of its data collections. In recognition of the challenges, a partnership is forming across CESD and among national and international agencies to examine the viability of creating an integrated, collaborative data infrastructure: a Virtual Laboratory. The overarching goal of this report is to identify the community’s key data technology requirements and high-priority development needs for sustaining and growing its scientific discovery potential. The report also aims to map these requirements to existing solutions and to identify gaps in current services, tools, and infrastructure that will need to be addressed in the short, medium, and long term to advance scientific progress.

• Research Organization: Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
• Sponsoring Organization: USDOE
• DOE Contract Number: AC52-07NA27344
• OSTI ID: 1239196
• Report Number(s): LLNL--TR-678127-REV-1
• Country of Publication: United States
• Language: English

Related Subjects

54 ENVIRONMENTAL SCIENCES
58 GEOSCIENCES
97 MATHEMATICS AND COMPUTING