skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A Data Analysis Framework for Earth System Simulation within an In-Situ Infrastructure

Journal Article · · Journal of Computer and Communications
ORCiD logo [1];  [2]; ORCiD logo [1]; ORCiD logo [3]
  1. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Environmental Science Division
  2. Univ. of Tennessee, Knoxville, TN (United States). Dept. of Computer Science and Electric Engineering
  3. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Computer Science and Mathematics Division

This paper presents a generic procedure to implement a scalable and high performance data analysis framework for large-scale scientific simulation within an in-situ infrastructure. It demonstrates a unique capability for global Earth system simulations using advanced computing technologies (i.e ., automated code analysis and instrumentation), in-situ infrastructure (i.e ., ADIOS) and big data analysis engines (i.e ., SciKit-learn). This paper also includes a useful case that analyzes a globe Earth System simulations with the integration of scalable in-situ infrastructure and advanced data processing package. Finally, the in-situ data analysis framework can provides new insights on scientific discoveries in multiscale modeling paradigms.

Research Organization:
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
Sponsoring Organization:
USDOE Office of Science (SC), Biological and Environmental Research (BER)
Grant/Contract Number:
AC05-00OR22725
OSTI ID:
1463975
Journal Information:
Journal of Computer and Communications, Vol. 5, Issue 14; ISSN 2327-5219
Publisher:
Scientific Research Publishing, Inc.Copyright Statement
Country of Publication:
United States
Language:
English

Figures / Tables (5)