A Data Analysis Framework for Earth System Simulation within an In-Situ Infrastructure
- Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Environmental Science Division
- Univ. of Tennessee, Knoxville, TN (United States). Dept. of Computer Science and Electric Engineering
- Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Computer Science and Mathematics Division
This paper presents a generic procedure to implement a scalable and high performance data analysis framework for large-scale scientific simulation within an in-situ infrastructure. It demonstrates a unique capability for global Earth system simulations using advanced computing technologies (i.e ., automated code analysis and instrumentation), in-situ infrastructure (i.e ., ADIOS) and big data analysis engines (i.e ., SciKit-learn). This paper also includes a useful case that analyzes a globe Earth System simulations with the integration of scalable in-situ infrastructure and advanced data processing package. Finally, the in-situ data analysis framework can provides new insights on scientific discoveries in multiscale modeling paradigms.
- Research Organization:
- Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
- Sponsoring Organization:
- USDOE Office of Science (SC), Biological and Environmental Research (BER)
- Grant/Contract Number:
- AC05-00OR22725
- OSTI ID:
- 1463975
- Journal Information:
- Journal of Computer and Communications, Vol. 5, Issue 14; ISSN 2327-5219
- Publisher:
- Scientific Research Publishing, Inc.Copyright Statement
- Country of Publication:
- United States
- Language:
- English
Similar Records
Enhancing the Earth System Grid Authentication Infrastructure through Single Sign-On and Autoprovisioning
Utilizing rare earth elements as tracers in high TDS reservoir brines in CCS applications