IO strategies and data services for petascale data sets from a global cloud resolving model
Global cloud resolving models at 4km resolutions or less create significant challenges in generation of simulation data, data storage, data management, and post-simulation analysis and visualization. To support efficient model output as well as data analysis, new models for IO and data organization must be evaluated. The model we are supporting, the Global Cloud Resolving Model being developed at Colorado State University, uses a geodesic grid. The non-monotonic nature of the grid's coordinate variables requires enhancements to existing data processing tools and community standards for describing and manipulating grids. The resolution, size and extent of the data suggest the need for parallel analysis tools and allow for the possibility of new techniques in data mining, filtering and comparison to observations. We describe the challenges posed by various aspects of data generation, management, and analysis, our work exploring IO strategies for the model, and a preliminary architecture, web portal, and tool enhancements which, when complete, will enable broad community access to the data sets in a way that is familiar to the community.
- Research Organization:
- Pacific Northwest National Lab. (PNNL), Richland, WA (United States). Environmental Molecular Sciences Lab. (EMSL)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC05-76RL01830
- OSTI ID:
- 921404
- Report Number(s):
- PNNL-SA-55926; 24094; 25621; KJ0101030; TRN: US200804%%733
- Journal Information:
- Journal of Physics: Conference Series, 78:Art. No. 012089, Vol. 78
- Country of Publication:
- United States
- Language:
- English
Similar Records
Study of Multi-Scale Cloud Processes Over the Tropical Western Pacific Using Cloud-Resolving Models Constrained by Satellite Data
Hawaii Utility Integration Initiatives to Enable Wind (Wind HUI) Final Technical Report