Framework for Interactive Parallel Dataset Analysis on the Grid
Conference
·
OSTI ID:897459
We present a framework for use at a typical Grid site to facilitate custom interactive parallel dataset analysis targeting terabyte-scale datasets of the type typically produced by large multi-institutional science experiments. We summarize the needs for interactive analysis and show a prototype solution that satisfies those needs. The solution consists of desktop client tool and a set of Web Services that allow scientists to sign onto a Grid site, compose analysis script code to carry out physics analysis on datasets, distribute the code and datasets to worker nodes, collect the results back to the client, and to construct professional-quality visualizations of the results.
- Research Organization:
- SLAC National Accelerator Lab., Menlo Park, CA (United States)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC02-76SF00515
- OSTI ID:
- 897459
- Report Number(s):
- SLAC-PUB-12289; TRN: US200705%%330
- Resource Relation:
- Conference: To appear in the proceedings of 2006 International Conference on Parallel Processing Workshops (ICPPW 06), Columbus, Ohio, 14-18 Aug 2006
- Country of Publication:
- United States
- Language:
- English
Similar Records
Using Pilot Jobs and CernVM File System for Simplified Use of Containers and Software Distribution
Constructing Collaborative Desktop Storage Caches for Large Scientific Datasets
Incident Management Preparedness and Coordination Toolkit
Conference
·
Fri Jan 01 00:00:00 EST 2021
· TBD
·
OSTI ID:897459
Constructing Collaborative Desktop Storage Caches for Large Scientific Datasets
Journal Article
·
Tue Aug 01 00:00:00 EDT 2006
· ACM Transactions on Storage
·
OSTI ID:897459
+4 more
Incident Management Preparedness and Coordination Toolkit
Software
·
Mon Apr 01 00:00:00 EDT 2013
·
OSTI ID:897459