Enabling distributed petascale science.

Conference · Mon Jan 01 00:00:00 EST 2007 · J. Phys.: Conf. Ser.

DOI:https://doi.org/10.1088/1742-6596/78/1/012020· OSTI ID:973002

Baranovski, A; Bharathi, S; Bresnahan, J; chervenak, A; Foster, I; Fraser, D; Freeman, T; Gunter, D; Jackson, K; Keahey, K; Kesselman, C; Konerding, D E; Leroy, N; Link, M; Livny, M; Miller, N; Miller, R; Oleynik, G; Pearlman, L; Schopf, J M ; Schuler, R; Tierney, B; FNL,; LBNL,

Petascale science is an end-to-end endeavour, involving not only the creation of massive datasets at supercomputers or experimental facilities, but the subsequent analysis of that data by a user community that may be distributed across many laboratories and universities. The new SciDAC Center for Enabling Distributed Petascale Science (CEDPS) is developing tools to support this end-to-end process. These tools include data placement services for the reliable, high-performance, secure, and policy-driven placement of data within a distributed science environment; tools and techniques for the construction, operation, and provisioning of scalable science services; and tools for the detection and diagnosis of failures in end-to-end data placement and distributed application hosting configurations. In each area, we build on a strong base of existing technology and have made useful progress in the first year of the project. For example, we have recently achieved order-of-magnitude improvements in transfer times (for lots of small files) and implemented asynchronous data staging capabilities; demonstrated dynamic deployment of complex application stacks for the STAR experiment; and designed and deployed end-to-end troubleshooting services. We look forward to working with SciDAC application and technology projects to realize the promise of petascale science.

• Research Organization: Argonne National Lab. (ANL), Argonne, IL (United States)
• Sponsoring Organization: USDOE Office of Science (SC)
• DOE Contract Number: DE-AC02-06CH11357
• OSTI ID: 973002
• Report Number(s): ANL/MCS/CP-59797; TRN: US201005%%399
• Journal Information: J. Phys.: Conf. Ser., Vol. 78, Issue 2007; Conference: Scientific Discovery through Advanced Computing (SciDAC 2007); Jun. 24, 2007 - Jun. 26, 2007; Boston, MA
• Country of Publication: United States
• Language: ENGLISH

Related Subjects

97 MATHEMATICAL METHODS AND COMPUTING
99 GENERAL AND MISCELLANEOUS//MATHEMATICS, COMPUTING, AND INFORMATION SCIENCE
SUPERCOMPUTERS
SIZE
DATA ANALYSIS
PARALLEL PROCESSING
DATA TRANSMISSION
PERFORMANCE