Provenance management in Swift with implementation details.
- Mathematics and Computer Science
The Swift parallel scripting language allows for the specification, execution and analysis of large-scale computations in parallel and distributed environments. It incorporates a data model for recording and querying provenance information. In this article we describe these capabilities and evaluate interoperability with other systems through the use of the Open Provenance Model. We describe Swift's provenance data model and compare it to the Open Provenance Model. We also describe and evaluate activities performed within the Third Provenance Challenge, which consisted of implementing a specific scientific workflow, capturing and recording provenance information of its execution, performing provenance queries, and exchanging provenance information with other systems. Finally, we propose improvements to both the Open Provenance Model and Swift's provenance system.
- Research Organization:
- Argonne National Laboratory (ANL)
- Sponsoring Organization:
- SC; CAPES; CNPq
- DOE Contract Number:
- AC02-06CH11357
- OSTI ID:
- 1011306
- Report Number(s):
- ANL/MCS-TM-311
- Country of Publication:
- United States
- Language:
- ENGLISH
Similar Records
Provenance Storage, Querying, and Visualization in PBase
Managing genomic variant calling workflows with Swift/T
Applying Content Management to Automated Provenance Capture
Conference
·
Wed Dec 31 23:00:00 EST 2014
·
OSTI ID:1335323
Managing genomic variant calling workflows with Swift/T
Journal Article
·
Mon Jul 08 20:00:00 EDT 2019
· PLoS ONE
·
OSTI ID:1627877
Applying Content Management to Automated Provenance Capture
Journal Article
·
Thu Apr 10 00:00:00 EDT 2008
· Concurrency and Computation. Practice & Experience, 20(5):541-554
·
OSTI ID:927710