Pegasus, a workflow management system for science automation

Deelman, Ewa; Vahi, Karan; Juve, Gideon; Rynge, Mats; Callaghan, Scott; Maechling, Philip J.; Mayani, Rajiv; Chen, Weiwei; Ferreira da Silva, Rafael; Livny, Miron; Wenger, Kent

doi:10.1016/j.future.2014.10.008

Title: Pegasus, a workflow management system for science automation

Authors:

Deelman, Ewa; Vahi, Karan; Juve, Gideon; Rynge, Mats; Callaghan, Scott; Maechling, Philip J.; Mayani, Rajiv; Chen, Weiwei;

;

; Wenger, Kent

Publication Date:: Fri May 01 00:00:00 EDT 2015

Sponsoring Org.:: USDOE

OSTI Identifier:: 1245675

Resource Type:: Publisher's Accepted Manuscript

Journal Name:: Future Generations Computer Systems

Additional Journal Information:: Journal Name: Future Generations Computer Systems Journal Volume: 46 Journal Issue: C; Journal ID: ISSN 0167-739X

Publisher:: Elsevier

Country of Publication:: Netherlands

Language:: English

Citation Formats


                    Deelman, Ewa, Vahi, Karan, Juve, Gideon, Rynge, Mats, Callaghan, Scott, Maechling, Philip J., Mayani, Rajiv, Chen, Weiwei, Ferreira da Silva, Rafael, Livny, Miron, and Wenger, Kent. Pegasus, a workflow management system for science automation.  Netherlands: N. p., 2015. 
Web.  doi:10.1016/j.future.2014.10.008.

Copy to clipboard


                    Deelman, Ewa, Vahi, Karan, Juve, Gideon, Rynge, Mats, Callaghan, Scott, Maechling, Philip J., Mayani, Rajiv, Chen, Weiwei, Ferreira da Silva, Rafael, Livny, Miron, & Wenger, Kent. Pegasus, a workflow management system for science automation.  Netherlands.  https://doi.org/10.1016/j.future.2014.10.008

Copy to clipboard


                    Deelman, Ewa, Vahi, Karan, Juve, Gideon, Rynge, Mats, Callaghan, Scott, Maechling, Philip J., Mayani, Rajiv, Chen, Weiwei, Ferreira da Silva, Rafael, Livny, Miron, and Wenger, Kent. Fri .  
"Pegasus, a workflow management system for science automation".  Netherlands.  https://doi.org/10.1016/j.future.2014.10.008.

Copy to clipboard


                    
@article{osti_1245675,

  title        = {Pegasus, a workflow management system for science automation},

  author       = {Deelman, Ewa and Vahi, Karan and Juve, Gideon and Rynge, Mats and Callaghan, Scott and Maechling, Philip J. and Mayani, Rajiv and Chen, Weiwei and Ferreira da Silva, Rafael and Livny, Miron and Wenger, Kent},

  abstractNote = {},

  doi          = {10.1016/j.future.2014.10.008},

  journal      = {Future Generations Computer Systems},

  number       = C,

  volume       = 46,

  place        = {Netherlands},

  year         = {Fri May 01 00:00:00 EDT 2015},

  month        = {Fri May 01 00:00:00 EDT 2015}

}

Copy to clipboard

Journal Article:

Free Publicly Available Full Text

Accepted Manuscript (Publisher)

Publisher's Version of Record
https://doi.org/10.1016/j.future.2014.10.008

Other availability

Search WorldCat to find libraries that may hold this journal

Citation Metrics:

Cited by: 432 works

Citation information provided by
Web of Science

Save / Share:

Export Metadata

Save to My Library

Works referenced in this record:

The Application of Cloud Computing to Astronomy: A Study of Cost and Performance
conference, December 2010

Berriman, G. Bruce; Juve, Gideon; Deelman, Ewa
2010 Sixth IEEE International Conference on E-Science Workshops
DOI: 10.1109/eScienceW.2010.10

ASKALON: a Grid application development and computing environment
conference, January 2005

Fahringer, T.; Prodan, R.
The 6th IEEE/ACM International Workshop on Grid Computing, 2005.
DOI: 10.1109/GRID.2005.1542733

Makeflow: a portable abstraction for data intensive computing on clusters, clouds, and grids
conference, January 2012

Albrecht, Michael; Donnelly, Patrick; Bui, Peter
Proceedings of the 1st ACM SIGMOD Workshop on Scalable Workflow Execution Engines and Technologies - SWEET '12
DOI: 10.1145/2443416.2443417

On the granularity and clustering of directed acyclic task graphs
journal, June 1993

Gerasoulis, A.; Yang, T.
IEEE Transactions on Parallel and Distributed Systems, Vol. 4, Issue 6
DOI: 10.1109/71.242154

Parameter Exploration in Science and Engineering Using Many-Task Computing
journal, June 2011

Abramson, D.; Bethwaite, B.; Enticott, C.
IEEE Transactions on Parallel and Distributed Systems, Vol. 22, Issue 6
DOI: 10.1109/TPDS.2010.177

Query processing in a system for distributed databases (SDD-1)
journal, December 1981

Bernstein, Philip A.; Goodman, Nathan; Wong, Eugene
ACM Transactions on Database Systems, Vol. 6, Issue 4
DOI: 10.1145/319628.319650

Enabling large-scale scientific workflows on petascale resources using MPI master/worker
conference, January 2012

Rynge, Mats; Callaghan, Scott; Deelman, Ewa
Proceedings of the 1st Conference of the Extreme Science and Engineering Discovery Environment on Bridging from the eXtreme to the campus and beyond - XSEDE '12
DOI: 10.1145/2335755.2335846

Static scheduling algorithms for allocating directed task graphs to multiprocessors
journal, December 1999

Kwok, Yu-Kwong; Ahmad, Ishfaq
ACM Computing Surveys, Vol. 31, Issue 4
DOI: 10.1145/344588.344618

Tavaxy: Integrating Taverna and Galaxy workflows with cloud computing support
journal, May 2012

Abouelhoda, Mohamed; Issa, Shadi Alaa; Ghanem, Moustafa
BMC Bioinformatics, Vol. 13, Issue 1
DOI: 10.1186/1471-2105-13-77

A resource management architecture for metacomputing systems
book, January 1998

Czajkowski, Karl; Foster, Ian; Karonis, Nick
Job Scheduling Strategies for Parallel Processing
DOI: 10.1007/BFb0053981

Experiences Using GlideinWMS and the Corral Frontend across Cyberinfrastructures
conference, December 2011

Rynge, Mats; Juve, Gideon; Mehta, Gaurang
2011 IEEE 7th International Conference on E-Science (e-Science), 2011 IEEE Seventh International Conference on eScience
DOI: 10.1109/eScience.2011.50

Wings: Intelligent Workflow-Based Design of Computational Experiments
journal, January 2011

Gil, Yolanda; Ratnakar, Varun; Kim, Jihie
IEEE Intelligent Systems, Vol. 26, Issue 1
DOI: 10.1109/MIS.2010.9

Wide area data replication for scientific collaborations
conference, January 2005

Chervenak, A.; Schuler, R.; Kesselman, C.
The 6th IEEE/ACM International Workshop on Grid Computing, 2005.
DOI: 10.1109/GRID.2005.1542717

High-Throughput, Kingdom-Wide Prediction and Annotation of Bacterial Non-Coding RNAs
journal, September 2008

Livny, Jonathan; Teonadi, Hidayat; Livny, Miron
PLoS ONE, Vol. 3, Issue 9
DOI: 10.1371/journal.pone.0003197

Accessing opportunistic resources with Bosco
journal, June 2014

Weitzel, D.; Sfiligoi, I.; Bockelman, B.
Journal of Physics: Conference Series, Vol. 513, Issue 3
DOI: 10.1088/1742-6596/513/3/032105

Scaling up workflow-based applications
journal, September 2010

Callaghan, Scott; Deelman, Ewa; Gunter, Dan
Journal of Computer and System Sciences, Vol. 76, Issue 6
DOI: 10.1016/j.jcss.2009.11.005

A view of cloud computing
journal, April 2010

Armbrust, Michael; Stoica, Ion; Zaharia, Matei
Communications of the ACM, Vol. 53, Issue 4
DOI: 10.1145/1721654.1721672

Performance-effective and low-complexity task scheduling for heterogeneous computing
journal, March 2002

Topcuoglu, H.; Hariri, S.
IEEE Transactions on Parallel and Distributed Systems, Vol. 13, Issue 3, p. 260-274
DOI: 10.1109/71.993206

Provenance: The Bridge Between Experiments and Data
journal, May 2008

Miles, Simon; Groth, Paul; Deelman, Ewa
Computing in Science & Engineering, Vol. 10, Issue 3
DOI: 10.1109/MCSE.2008.82

Characterizing and profiling scientific workflows
journal, March 2013

Juve, Gideon; Chervenak, Ann; Deelman, Ewa
Future Generation Computer Systems, Vol. 29, Issue 3
DOI: 10.1016/j.future.2012.08.015

Workflows and e-Science: An overview of workflow system features and capabilities
journal, May 2009

Deelman, Ewa; Gannon, Dennis; Shields, Matthew
Future Generation Computer Systems, Vol. 25, Issue 5
DOI: 10.1016/j.future.2008.06.012

Workflow task clustering for best effort systems with Pegasus
conference, January 2008

Singh, Gurmeet; Su, Mei-Hui; Vahi, Karan
Proceedings of the 15th ACM Mardi Gras conference on From lightweight mash-ups to lambda grids: Understanding the spectrum of distributed computing requirements, applications, tools, infrastructures, interoperability, and the incremental adoption of key capabilities - MG '08
DOI: 10.1145/1341811.1341822

The Taverna workflow suite: designing and executing workflows of Web Services on the desktop, web or in the cloud
journal, May 2013

Wolstencroft, Katherine; Haines, Robert; Fellows, Donal
Nucleic Acids Research, Vol. 41, Issue W1
DOI: 10.1093/nar/gkt328

A Case Study into Using Common Real-Time Workflow Monitoring Infrastructure for Scientific Workflows
journal, June 2013

Vahi, Karan; Harvey, Ian; Samak, Taghrid
Journal of Grid Computing, Vol. 11, Issue 3
DOI: 10.1007/s10723-013-9265-4

The open science grid
journal, July 2007

Pordes, Ruth; Petravick, Don; Kramer, Bill
Journal of Physics: Conference Series, Vol. 78
DOI: 10.1088/1742-6596/78/1/012057

Hypertext Transfer Protocol -- HTTP/1.1
report, June 1999

Fielding, R.; Gettys, J.; Mogul, J.
DOI: 10.17487/rfc2616

Workflow overhead analysis and optimizations
conference, January 2011

Chen, Weiwei; Deelman, Ewa
Proceedings of the 6th workshop on Workflows in support of large-scale science - WORKS '11
DOI: 10.1145/2110497.2110500

A Taxonomy of Workflow Management Systems for Grid Computing
journal, September 2005

Yu, Jia; Buyya, Rajkumar
Journal of Grid Computing, Vol. 3, Issue 3-4
DOI: 10.1007/s10723-005-9010-8

Scheduling Data-IntensiveWorkflows onto Storage-Constrained Distributed Resources
conference, May 2007

Ramakrishnan, Arun; Singh, Gurmeet; Zhao, Henan
Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07)
DOI: 10.1109/CCGRID.2007.101

Rethinking data management for big data scientific workflows
conference, October 2013

Vahi, Karan; Rynge, Mats; Juve, Gideon
2013 IEEE International Conference on Big Data
DOI: 10.1109/BigData.2013.6691724

CyberShake: A Physics-Based Seismic Hazard Model for Southern California
journal, May 2010

Graves, Robert; Jordan, Thomas H.; Callaghan, Scott
Pure and Applied Geophysics, Vol. 168, Issue 3-4
DOI: 10.1007/s00024-010-0161-6

A Scalable Approach to Network Enabled Servers
book, January 2002

Caron, Eddy; Desprez, Frédéric; Lombard, Frédéric
Euro-Par 2002 Parallel Processing
DOI: 10.1007/3-540-45706-2_128

Balanced Task Clustering in Scientific Workflows
conference, October 2013

Chen, Weiwei; Silva, Rafael Ferreira Da; Deelman, Ewa
2013 IEEE 9th International Conference on eScience (eScience), 2013 IEEE 9th International Conference on e-Science
DOI: 10.1109/eScience.2013.40

glideinWMS—a generic pilot-based workload management system
journal, July 2008

Sfiligoi, I.
Journal of Physics: Conference Series, Vol. 119, Issue 6
DOI: 10.1088/1742-6596/119/6/062044

Apache airavata: a framework for distributed applications and computational workflows
conference, January 2011

Marru, Suresh; Gardler, Ross; Slominski, Aleksander
Proceedings of the 2011 ACM workshop on Gateway computing environments - GCE '11
DOI: 10.1145/2110486.2110490

Flexible and Efficient Workflow Deployment of Data-Intensive Applications On Grids With MOTEUR
journal, August 2008

Glatard, Tristan; Montagnat, Johan; Lingrand, Diane
The International Journal of High Performance Computing Applications, Vol. 22, Issue 3
DOI: 10.1177/1094342008096067

The Secure Shell (SSH) Connection Protocol
report, January 2006

Ylonen, T.; Lonvick, C.
DOI: 10.17487/rfc4254

Toward fine-grained online task characteristics estimation in scientific workflows
conference, January 2013

da Silva, Rafael Ferreira; Juve, Gideon; Deelman, Ewa
Proceedings of the 8th Workshop on Workflows in Support of Large-Scale Science - WORKS '13
DOI: 10.1145/2534248.2534254

Distributed computing in practice: the Condor experience
journal, January 2005

Thain, Douglas; Tannenbaum, Todd; Livny, Miron
Concurrency and Computation: Practice and Experience, Vol. 17, Issue 2-4, p. 323-356
DOI: 10.1002/cpe.938

Connecting Scientific Data to Scientific Experiments with Provenance
conference, December 2007

Miles, Simon; Deelman, Ewa; Groth, Paul
Third IEEE International Conference on e-Science and Grid Computing (e-Science 2007)
DOI: 10.1109/E-SCIENCE.2007.22

The Open Provenance Model core specification (v1.1)
journal, June 2011

Moreau, Luc; Clifford, Ben; Freire, Juliana
Future Generation Computer Systems, Vol. 27, Issue 6
DOI: 10.1016/j.future.2010.07.005

Dependence graphs and compiler optimizations
conference, January 1981

Kuck, D. J.; Kuhn, R. H.; Padua, D. A.
Proceedings of the 8th ACM SIGPLAN-SIGACT symposium on Principles of programming languages - POPL '81
DOI: 10.1145/567532.567555

The Anatomy of the Grid: Enabling Scalable Virtual Organizations
journal, August 2001

Foster, Ian; Kesselman, Carl; Tuecke, Steven
The International Journal of High Performance Computing Applications, Vol. 15, Issue 3
DOI: 10.1177/109434200101500302

Using imbalance metrics to optimize task clustering in scientific workflow executions
journal, May 2015

Chen, Weiwei; Ferreira da Silva, Rafael; Deelman, Ewa
Future Generation Computer Systems, Vol. 46
DOI: 10.1016/j.future.2014.09.014

Searching for gravitational waves from binary coalescence
journal, January 2013

Babak, S.; Biswas, R.; Brady, P. R.
Physical Review D, Vol. 87, Issue 2
DOI: 10.1103/PhysRevD.87.024033

Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences
journal, January 2010

Goecks, Jeremy; Nekrutenko, Anton; Taylor, James
Genome Biology, Vol. 11, Issue 8
DOI: 10.1186/gb-2010-11-8-r86

Similar Records in DOE PAGES and OSTI.GOV collections:

The Evolution of the Pegasus Workflow Management Software

Journal Article Deelman, Ewa ; Vahi, Karan ; Rynge, Mats ; ... - Computing in Science and Engineering

Since 2001 the Pegasus Workflow Management System has evolved into a robust and scalable system that automates the execution of a number of complex applications running on a variety of heterogeneous, distributed high-throughput, and high-performance computing environments. Pegasus was built on the principle of separation between the workflow description and workflow execution, providing the ability to port and adapt the workflow based on the target execution environment. Through its user-driven research and development it has adapted to the needs of a number of scientific communities, utilizing and developing novel algorithms and software engineering solutions. This paper describes the evolution ofmore »« less
Cited by 25
https://doi.org/10.1109/MCSE.2019.2919690

Full Text Available
Building a Cyberinfrastructure for Environmental System Science: Modeling Frameworks, Data Management, and Scientific Workflows, Workshop Report, Potomac, Maryland, April 30-May 1, 2015

Technical Report Moulton, David ; Williams, Dean ; Agarwal, Deb ; ...

The Environmental System Science (ESS) activity within the Department of Energy’s (DOE) Office of Biological and Environmental Research (BER) seeks to advance a robust, predictive understanding of terrestrial environments, extending from bedrock to the top of the vegetative canopy and from molecular to global scales, through an iterative cycle of model-driven experimentation and observation dubbed MODEX. Considerable progress has been made toward achieving this overarching goal, but widely recognized is the fragmentation across projects and disciplines of the relevant modeling and simulation capabilities, observational and experimental data, analysis algorithms, and workflow tools. This fragmentation creates significant challenges for studying impactsmore »« less
https://doi.org/10.2172/1471414

Full Text Available
Automated Workflows for Engineering Sciences V&V Applications.

Conference Clay, Robert L.

Abstract not provided.
Full Text Available
Progress and prospects for accelerating materials science with automated and autonomous workflows

Journal Article Stein, Helge S. ; Gregoire, John M. - Chemical Science

Accelerating materials research by integrating automation with artificial intelligence is increasingly recognized as a grand scientific challenge to discover and develop materials for emerging and future technologies. While the solid state materials science community has demonstrated a broad range of high throughput methods and effectively leveraged computational techniques to accelerate individual research tasks, revolutionary acceleration of materials discovery has yet to be fully realized. This perspective review presents a framework and ontology to outline a materials experiment lifecycle and visualize materials discovery workflows, providing a context for mapping the realized levels of automation and the next generation of autonomous loopsmore »« less
Cited by 86
https://doi.org/10.1039/C9SC03766G
Scientific Process Automation and Workflow Management

Book Ludaescher, Bertram T ; Altintas, Ilkay ; Bowers, Shawn ; ...

We introduce and describe scientific workflows, i.e., executable descriptions of automatable scientific processes such as computational science simulations and data analyses. Scientific workflows are often expressed in terms of tasks and their (data ow) dependencies. This chapter first provides an overview of the characteristic features of scientific workflows and outlines their life cycle. A detailed case study highlights workflow challenges and solutions in simulation management. We then provide a brief overview of how some concrete systems support the various phases of the workflow life cycle, i.e., design, resource management, execution, and provenance management. We conclude with a discussion on community-basedmore » workflow sharing.« less

Similar Records

Title: Pegasus, a workflow management system for science automation

Citation Formats

The Application of Cloud Computing to Astronomy: A Study of Cost and Performance conference, December 2010

ASKALON: a Grid application development and computing environment conference, January 2005

Makeflow: a portable abstraction for data intensive computing on clusters, clouds, and grids conference, January 2012

On the granularity and clustering of directed acyclic task graphs journal, June 1993

Parameter Exploration in Science and Engineering Using Many-Task Computing journal, June 2011

Query processing in a system for distributed databases (SDD-1) journal, December 1981

Enabling large-scale scientific workflows on petascale resources using MPI master/worker conference, January 2012

Static scheduling algorithms for allocating directed task graphs to multiprocessors journal, December 1999

Tavaxy: Integrating Taverna and Galaxy workflows with cloud computing support journal, May 2012

A resource management architecture for metacomputing systems book, January 1998

Experiences Using GlideinWMS and the Corral Frontend across Cyberinfrastructures conference, December 2011

Wings: Intelligent Workflow-Based Design of Computational Experiments journal, January 2011

Wide area data replication for scientific collaborations conference, January 2005

High-Throughput, Kingdom-Wide Prediction and Annotation of Bacterial Non-Coding RNAs journal, September 2008

Accessing opportunistic resources with Bosco journal, June 2014

Scaling up workflow-based applications journal, September 2010

A view of cloud computing journal, April 2010

Performance-effective and low-complexity task scheduling for heterogeneous computing journal, March 2002

Provenance: The Bridge Between Experiments and Data journal, May 2008

Characterizing and profiling scientific workflows journal, March 2013

Workflows and e-Science: An overview of workflow system features and capabilities journal, May 2009

Workflow task clustering for best effort systems with Pegasus conference, January 2008

The Taverna workflow suite: designing and executing workflows of Web Services on the desktop, web or in the cloud journal, May 2013

A Case Study into Using Common Real-Time Workflow Monitoring Infrastructure for Scientific Workflows journal, June 2013

The open science grid journal, July 2007

Hypertext Transfer Protocol -- HTTP/1.1 report, June 1999

Workflow overhead analysis and optimizations conference, January 2011

A Taxonomy of Workflow Management Systems for Grid Computing journal, September 2005

Scheduling Data-IntensiveWorkflows onto Storage-Constrained Distributed Resources conference, May 2007

Rethinking data management for big data scientific workflows conference, October 2013

CyberShake: A Physics-Based Seismic Hazard Model for Southern California journal, May 2010

A Scalable Approach to Network Enabled Servers book, January 2002

Balanced Task Clustering in Scientific Workflows conference, October 2013

glideinWMS—a generic pilot-based workload management system journal, July 2008

Apache airavata: a framework for distributed applications and computational workflows conference, January 2011

Flexible and Efficient Workflow Deployment of Data-Intensive Applications On Grids With MOTEUR journal, August 2008

The Secure Shell (SSH) Connection Protocol report, January 2006

Toward fine-grained online task characteristics estimation in scientific workflows conference, January 2013

Distributed computing in practice: the Condor experience journal, January 2005

Connecting Scientific Data to Scientific Experiments with Provenance conference, December 2007

The Open Provenance Model core specification (v1.1) journal, June 2011

Dependence graphs and compiler optimizations conference, January 1981

The Anatomy of the Grid: Enabling Scalable Virtual Organizations journal, August 2001

Using imbalance metrics to optimize task clustering in scientific workflow executions journal, May 2015

Searching for gravitational waves from binary coalescence journal, January 2013

Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences journal, January 2010

The Application of Cloud Computing to Astronomy: A Study of Cost and Performance
conference, December 2010

ASKALON: a Grid application development and computing environment
conference, January 2005

Makeflow: a portable abstraction for data intensive computing on clusters, clouds, and grids
conference, January 2012

On the granularity and clustering of directed acyclic task graphs
journal, June 1993

Parameter Exploration in Science and Engineering Using Many-Task Computing
journal, June 2011

Query processing in a system for distributed databases (SDD-1)
journal, December 1981

Enabling large-scale scientific workflows on petascale resources using MPI master/worker
conference, January 2012

Static scheduling algorithms for allocating directed task graphs to multiprocessors
journal, December 1999

Tavaxy: Integrating Taverna and Galaxy workflows with cloud computing support
journal, May 2012

A resource management architecture for metacomputing systems
book, January 1998

Experiences Using GlideinWMS and the Corral Frontend across Cyberinfrastructures
conference, December 2011

Wings: Intelligent Workflow-Based Design of Computational Experiments
journal, January 2011

Wide area data replication for scientific collaborations
conference, January 2005

High-Throughput, Kingdom-Wide Prediction and Annotation of Bacterial Non-Coding RNAs
journal, September 2008

Accessing opportunistic resources with Bosco
journal, June 2014

Scaling up workflow-based applications
journal, September 2010

A view of cloud computing
journal, April 2010

Performance-effective and low-complexity task scheduling for heterogeneous computing
journal, March 2002

Provenance: The Bridge Between Experiments and Data
journal, May 2008

Characterizing and profiling scientific workflows
journal, March 2013

Workflows and e-Science: An overview of workflow system features and capabilities
journal, May 2009

Workflow task clustering for best effort systems with Pegasus
conference, January 2008

The Taverna workflow suite: designing and executing workflows of Web Services on the desktop, web or in the cloud
journal, May 2013

A Case Study into Using Common Real-Time Workflow Monitoring Infrastructure for Scientific Workflows
journal, June 2013

The open science grid
journal, July 2007

Hypertext Transfer Protocol -- HTTP/1.1
report, June 1999

Workflow overhead analysis and optimizations
conference, January 2011

A Taxonomy of Workflow Management Systems for Grid Computing
journal, September 2005

Scheduling Data-IntensiveWorkflows onto Storage-Constrained Distributed Resources
conference, May 2007

Rethinking data management for big data scientific workflows
conference, October 2013

CyberShake: A Physics-Based Seismic Hazard Model for Southern California
journal, May 2010

A Scalable Approach to Network Enabled Servers
book, January 2002

Balanced Task Clustering in Scientific Workflows
conference, October 2013

glideinWMS—a generic pilot-based workload management system
journal, July 2008

Apache airavata: a framework for distributed applications and computational workflows
conference, January 2011

Flexible and Efficient Workflow Deployment of Data-Intensive Applications On Grids With MOTEUR
journal, August 2008

The Secure Shell (SSH) Connection Protocol
report, January 2006

Toward fine-grained online task characteristics estimation in scientific workflows
conference, January 2013

Distributed computing in practice: the Condor experience
journal, January 2005

Connecting Scientific Data to Scientific Experiments with Provenance
conference, December 2007

The Open Provenance Model core specification (v1.1)
journal, June 2011

Dependence graphs and compiler optimizations
conference, January 1981

The Anatomy of the Grid: Enabling Scalable Virtual Organizations
journal, August 2001

Using imbalance metrics to optimize task clustering in scientific workflow executions
journal, May 2015

Searching for gravitational waves from binary coalescence
journal, January 2013

Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences
journal, January 2010