skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Heterogeneous Hierarchical Workflow Composition

Abstract

Workflow systems promise scientists an automated end-to-end path from hypothesis to discovery. However, expecting any single workflow system to deliver such a wide range of capabilities is impractical. A more practical solution is to compose the end-to-end workflow from more than one system. With this goal in mind, the integration of task-based and in situ workflows is explored, where the result is a hierarchical heterogeneous workflow composed of subworkflows, with different levels of the hierarchy using different programming, execution, and data models. Materials science use cases demonstrate the advantages of such heterogeneous hierarchical workflow composition.

Authors:
; ; ; ; ;
Publication Date:
Research Org.:
Argonne National Lab. (ANL), Argonne, IL (United States)
Sponsoring Org.:
USDOE Office of Science - Office of Advanced Scientific Computing Research; Spanish Ministry of Science and Innovation (MICINN)
OSTI Identifier:
1550805
DOE Contract Number:  
AC02-06CH11357
Resource Type:
Journal Article
Journal Name:
Computing in Science and Engineering
Additional Journal Information:
Journal Volume: 21; Journal Issue: 4
Country of Publication:
United States
Language:
English
Subject:
distributed workflows; in situ workflows

Citation Formats

Yildiz, Orcun, Ejarque, Jorge, Chan, Henry, Sankaranarayanan, Subramanian, Badia, Rosa M., and Peterka, Tom. Heterogeneous Hierarchical Workflow Composition. United States: N. p., 2019. Web. doi:10.1109/MCSE.2019.2918766.
Yildiz, Orcun, Ejarque, Jorge, Chan, Henry, Sankaranarayanan, Subramanian, Badia, Rosa M., & Peterka, Tom. Heterogeneous Hierarchical Workflow Composition. United States. doi:10.1109/MCSE.2019.2918766.
Yildiz, Orcun, Ejarque, Jorge, Chan, Henry, Sankaranarayanan, Subramanian, Badia, Rosa M., and Peterka, Tom. Mon . "Heterogeneous Hierarchical Workflow Composition". United States. doi:10.1109/MCSE.2019.2918766.
@article{osti_1550805,
title = {Heterogeneous Hierarchical Workflow Composition},
author = {Yildiz, Orcun and Ejarque, Jorge and Chan, Henry and Sankaranarayanan, Subramanian and Badia, Rosa M. and Peterka, Tom},
abstractNote = {Workflow systems promise scientists an automated end-to-end path from hypothesis to discovery. However, expecting any single workflow system to deliver such a wide range of capabilities is impractical. A more practical solution is to compose the end-to-end workflow from more than one system. With this goal in mind, the integration of task-based and in situ workflows is explored, where the result is a hierarchical heterogeneous workflow composed of subworkflows, with different levels of the hierarchy using different programming, execution, and data models. Materials science use cases demonstrate the advantages of such heterogeneous hierarchical workflow composition.},
doi = {10.1109/MCSE.2019.2918766},
journal = {Computing in Science and Engineering},
number = 4,
volume = 21,
place = {United States},
year = {2019},
month = {7}
}