Kepler Scientific Workflow Design and Execution with Contexts

Ngu, Anne Hee Hiong; Jamnagarwala, Arwa; Chin, George; Sivaramakrishnan, Chandrika; Critchlow, Terence J

Title: Kepler Scientific Workflow Design and Execution with Contexts

Full Record
Other Related Research

Abstract

A context-aware scientific workflow is a typical scientific workflow that is enhanced with context binding and awareness mechanisms. Context facilitates further configuration of the scientific workflow at runtime such that it is tuned to its environment during execution and responds intelligently based on such awareness without customized coding of the workflow. In this paper, we present a context annotation framework, which supports rapid development of context-aware scientific workflows. Context annotation enables a diverse type of actor in Kepler that may bind with different sensed environmental information as part of the actor’s regular data. Context-aware actors simplify the construction of scientific workflows that require intricate knowledge in initializing and configuring a large number of parameters to cover all different execution conditions. This paper presents the motivation, system design, implementation, and usage of context annotation in relation to the Kepler scientific workflow system.

Authors:: Ngu, Anne Hee Hiong; Jamnagarwala, Arwa; Chin, George; Sivaramakrishnan, Chandrika; Critchlow, Terence J

Publication Date:: Thu Sep 01 00:00:00 EDT 2011

Research Org.:: Pacific Northwest National Lab. (PNNL), Richland, WA (United States)

Sponsoring Org.:: USDOE

OSTI Identifier:: 1026602

Report Number(s):: PNNL-SA-77613
KJ0403000; TRN: US201120%%931

DOE Contract Number:: AC05-76RL01830

Resource Type:: Journal Article

Journal Name:: International Journal of Computers and Their Applications, 18(3):133-147

Additional Journal Information:: Journal Volume: 18; Journal Issue: 3

Country of Publication:: United States

Language:: English

Subject:: 99 GENERAL AND MISCELLANEOUS//MATHEMATICS, COMPUTING, AND INFORMATION SCIENCE; CONFIGURATION; CONSTRUCTION; DESIGN; IMPLEMENTATION

Citation Formats


                    Ngu, Anne Hee Hiong, Jamnagarwala, Arwa, Chin, George, Sivaramakrishnan, Chandrika, and Critchlow, Terence J. Kepler Scientific Workflow Design and Execution with Contexts.  United States: N. p., 2011. 
        Web.

Copy to clipboard


                    Ngu, Anne Hee Hiong, Jamnagarwala, Arwa, Chin, George, Sivaramakrishnan, Chandrika, & Critchlow, Terence J. Kepler Scientific Workflow Design and Execution with Contexts.  United States.

Copy to clipboard


                    Ngu, Anne Hee Hiong, Jamnagarwala, Arwa, Chin, George, Sivaramakrishnan, Chandrika, and Critchlow, Terence J. 2011.  
        "Kepler Scientific Workflow Design and Execution with Contexts".  United States.

Copy to clipboard


                    
@article{osti_1026602,

  title        = {Kepler Scientific Workflow Design and Execution with Contexts},

  author       = {Ngu, Anne Hee Hiong and Jamnagarwala, Arwa and Chin, George and Sivaramakrishnan, Chandrika and Critchlow, Terence J},

  abstractNote = {A context-aware scientific workflow is a typical scientific workflow that is enhanced with context binding and awareness mechanisms. Context facilitates further configuration of the scientific workflow at runtime such that it is tuned to its environment during execution and responds intelligently based on such awareness without customized coding of the workflow. In this paper, we present a context annotation framework, which supports rapid development of context-aware scientific workflows. Context annotation enables a diverse type of actor in Kepler that may bind with different sensed environmental information as part of the actor’s regular data. Context-aware actors simplify the construction of scientific workflows that require intricate knowledge in initializing and configuring a large number of parameters to cover all different execution conditions. This paper presents the motivation, system design, implementation, and usage of context annotation in relation to the Kepler scientific workflow system.},

  doi          = {},

  url          = {https://www.osti.gov/biblio/1026602},
  journal      = {International Journal of Computers and Their Applications, 18(3):133-147},
number       = 3,

  volume       = 18,

  place        = {United States},

  year         = {Thu Sep 01 00:00:00 EDT 2011},

  month        = {Thu Sep 01 00:00:00 EDT 2011}

}

Copy to clipboard

Journal Article:

Other availability

Find in Google Scholar

Search WorldCat to find libraries that may hold this journal

Save / Share:

Export Metadata

Save to My Library

Similar records in OSTI.GOV collections:

Context-Aware Scientific Workflow Systems using KEPLER

Journal Article Ngu, Anne; Jamnagarwala, Arwa; Chin, George; ... - International Journal of Business Process Integration and Management, 5(1):18-31

Data-intensive scientific workflows are often modeled using a dataflow-oriented model. The simplicity of a dataflow model facilitates intuitive workflow design, analysis, and optimization. However, some amount of control-flow modeling is often necessary for engineering fault-tolerant, robust, and adaptive workflows. Modeling the control-flow using inherent dataflow constructs will quickly end up with a workflow that is hard to comprehend, reuse, and maintain. In this paper, we propose a context-aware architecture for scientific workflows. By incorporating contexts within a data-flow oriented scientific workflow system, we enable the development of context-aware scientific workflows without the need to use numerous low-level control-flow actors. Thismore »« less
https://doi.org/10.1504/IJBPIM.2010.033172
Kepler + MeDICi - Service-Oriented Scientific Workflow Applications

Conference Chase, Jared; Gorton, Ian; Sivaramakrishnan, Chandrika; ...

Scientific applications are often structured as workflows that execute a series of interdependent, distributed software modules to analyze large data sets. The order of execution of the tasks in a workflow is commonly controlled by complex scripts, which over time become difficult to maintain and evolve. In this paper, we describe how we have integrated the Kepler scientific workflow platform with the MeDICi Integration Framework, which has been specifically designed to provide a standards-based, lightweight and flexible integration platform. The MeDICi technology provides a scalable, component-based architecture that efficiently handles integration with heterogeneous, distributed software systems. This paper describes themore »« less
Working with Workflows: Highlights from 5 years Building Scientific Workflows

Conference Critchlow, Terence; Altintas, Ilkay; Chin, George; ...

In 2006, the SciDAC Scientific Data Management (SDM) Center proposed to continue its work deploying leading edge data management and analysis capabilities to scientific applications. One of three thrust areas within the proposed center was focused on Scientific Process Automation (SPA) using workflow technology. As a founding member of the Kepler consortium [LAB+09], the SDM Center team was well positioned to begin deploying workflows immediately. We were also keenly aware of some of the deficiencies in Kepler when applied to high performance computing workflows, which allowed us to focus our research and development efforts on critical new capabilities which weremore »« less
Scientist-Centered Workflow Abstractions via Generic Actors, Workflow Templates, and Context-Awareness for Groundwater Modeling and Analysis

Conference Chin, George; Sivaramakrishnan, Chandrika; Critchlow, Terence; ...

A drawback of existing scientific workflow systems is the lack of support to domain scientists in designing and executing their own scientific workflows. Many domain scientists avoid developing and using workflows because the basic objects of workflows are too low-level and high-level tools and mechanisms to aid in workflow construction and use are largely unavailable. In our research, we are prototyping higher-level abstractions and tools to better support scientists in their workflow activities. Specifically, we are developing generic actors that provide abstract interfaces to specific functionality, workflow templates that encapsulate workflow and data patterns that can be reused and adaptedmore »« less
Enabling In-situ Execution of Coupled Scientific Workflow on Multi-core Platform

Conference Zhang, Fan; Docan, Ciprian; Parashar, Manish; ... - 2012 IEEE 26TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS)

Emerging scientific application workflows are composed of heterogeneous coupled component applications that simulate different aspects of the physical phenomena being modeled, and that interact and exchange significant volumes of data at runtime. With the increasing performance gap between on-chip data sharing and off-chip data transfers in current systems based on multicore processors, moving large volumes of data using communication network fabric can significantly impact performance. As a result, minimizing the amount of inter-application data exchanges that are across compute nodes and use the network is critical to achieving overall application performance and system efficiency. In this paper, we investigate themore »« less
https://doi.org/10.1109/IPDPS.2012.122

Similar Records