skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A Web Accessible Scientific Workflow System for Performance Monitoring

Abstract

We describe the design and implementation of a web-accessible scientific workflow system for environmental performance monitoring. This workflow environment integrates distributed automated data acquisition with server side data management and information visualization through flexible browser-based data access tools. Component technologies include a rich browser-based client, a back-end server for methodical data processing, user management, and result delivery, and third party applications which are invoked by the back-end using web services. This environment allows for reproducible, transparent result generation by a diverse user base, and provides a seamless integration between data selection, analysis applications, and result delivery. This workflow system has been implemented for several sites and monitoring systems with different degrees of complexity.

Authors:
; ;
Publication Date:
Research Org.:
Idaho National Laboratory (INL)
Sponsoring Org.:
USDOE
OSTI Identifier:
912336
Report Number(s):
INL/JOU-05-00590
Journal ID: ISSN 0013-936X; ESTHAG; TRN: US200801%%771
DOE Contract Number:
DE-AC07-99ID-13727
Resource Type:
Journal Article
Resource Relation:
Journal Name: Environmental Science and Technology; Journal Volume: 40; Journal Issue: 8
Country of Publication:
United States
Language:
English
Subject:
99 - GENERAL AND MISCELLANEOUS//MATHEMATICS, COMPUTING, AND INFORMATION SCIENCE; DATA ACQUISITION; DATA PROCESSING; DESIGN; IMPLEMENTATION; MANAGEMENT; MONITORING; PERFORMANCE; automated data; environmental; processing; web; workflow

Citation Formats

Alex Richardson, Roelof Versteeg, and Trevor Rowe. A Web Accessible Scientific Workflow System for Performance Monitoring. United States: N. p., 2006. Web.
Alex Richardson, Roelof Versteeg, & Trevor Rowe. A Web Accessible Scientific Workflow System for Performance Monitoring. United States.
Alex Richardson, Roelof Versteeg, and Trevor Rowe. Wed . "A Web Accessible Scientific Workflow System for Performance Monitoring". United States. doi:.
@article{osti_912336,
title = {A Web Accessible Scientific Workflow System for Performance Monitoring},
author = {Alex Richardson and Roelof Versteeg and Trevor Rowe},
abstractNote = {We describe the design and implementation of a web-accessible scientific workflow system for environmental performance monitoring. This workflow environment integrates distributed automated data acquisition with server side data management and information visualization through flexible browser-based data access tools. Component technologies include a rich browser-based client, a back-end server for methodical data processing, user management, and result delivery, and third party applications which are invoked by the back-end using web services. This environment allows for reproducible, transparent result generation by a diverse user base, and provides a seamless integration between data selection, analysis applications, and result delivery. This workflow system has been implemented for several sites and monitoring systems with different degrees of complexity.},
doi = {},
journal = {Environmental Science and Technology},
number = 8,
volume = 40,
place = {United States},
year = {Wed Mar 01 00:00:00 EST 2006},
month = {Wed Mar 01 00:00:00 EST 2006}
}
  • We describe the design and implementation of a web accessible scientific workflow system for environmental monitoring. This workflow environment integrates distributed, automated data acquisition with server side data management and information visualization through flexible browser based data access tools. Component technologies include a rich browser-based client (using dynamic Javascript and HTML/CSS) for data selection, a back-end server which uses PHP for data processing, user management, and result delivery, and third party applications which are invoked by the back-end using webservices. This environment allows for reproducible, transparent result generation by a diverse user base. It has been implemented for several monitoringmore » systems with different degrees of complexity.« less
  • Subsurface modeling applications typically neglect uncertainty in the conceptual models, past or future scenarios, and attribute most or all uncertainty to errors in model parameters. In this contribution, uncertainty in technetium-99 transport in a heterogeneous, deep vadose zone is explored with respect to the conceptual model using a next generation user environment called Akuna. Akuna provides a range of tools to manage environmental modeling projects, from managing simulation data to visualizing results from high-performance computational simulators. Core toolsets accessible through the user interface include model setup, grid generation, parameter estimation, and uncertainty quantification. The BC Cribs site at Hanford inmore » southeastern Washington State is used to demonstrate Akuna capabilities. At the BC Cribs site, conceptualization of the system is highly uncertain because only sparse information is available for the geologic conceptual model, the physical and chemical properties of the sediments, and the history of waste disposal operations. Using the Akuna toolset to perform an analysis of conservative solute transport, significant prediction uncertainty in simulated concentrations is demonstrated by conceptual model variation. This demonstrates that conceptual model uncertainty is an important consideration in sparse data environments such as BC Cribs. It is also demonstrated that Akuna and the underlying toolset provides an integrated modeling environment that streamlines model setup, parameter optimization, and uncertainty analyses for high-performance computing applications.« less
  • Cited by 41
  • Data-intensive scientific workflows are often modeled using a dataflow-oriented model. The simplicity of a dataflow model facilitates intuitive workflow design, analysis, and optimization. However, some amount of control-flow modeling is often necessary for engineering fault-tolerant, robust, and adaptive workflows. Modeling the control-flow using inherent dataflow constructs will quickly end up with a workflow that is hard to comprehend, reuse, and maintain. In this paper, we propose a context-aware architecture for scientific workflows. By incorporating contexts within a data-flow oriented scientific workflow system, we enable the development of context-aware scientific workflows without the need to use numerous low-level control-flow actors. Thismore » results in a workflow that is aware of its environment during execution with minimal user input and responds intelligently based on such awareness at runtime. A further advantage of our approach is that the defined contexts can be reused and shared across other workflows. We demonstrate our approach with two prototype implementation of context-aware actors in KEPLER.« less