Engineering High Performance Service-Oriented Pipeline Applications with MeDICi
The pipeline software architecture pattern is commonly used in many application domains to structure a software system. A pipeline comprises a sequence of processing steps that progressively transform data to some desired outputs. As pipeline-based systems are required to handle increasingly large volumes of data and provide high throughput services, simple scripting-based technologies that have traditionally been used for constructing pipelines do not scale. In this paper we describe the MeDICI Integration Framework (MIF), which is specifically designed for building flexible, efficient and scalable pipelines that exploit distributed services as elements of the pipeline. We explain the core runtime and development infrastructures that MIF provides, and demonstrate how MIF has been used in two complex applications to improve performance and modifiability.
- Research Organization:
- Pacific Northwest National Laboratory (PNNL), Richland, WA (US)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC05-76RL01830
- OSTI ID:
- 1010473
- Report Number(s):
- PNNL-SA-76345
- Country of Publication:
- United States
- Language:
- English
Similar Records
Middleware Case Study: MeDICi
Kepler + MeDICi - Service-Oriented Scientific Workflow Applications
Services + Components = Data Intensive Scientific Workflow Applications with MeDICi
Book
·
Thu May 05 00:00:00 EDT 2011
·
OSTI ID:1040989
Kepler + MeDICi - Service-Oriented Scientific Workflow Applications
Conference
·
Thu Jul 30 00:00:00 EDT 2009
·
OSTI ID:971104
Services + Components = Data Intensive Scientific Workflow Applications with MeDICi
Conference
·
Mon Jun 01 00:00:00 EDT 2009
·
OSTI ID:1011819