Components in the Pipeline

Journal Article · Thu Feb 24 04:00:00 EST 2011 · IEEE Software, 28(3):34-40

DOI:https://doi.org/10.1109/MS.2011.23· OSTI ID:1013286

Gorton, Ian; Wynne, Adam S; Liu, Yan ^[1]; Yin, Jian

---

1. Jenny

Scientists commonly describe their data processing systems metaphorically as software pipelines. These pipelines input one or more data sources and apply a sequence of processing steps to transform the data and create useful results. While conceptually simple, pipelines often adopt complex topologies and must meet stringent quality of service requirements that place stress on the software infrastructure used to construct the pipeline. In this paper we describe the MeDICi Integration Framework, which is a component-based framework for constructing complex software pipelines. The framework supports composing pipelines from distributed heterogeneous software components and provides mechanisms for controlling qualities of service to meet demanding performance, reliability and communication requirements.

• Research Organization: Pacific Northwest National Laboratory (PNNL), Richland, WA (US)
• Sponsoring Organization: USDOE
• DOE Contract Number: AC05-76RL01830
• OSTI ID: 1013286
• Report Number(s): PNNL-SA-77807
• Journal Information: IEEE Software, 28(3):34-40, Journal Name: IEEE Software, 28(3):34-40 Journal Issue: 3 Vol. 28
• Country of Publication: United States
• Language: English

Related Subjects

99 GENERAL AND MISCELLANEOUS
COMMUNICATIONS
COMPUTERS
DATA PROCESSING
PERFORMANCE
PROCESSING
PROGRAMMING
RELIABILITY