Kepler + MeDICi

Conference · Fri Jul 10 04:00:00 EDT 2009

OSTI ID:973731

Chase, Jared M; Gorton, Ian; Sivaramakrishnan, Chandrika; Almquist, Justin P; Wynne, Adam S; Chin, George; Critchlow, Terence J

applications are often structured as workflows that execute a series of interdependent, distributed software modules to analyze large data sets. Passing very large data sets between workflow steps can incur unacceptable overheads with workflow engines that are not designed to efficiently handle large data transfers. In this paper, we describe how we have enhanced a Kepler workflow application with the MeDICi Integration Framework, which has been specifically designed to support the execution of data intensive workflows. The MeDICi technology provides a scalable, component-based architecture that efficiently handles integration with heterogeneous, distributed software systems. This paper describes the MeDICi Integration Framework and the mechanisms we used to integrate MeDICi components with Kepler workflow actors. We illustrate this solution with a workflow application for an atmospheric sciences application, which demonstrates the advantages of this approach.

• Research Organization: Pacific Northwest National Laboratory (PNNL), Richland, WA (US)
• Sponsoring Organization: USDOE
• DOE Contract Number: AC05-76RL01830
• OSTI ID: 973731
• Report Number(s): PNNL-SA-65047
• Country of Publication: United States
• Language: English

Related Subjects

97 MATHEMATICS AND COMPUTING
99 GENERAL AND MISCELLANEOUS
COMPUTER ARCHITECTURE
DATA TRANSMISSION
DESIGN
K CODES
M CODES
components
middleware
services
workflow