In-Staging Data Placement for Asynchronous Coupling of Task-Based Scientific Workflows, In: 2016 Second International Workshop on Extreme Scale Programming Models and Middlewar (ESPM2)

Conference · Fri Jan 01 00:00:00 EST 2016 · PROCEEDINGS OF SECOND INTERNATIONAL WORKSHOP ON EXTREME SCALE PROGRAMMING MODELS AND MIDDLEWARE (ESPM2 2016)

DOI:https://doi.org/10.1109/ESPM2.2016.12· OSTI ID:1567424

Sun, Qian ^[1]; Romanus, Melissa ^[1]; Jin, Tong ^[1]; Yu, Hongfeng ^[2]; Bremer, Peer-Timo ^[3]; Petruzza, Steve ^[4]; Klasky, Scott ^[5]

---

1. Rutgers University, Piscataway NJ (United States)
2. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
3. Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
4. Sci. Comput. & Imaging Inst., University of Utah, Salt Lake City, UT (United States)
5. Computer Science and Mathematics Division, Oak Ridge National Laboratory, Oak Ridge, TN (United States)

Coupled application workflows composed of applications implemented using task-based models present new coupling and data exchange challenges, due to the asynchronous interaction and coupling behaviors between tasks of the component applications. In this paper, we present an adaptive data placement approach that addresses these challenges by dynamically adjusting to the asynchronous coupling patterns. Specifically, it places data across a set of staging cores/nodes with an awareness of the application-specific data locality requirements and the runtime task executions at these staging cores/nodes, with the goal of reducing end-to-end execution time and data movement overhead of the workflow. We experimentally demonstrate the effectiveness of our approach on the Titan Cray XK7 system using representative data coupling patterns derived from current scientific workflows. The evaluation demonstrates that our approach efficiently improves performance by reducing the time-to-solution and increasing the quality of insights for scientific discovery.

• Research Organization: Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF); Rutgers Univ., Piscataway, NJ (United States); UT-Battelle LLC/ORNL, Oak Ridge, TN (United States)
• Sponsoring Organization: USDOE Office of Science (SC)
• DOE Contract Number: FC02-06ER54857; AC05-00OR22725; SC0007455
• OSTI ID: 1567424
• Journal Information: PROCEEDINGS OF SECOND INTERNATIONAL WORKSHOP ON EXTREME SCALE PROGRAMMING MODELS AND MIDDLEWARE (ESPM2 2016), Conference: Workshop on Extreme Scale Programming Models and Middlewar (ESPM2), Salt Lake City, UT, November 18, 2016
• Country of Publication: United States
• Language: English

Related Subjects

Computer Science