An Asynchronous Many-Task Implementation of In-Situ Statistical Analysis using Legion.

Technical Report · Sun Nov 01 04:00:00 EST 2015

DOI:https://doi.org/10.2172/1227237· OSTI ID:1227237

Pebay, Philippe Pierre ^[1]; Bennett, Janine Camille ^[1]

---

1. Sandia National Lab. (SNL-CA), Livermore, CA (United States)

In this report, we propose a framework for the design and implementation of in-situ analy- ses using an asynchronous many-task (AMT) model, using the Legion programming model together with the MiniAero mini-application as a surrogate for full-scale parallel scientific computing applications. The bulk of this work consists of converting the Learn/Derive/Assess model which we had initially developed for parallel statistical analysis using MPI [PTBM11], from a SPMD to an AMT model. In this goal, we propose an original use of the concept of Legion logical regions as a replacement for the parallel communication schemes used for the only operation of the statistics engines that require explicit communication. We then evaluate this proposed scheme in a shared memory environment, using the Legion port of MiniAero as a proxy for a full-scale scientific application, as a means to provide input data sets of variable size for the in-situ statistical analyses in an AMT context. We demonstrate in particular that the approach has merit, and warrants further investigation, in collaboration with ongoing efforts to improve the overall parallel performance of the Legion system.

• Research Organization: Sandia National Lab. (SNL-CA), Livermore, CA (United States)
• Sponsoring Organization: USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)
• DOE Contract Number: AC04-94AL85000
• OSTI ID: 1227237
• Report Number(s): SAND2015--10345; 613842
• Country of Publication: United States
• Language: English