Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Extensions to the SENSEI In situ Framework for Heterogeneous Architectures

Conference · · Proceedings of the SC '23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis
 [1];  [2];  [1];  [3]
  1. Data Sciences Division, Lawrence Berkeley National Laboratory, USA
  2. Computer Sciences Department, San Francisco State University, USA and Data Sciences Division, Lawrence Berkeley National Laboratory, USA
  3. Data Sciences Division, Lawrence Berkeley National Laboratory, USA and International Computer Science Institute, University of California at Berkeley, USA

The proliferation of GPUs and accelerators in recent supercomputing systems, so called heterogeneous architectures, has led to increased complexity in execution environments and programming models as well as to deeper memory hierarchies on these systems. In this work, we discuss challenges that arise in in situ code coupling on these heterogeneous architectures. In particular, we present data and execution model extensions to the SENSEI in situ framework that are targeted at the effective use of systems with heterogeneous architectures. We then use these new data and execution model extensions to investigate several in situ placement and execution configurations and to analyze the impact these choices have on overall performance.

Research Organization:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-ASCR)
DOE Contract Number:
AC02-05CH11231
OSTI ID:
2370361
Journal Information:
Proceedings of the SC '23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis, Journal Name: Proceedings of the SC '23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis
Country of Publication:
United States
Language:
English

References (9)

Python-based in situ analysis and visualization conference November 2018
WarpIV: In Situ Visualization and Analysis of Ion Accelerator Simulations journal May 2016
Improving Performance of M-to-N Processing and Data Redistribution in In Transit Analysis and Visualization text January 2020
Optimal scheduling of in-situ analysis for large-scale scientific simulations
  • Malakar, Preeti; Vishwanath, Venkatram; Munson, Todd
  • Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '15 https://doi.org/10.1145/2807591.2807656
conference January 2015
A Hybrid In Situ Approach for Cost Efficient Image Database Generation journal January 2022
The SENSEI Generic In Situ Interface
  • Ayachit, Utkarsh; Whitlock, Brad; Wolf, Matthew
  • 2016 Second Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization (ISAV) https://doi.org/10.1109/ISAV.2016.013
conference November 2016
Extreme Heterogeneity 2018 - Productive Computational Science in the Era of Extreme Heterogeneity: Report for DOE ASCR Workshop on Extreme Heterogeneity report December 2018
Conduit: A Successful Strategy for Describing and Sharing Data In Situ
  • Harrison, Cyrus; Larsen, Matthew; Ryujin, Brian S.
  • 2022 IEEE/ACM International Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization (ISAV) https://doi.org/10.1109/ISAV56555.2022.00006
conference November 2022
HDF5 as a vehicle for in transit data movement conference November 2019

Similar Records

IRIS: A Performance-Portable Framework for Cross-Platform Heterogeneous Computing
Journal Article · 2024 · IEEE Transactions on Parallel and Distributed Systems · OSTI ID:2438807

Practical Loop Transformations for Tensor Contraction Expressions on Multi-Level Memory Hierarchies
Conference · 2011 · OSTI ID:1013930

Data and Thread Placement in NUMA Architectures: A Statistical Learning Approach
Conference · 2018 · OSTI ID:1574309

Related Subjects