skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Final Technical Report for: A Unified Data-Driven Approach for Programming In Situ Analysis and Visualization

Abstract

The placement and movement of data is becoming the key limiting factor on both performance and energy efficiency of high performance computations. As systems generate more data, it is becoming increasingly difficult to actually move that data elsewhere for post-processing, as the rate of improvements in supporting I/O infrastructure is not keeping pace. Together, these trends are creating a shift in how we think about exascale computations, from a viewpoint that focuses on FLOPS to one that focuses on data and data-centric operations as fundamental to the reasoning about, and optimization of, scientific workflows on extreme-scale architectures. The overarching goal of our effort was the study of a unified data-driven approach for programming applications and in situ analysis and visualization. Our work was to understand the interplay between data-centric programming model requirements at extreme-scale and the overall impact of those requirements on the design, capabilities, flexibility, and implementation details for both applications and the supporting in situ infrastructure. In this context, we made many improvements to the Legion programming system (one of the leading data-centric models today) and demonstrated in situ analyses on real application codes using these improvements.

Authors:
 [1]
  1. Stanford Univ., CA (United States)
Publication Date:
Research Org.:
Stanford Univ., CA (United States)
Sponsoring Org.:
USDOE Office of Science (SC)
OSTI Identifier:
1439415
Report Number(s):
12426
DOE Contract Number:  
SC0012426
Resource Type:
Technical Report
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING

Citation Formats

Aiken, Alex. Final Technical Report for: A Unified Data-Driven Approach for Programming In Situ Analysis and Visualization. United States: N. p., 2018. Web. doi:10.2172/1439415.
Aiken, Alex. Final Technical Report for: A Unified Data-Driven Approach for Programming In Situ Analysis and Visualization. United States. doi:10.2172/1439415.
Aiken, Alex. Sat . "Final Technical Report for: A Unified Data-Driven Approach for Programming In Situ Analysis and Visualization". United States. doi:10.2172/1439415. https://www.osti.gov/servlets/purl/1439415.
@article{osti_1439415,
title = {Final Technical Report for: A Unified Data-Driven Approach for Programming In Situ Analysis and Visualization},
author = {Aiken, Alex},
abstractNote = {The placement and movement of data is becoming the key limiting factor on both performance and energy efficiency of high performance computations. As systems generate more data, it is becoming increasingly difficult to actually move that data elsewhere for post-processing, as the rate of improvements in supporting I/O infrastructure is not keeping pace. Together, these trends are creating a shift in how we think about exascale computations, from a viewpoint that focuses on FLOPS to one that focuses on data and data-centric operations as fundamental to the reasoning about, and optimization of, scientific workflows on extreme-scale architectures. The overarching goal of our effort was the study of a unified data-driven approach for programming applications and in situ analysis and visualization. Our work was to understand the interplay between data-centric programming model requirements at extreme-scale and the overall impact of those requirements on the design, capabilities, flexibility, and implementation details for both applications and the supporting in situ infrastructure. In this context, we made many improvements to the Legion programming system (one of the leading data-centric models today) and demonstrated in situ analyses on real application codes using these improvements.},
doi = {10.2172/1439415},
journal = {},
number = ,
volume = ,
place = {United States},
year = {2018},
month = {5}
}