Exploring power behaviors and trade-offs of in-situ data analytics, In: SC '13 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis

Conference · Tue Jan 01 00:00:00 EST 2013 · 2013 INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS (SC)

DOI:https://doi.org/10.1145/2503210.2503303· OSTI ID:1567350

Gamell, Marc; McCormick, Patrick; Pakin, Scott; Pascucci, Valerio; Klasky, Scott; Rodero, Ivan; Parashar, Manish; Bennett, Janine C.; Kolla, Hemanth; Chen, Jacqueline; Bremer, Peer-Timo; Landge, Aaditya G.; Gyulassy, Attila

As scientific applications target exascale, challenges related to data and energy are becoming dominating concerns. For example, coupled simulation workflows are increasingly adopting in-situ data processing and analysis techniques to address costs and overheads due to data movement and I/O. However it is also critical to understand these overheads and associated trade-offs from an energy perspective. The goal of this paper is exploring data-related energy/performance trade-offs for end-to-end simulation workflows running at scale on current high-end computing systems. Specifically, this paper presents: (1) an analysis of the data-related behaviors of a combustion simulation workflow with an in-situ data analytics pipeline, running on the Titan system at ORNL; (2) a power model based on system power and data exchange patterns, which is empirically validated; and (3) the use of the model to characterize the energy behavior of the workflow and to explore energy/performance trade-offs on current as well as emerging systems.

• Research Organization: Rutgers Univ., Piscataway, NJ (United States); Lockheed Martin Corporation, Littleton, CO (United States); Los Alamos National Lab. (LANL), Los Alamos, NM (United States), Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
• Sponsoring Organization: USDOE Office of Science (SC)
• DOE Contract Number: FC02-06ER54857; AC04-94AL85000; AC52-06NA25396; SC0007455
• OSTI ID: 1567350
• Journal Information: 2013 INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS (SC), Conference: International Conference on High Performance Computing, Networking, Storage and Analysis, Denver, Colorado, November 17-21, 2013
• Country of Publication: United States
• Language: English

Related Subjects

Computer Science
Engineering