skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Results of the PERI survey of SciDAC applications

Abstract

The Performance Engineering Research Institute (PERI) project focuses on achieving superior performance for Scientific Discovery through Advanced Computing (SciDAC) applications on leadership class machines through cutting-edge research in performance modeling and automated performance tuning. This focus requires coordinated activities to engage SciDAC application teams. The initial application engagement activity was a survey of these teams to determine their performance goals, the criticality of those goals, current performance of their applications, application characteristics relevant to performance and their plans for future optimization. Using a web-based questionnaire, PERI researchers have worked with application developers to provide this information for over twenty-five applications. This paper describes the initial analysis of the application characteristics and performance goals, as well as current and future application engagement activities driven by these results. While the survey was conducted primarily to meet PERI needs, the results represent a snapshot of the state of SciDAC code development and may be of use to the DOE community at large. Overall, the results show that SciDAC application teams are engaged in significant new code development, which will require flexible performance optimization techniques that can improve performance as the applications evolve.

Authors:
 [1];  [2];  [3];  [4]
  1. Lawrence Livermore National Laboratory (LLNL)
  2. University of Maryland
  3. University of Tennessee, Knoxville (UTK)
  4. ORNL
Publication Date:
Research Org.:
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
Sponsoring Org.:
USDOE Office of Science (SC)
OSTI Identifier:
958799
DOE Contract Number:
DE-AC05-00OR22725
Resource Type:
Conference
Resource Relation:
Conference: SciDAC 2007, Boston, MA, USA, 20070624, 20070628
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICAL METHODS AND COMPUTING; CRITICALITY; OPTIMIZATION; PERFORMANCE; SIMULATION; TUNING

Citation Formats

de Supinski, Bronis R., Hollingsworth, Jeffrey K., Moore, Shirley, and Worley, Patrick H. Results of the PERI survey of SciDAC applications. United States: N. p., 2007. Web.
de Supinski, Bronis R., Hollingsworth, Jeffrey K., Moore, Shirley, & Worley, Patrick H. Results of the PERI survey of SciDAC applications. United States.
de Supinski, Bronis R., Hollingsworth, Jeffrey K., Moore, Shirley, and Worley, Patrick H. Mon . "Results of the PERI survey of SciDAC applications". United States. doi:.
@article{osti_958799,
title = {Results of the PERI survey of SciDAC applications},
author = {de Supinski, Bronis R. and Hollingsworth, Jeffrey K. and Moore, Shirley and Worley, Patrick H},
abstractNote = {The Performance Engineering Research Institute (PERI) project focuses on achieving superior performance for Scientific Discovery through Advanced Computing (SciDAC) applications on leadership class machines through cutting-edge research in performance modeling and automated performance tuning. This focus requires coordinated activities to engage SciDAC application teams. The initial application engagement activity was a survey of these teams to determine their performance goals, the criticality of those goals, current performance of their applications, application characteristics relevant to performance and their plans for future optimization. Using a web-based questionnaire, PERI researchers have worked with application developers to provide this information for over twenty-five applications. This paper describes the initial analysis of the application characteristics and performance goals, as well as current and future application engagement activities driven by these results. While the survey was conducted primarily to meet PERI needs, the results represent a snapshot of the state of SciDAC code development and may be of use to the DOE community at large. Overall, the results show that SciDAC application teams are engaged in significant new code development, which will require flexible performance optimization techniques that can improve performance as the applications evolve.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Mon Jan 01 00:00:00 EST 2007},
month = {Mon Jan 01 00:00:00 EST 2007}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share:
  • One of the main goals of the Dept. of Energy funded SciDAC-Data project is to analyze the more than 410,000 high energy physics datasets that have been collected, generated and defined over the past two decades by experiments using the Fermilab storage facilities. These datasets have been used as the input to over 5.6 million recorded analysis projects, for which detailed analytics have been gathered. The analytics and meta information for these datasets and analysis projects are being combined with knowledge of their part of the HEP analysis chains for major experiments to understand how modern computing and data deliverymore » is being used. We present the first results of this project, which examine in detail how the CDF, D0, NOvA, MINERvA and MicroBooNE experiments have organized, classified and consumed petascale datasets to produce their physics results. The results include analysis of the correlations in dataset/file overlap, data usage patterns, data popularity, dataset dependency and temporary dataset consumption. The results provide critical insight into how workflows and data delivery schemes can be combined with different caching strategies to more efficiently perform the work required to mine these large HEP data volumes and to understand the physics analysis requirements for the next generation of HEP computing facilities. In particular we present a detailed analysis of the NOvA data organization and consumption model corresponding to their first and second oscillation results (2014-2016) and the first look at the analysis of the Tevatron Run II experiments. We present statistical distributions for the characterization of these data and data driven models describing their consumption« less
  • SciDAC has had a major impact on computational beam dynamics and the design of particle accelerators. Particle accelerators--which account for half of the facilities in the DOE Office of Science Facilities for the Future of Science 20 Year Outlook--are crucial for US scientific, industrial, and economic competitiveness. Thanks to SciDAC, accelerator design calculations that were once thought impossible are now carried routinely, and new challenging and important calculations are within reach. SciDAC accelerator modeling codes are being used to get the most science out of existing facilities, to produce optimal designs for future facilities, and to explore advanced accelerator conceptsmore » that may hold the key to qualitatively new ways of accelerating charged particle beams. In this poster we present highlights from the SciDAC Accelerator Science and Technology (AST) project Beam Dynamics focus area in regard to algorithm development, software development, and applications.« less
  • The LHC era will start very soon, creating immense data volumes capable of demanding allocation of an entire network circuit for task-driven applications. Circuit-based alternate network paths are one solution to meeting the LHC high bandwidth network requirements. The Lambda Station project is aimed at addressing growing requirements for dynamic allocation of alternate network paths. Lambda Station facilitates the rerouting of designated traffic through site LAN infrastructure onto so-called 'high-impact' wide-area networks. The prototype Lambda Station developed with Service Oriented Architecture (SOA) approach in mind will be presented. Lambda Station has been successfully integrated into the production version of themore » Storage Resource Manager (SRM), and deployed at US CMS Tier1 center at Fermilab, as well as at US-CMS Tier-2 site at Caltech. This paper will discuss experiences using the prototype system with production SciDAC applications for data movement between Fermilab and Caltech. The architecture and design principles of the production version Lambda Station software, currently being implemented as Java based web services, will also be presented in this paper.« less
  • We present a brief overview of optimization tools that are being developed for SciDAC applications. We emphasize derivative-free and gradient-based methods since these tools make minimal demands on the user and the application. We discuss the performance of these tools and point out developments that have led to significant improvements in performance. A parameter estimation problem that arises in nuclear fission is used to illustrate the challenges that arise as we attack nonlinear, noisy, computationally-intensive optimization applications.