skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Investigating User Experiences with Data Abstractions on High Performance Computing Systems

Abstract

Scientific exploration generates expanding volumes of data that commonly require High Performance Computing (HPC) systems to facilitate research. HPC systems are complex ecosystems of hardware and software that frequently are not user friendly. The Usable Data Abstractions (UDA) project set out to build usable software for scientific workflows in HPC environments by undertaking multiple rounds of qualitative user research. Qualitative research investigates how individuals accomplish their work and our interview-based study surfaced a variety of insights about the experiences of working in and with HPC ecosystems. This report examines multiple facets to the experiences of scientists and developers using and supporting HPC systems. We discuss how stakeholders grasp the design and configuration of these systems, the impacts of abstraction layers on their ability to successfully do work, and the varied perceptions of time that shape this work. Examining the adoption of the Cori HPC at NERSC we explore the anticipations and lived experiences of users interacting with this system’s novel storage feature, the Burst Buffer. We present lessons learned from across these insights to illustrate just some of the challenges HPC facilities and their stakeholders need to account for when procuring and supporting these essential scientific resources to ensure theirmore » usability and utility to a variety of scientific practices.« less

Authors:
 [1];  [1];  [1]
  1. Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
Publication Date:
Research Org.:
Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
OSTI Identifier:
1805039
Report Number(s):
LBNL-2001374
ark:/13030/qt1j93t5gm
DOE Contract Number:  
AC02-05CH11231
Resource Type:
Technical Report
Country of Publication:
United States
Language:
English
Subject:
user research; qualitative methods; HPC system; abstraction layers; Burst Buffer

Citation Formats

Paine, Drew, Poon, Sarah, and Ramakrishnan, Lavanya. Investigating User Experiences with Data Abstractions on High Performance Computing Systems. United States: N. p., 2021. Web. doi:10.2172/1805039.
Paine, Drew, Poon, Sarah, & Ramakrishnan, Lavanya. Investigating User Experiences with Data Abstractions on High Performance Computing Systems. United States. https://doi.org/10.2172/1805039
Paine, Drew, Poon, Sarah, and Ramakrishnan, Lavanya. 2021. "Investigating User Experiences with Data Abstractions on High Performance Computing Systems". United States. https://doi.org/10.2172/1805039. https://www.osti.gov/servlets/purl/1805039.
@article{osti_1805039,
title = {Investigating User Experiences with Data Abstractions on High Performance Computing Systems},
author = {Paine, Drew and Poon, Sarah and Ramakrishnan, Lavanya},
abstractNote = {Scientific exploration generates expanding volumes of data that commonly require High Performance Computing (HPC) systems to facilitate research. HPC systems are complex ecosystems of hardware and software that frequently are not user friendly. The Usable Data Abstractions (UDA) project set out to build usable software for scientific workflows in HPC environments by undertaking multiple rounds of qualitative user research. Qualitative research investigates how individuals accomplish their work and our interview-based study surfaced a variety of insights about the experiences of working in and with HPC ecosystems. This report examines multiple facets to the experiences of scientists and developers using and supporting HPC systems. We discuss how stakeholders grasp the design and configuration of these systems, the impacts of abstraction layers on their ability to successfully do work, and the varied perceptions of time that shape this work. Examining the adoption of the Cori HPC at NERSC we explore the anticipations and lived experiences of users interacting with this system’s novel storage feature, the Burst Buffer. We present lessons learned from across these insights to illustrate just some of the challenges HPC facilities and their stakeholders need to account for when procuring and supporting these essential scientific resources to ensure their usability and utility to a variety of scientific practices.},
doi = {10.2172/1805039},
url = {https://www.osti.gov/biblio/1805039}, journal = {},
number = ,
volume = ,
place = {United States},
year = {2021},
month = {6}
}