Understanding Interactive and Reproducible Computing With Jupyter Tools at Facilities

Technical Report · Thu Oct 01 04:00:00 EDT 2020

DOI:https://doi.org/10.2172/1695768· OSTI ID:1695768

Paine, Drew ^[1]; Ramakrishnan, Lavanya ^[1]

---

1. Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)

Increasingly Jupyter tools are being adopted and incorporated into High Performance Computing (HPC) and scientific user facilities. Adopting Jupyter tools enables more interactive and reproducible computational work at facilities across data life cycles. As the volume, variety, and scope of data grow, scientists need to be able to analyze and share results in user friendly ways. Human-centered research highlights design challenges around computational notebooks, and our qualitative user study shifts focus to better characterize how Jupyter tools are being used in HPC and science user facilities today. We conducted twenty-nine interviews, and obtained 103 survey responses from NERSC Jupyter users, to better understand the increasing role of interactive computing tools in DOE sponsored scientific work. We examine a range of issues that emerge using and supporting Jupyter in HPC ecosystems, including: how Jupyter is being used by scientists in HPC and user facility ecosystems; how facilities are purposefully supporting Jupyter in their ecosystems; feedback NERSC users have about the facility’s deployment, and, discuss features NERSC indicated would be helpful. We offer a variety of takeaways for staff supporting Jupyter at facilities, Project Jupyter and related open source communities, and funding agencies supporting interactive computing work.

• Research Organization: Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
• Sponsoring Organization: USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
• DOE Contract Number: AC02-05CH11231
• OSTI ID: 1695768
• Report Number(s): LBNL--2001355; ark:/13030/qt9n11k2zm
• Country of Publication: United States
• Language: English

Related Subjects

97 MATHEMATICS AND COMPUTING
HPC user facilities
Jupyter
qualitative research
science user facilities