Skip to main content
OSTI.GOVU.S. Department of Energy Office of Scientific and Technical Information
U.S. Department of Energy
Office of Scientific and Technical Information
 

Application-level regression testing framework using Jenkins

Journal Article · · Concurrency and Computation. Practice and Experience
DOI:https://doi.org/10.1002/cpe.4339· OSTI ID:1399387
 [1];  [2];  [2]
  1. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). National Center for Computational Sciences
  2. Univ. of Illinois, Urbana-Champaign, IL (United States). National Center for Supercomputing Applications
+ Show Author Affiliations
Monitoring and testing for regression of large-scale systems such as the NCSA's Blue Waters supercomputer are challenging tasks. In this paper, we describe the solution we came up with to perform those tasks. The goal was to find an automated solution for running user-level regression tests to evaluate system usability and performance. Jenkins, an automation server software, was chosen for its versatility, large user base, and multitude of plugins including collecting data and plotting test results over time. We also describe our Jenkins deployment to launch and monitor jobs on remote HPC system, perform authentication with one-time password, and integrate with our LDAP server for its authorization. We show some use cases and describe our best practices for successfully using Jenkins as a user-level system-wide regression testing and monitoring framework for large supercomputer systems.
Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States); Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
Sponsoring Organization:
National Science Foundation (NSF); USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)
Grant/Contract Number:
AC05-00OR22725
OSTI ID:
1399387
Alternate ID(s):
OSTI ID: 1376453
Journal Information:
Concurrency and Computation. Practice and Experience, Journal Name: Concurrency and Computation. Practice and Experience Journal Issue: 1 Vol. 30; ISSN 1532-0626
Publisher:
WileyCopyright Statement
Country of Publication:
United States
Language:
English

References (1)

Scalable molecular dynamics with NAMD journal January 2005

Similar Records

Provably Secure Password-based Authentication in TLS
Conference · Mon Dec 19 23:00:00 EST 2005 · OSTI ID:881394
Price of gasoline: forecasting comparisons. [Box-Jenkins, econometric, and regression methods]
Journal Article · · Q. Rev. Econ. Bus.; (United States) · OSTI ID:6352514
Implementing a secure client/server application
Conference · Mon Aug 01 00:00:00 EDT 1994 · OSTI ID:102395

Related Subjects

97 MATHEMATICS AND COMPUTING
applications
benchmarking
performance
regression-testing
system-monitoring