skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: SAPHIRE 8 Quality Assurance Software Metrics Report

Abstract

The purpose of this review of software metrics is to examine the quality of the metrics gathered in the 2010 IV&V and to set an outline for results of updated metrics runs to be performed. We find from the review that the maintenance of accepted quality standards presented in the SAPHIRE 8 initial Independent Verification and Validation (IV&V) of April, 2010 is most easily achieved by continuing to utilize the tools used in that effort while adding a metric of bug tracking and resolution. Recommendations from the final IV&V were to continue periodic measurable metrics such as McCabe's complexity measure to ensure quality is maintained. The four software tools used to measure quality in the IV&V were CodeHealer, Coverage Validator, Memory Validator, Performance Validator, and Thread Validator. These are evaluated based on their capabilities. We attempted to run their latest revisions with the newer Delphi 2010 based SAPHIRE 8 code that has been developed and was successful with all of the Validator series of tools on small tests. Another recommendation from the IV&V was to incorporate a bug tracking and resolution metric. To improve our capability of producing this metric, we integrated our current web reporting system with the SpiraTestmore » test management software purchased earlier this year to track requirements traceability.« less

Authors:
Publication Date:
Research Org.:
Idaho National Laboratory (INL)
Sponsoring Org.:
USDOE
OSTI Identifier:
1031699
Report Number(s):
INL/EXT-11-23138
TRN: US201201%%931
DOE Contract Number:  
DE-AC07-05ID14517
Resource Type:
Technical Report
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICAL METHODS AND COMPUTING; COMPUTER CODES; PROGRAMMING; MAINTENANCE; MANAGEMENT; METRICS; PERFORMANCE; QUALITY ASSURANCE; RECOMMENDATIONS; RESOLUTION; VALIDATION; VERIFICATION; Metrics; QA; Software

Citation Formats

Kurt G. Vedros. SAPHIRE 8 Quality Assurance Software Metrics Report. United States: N. p., 2011. Web. doi:10.2172/1031699.
Kurt G. Vedros. SAPHIRE 8 Quality Assurance Software Metrics Report. United States. doi:10.2172/1031699.
Kurt G. Vedros. Mon . "SAPHIRE 8 Quality Assurance Software Metrics Report". United States. doi:10.2172/1031699. https://www.osti.gov/servlets/purl/1031699.
@article{osti_1031699,
title = {SAPHIRE 8 Quality Assurance Software Metrics Report},
author = {Kurt G. Vedros},
abstractNote = {The purpose of this review of software metrics is to examine the quality of the metrics gathered in the 2010 IV&V and to set an outline for results of updated metrics runs to be performed. We find from the review that the maintenance of accepted quality standards presented in the SAPHIRE 8 initial Independent Verification and Validation (IV&V) of April, 2010 is most easily achieved by continuing to utilize the tools used in that effort while adding a metric of bug tracking and resolution. Recommendations from the final IV&V were to continue periodic measurable metrics such as McCabe's complexity measure to ensure quality is maintained. The four software tools used to measure quality in the IV&V were CodeHealer, Coverage Validator, Memory Validator, Performance Validator, and Thread Validator. These are evaluated based on their capabilities. We attempted to run their latest revisions with the newer Delphi 2010 based SAPHIRE 8 code that has been developed and was successful with all of the Validator series of tools on small tests. Another recommendation from the IV&V was to incorporate a bug tracking and resolution metric. To improve our capability of producing this metric, we integrated our current web reporting system with the SpiraTest test management software purchased earlier this year to track requirements traceability.},
doi = {10.2172/1031699},
journal = {},
number = ,
volume = ,
place = {United States},
year = {2011},
month = {8}
}

Technical Report:

Save / Share: