Approach to Quality Assurance for Complex Environmental Modeling - 20407
- Neptune and Company, Inc., Los Alamos, New Mexico and Lakewood, Colorado (United States)
A strong Quality Assurance (QA) program for complex environmental modeling is essential for regulatory and public acceptance and trust, but it does not have to be onerous. Neptune and Company, Inc. (Neptune) has developed a strong QA program that improves transparency, traceability, reproducibility, and therefore, defensibility and trust. Neptune's QA program has evolved over the past 27 years, transitioning from an ad hoc QA program, to a program that is currently Nuclear Quality Assurance-1 (NQA-1) compliant, and will soon be NQA-1/DOE approved for DOE EM modeling work. In addition, Neptune is a qualified laboratory assessor and qualified auditor for reference materials, a proficiency testing provider, and fully complies with the Environmental Protection Agency (EPA) QA program. Neptune's President and CEO, Kelly Black, was recently named the Chairperson of the International Organization for Standardization (ISO) Technical Committee 69, Application of Statistical Methods. A strong QA program has been developed for Neptune's radiological performance assessment (PA) program. Although pieces of their QA program are currently in development, their current program includes document control using Subversion, issue tracking and work flow tracking using JIRA, and transparency and traceability via a system of 'calc sheets' for documentation of all data analysis and modeling combined with 'check print' documentation of QA checking, and rigorous model testing and configuration control. All work is reviewed by an independent subject matter expert who is not associated with the collection and assembly of information, for an internal peer review. The program is enforced with a handful of Standard Operation Procedures (SOPs), Work Instructions, QA Project Plans (QAPPs), and Quality Management Plans (QMPs) that are updated frequently, with required annual training and acknowledgment. In addition, effective communication of modeling approaches and results to clients and stakeholders are integral to their QA program. Many of their models are built using the GoldSim modeling platform, for which their models are well-known for their level of transparency, documentation, and QA traceability. This level of QA is also applied to their process-level models. Neptune has taken some lessons learned from the extremely rigorous QA program required for the Yucca Mountain Project (YMP), and imposed the YMP requirements of complete traceability, transparency, and reproducibility, but avoided the inflexibility of a QA program that likely contributed to the suspect e-mails in 2005 that resulted in loss of trust in the YMP, and in nuclear waste disposal (and nuclear power) in general. There are far too many examples of loss of public trust due to poor QA that could have been easily avoided with a simple and straight-forward QA program combined with stakeholder engagement. The purpose of this paper is to share features of Neptune's Radiological Performance Assessment program QA program, and some of their QA related lessons learned over the past 27 years of QA for complex environmental modeling. (authors)
- Research Organization:
- WM Symposia, Inc., PO Box 27646, 85285-7646 Tempe, AZ (United States)
- OSTI ID:
- 23028021
- Report Number(s):
- INIS-US-21-WM-20407; TRN: US21V1857068373
- Resource Relation:
- Conference: WM2020: 46. Annual Waste Management Conference, Phoenix, AZ (United States), 8-12 Mar 2020; Other Information: Country of input: France; 10 refs.; available online at: https://www.xcdsystem.com/wmsym/2020/index.html
- Country of Publication:
- United States
- Language:
- English
Similar Records
Quality Assurance Protocol for AFCI Advanced Structural Materials Testing
NOMINATION FOR THE PROJECT MANAGEMENT INSTITUTE (PMI) PROJECT OF THE YEAR AWARD INTEGRATED DISPOSAL FACILITY (IDF)
Related Subjects
54 ENVIRONMENTAL SCIENCES
COMMUNICATIONS
COMPUTERIZED SIMULATION
CONFIGURATION CONTROL
DATA ANALYSIS
DOCUMENTATION
ENVIRONMENTAL PROTECTION
OPACITY
PERFORMANCE
QUALITY ASSURANCE
RADIOACTIVE WASTE DISPOSAL
STANDARDIZATION
TESTING
US EPA
YUCCA MOUNTAIN