skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Recommended Research Directions for Improving the Validation of Complex Systems Models.

Abstract

Improved validation for models of complex systems has been a primary focus over the past year for the Resilience in Complex Systems Research Challenge. This document describes a set of research directions that are the result of distilling those ideas into three categories of research -- epistemic uncertainty, strong tests, and value of information. The content of this document can be used to transmit valuable information to future research activities, update the Resilience in Complex Systems Research Challenge's roadmap, inform the upcoming FY18 Laboratory Directed Research and Development (LDRD) call and research proposals, and facilitate collaborations between Sandia and external organizations. The recommended research directions can provide topics for collaborative research, development of proposals, workshops, and other opportunities.

Authors:
 [1];  [1];  [1];  [1];  [1];  [1];  [1];  [1]
  1. Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Publication Date:
Research Org.:
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Sponsoring Org.:
USDOE National Nuclear Security Administration (NNSA)
OSTI Identifier:
1367494
Report Number(s):
SAND2017-1753
654205
DOE Contract Number:
AC04-94AL85000
Resource Type:
Technical Report
Country of Publication:
United States
Language:
English
Subject:
99 GENERAL AND MISCELLANEOUS

Citation Formats

Vugrin, Eric D., Trucano, Timothy G., Swiler, Laura Painton, Finley, Patrick D., Flanagan, Tatiana Paz, Naugle, Asmeret Bier, Tsao, Jeffrey Y., and Verzi, Stephen Joseph. Recommended Research Directions for Improving the Validation of Complex Systems Models.. United States: N. p., 2017. Web. doi:10.2172/1367494.
Vugrin, Eric D., Trucano, Timothy G., Swiler, Laura Painton, Finley, Patrick D., Flanagan, Tatiana Paz, Naugle, Asmeret Bier, Tsao, Jeffrey Y., & Verzi, Stephen Joseph. Recommended Research Directions for Improving the Validation of Complex Systems Models.. United States. doi:10.2172/1367494.
Vugrin, Eric D., Trucano, Timothy G., Swiler, Laura Painton, Finley, Patrick D., Flanagan, Tatiana Paz, Naugle, Asmeret Bier, Tsao, Jeffrey Y., and Verzi, Stephen Joseph. Wed . "Recommended Research Directions for Improving the Validation of Complex Systems Models.". United States. doi:10.2172/1367494. https://www.osti.gov/servlets/purl/1367494.
@article{osti_1367494,
title = {Recommended Research Directions for Improving the Validation of Complex Systems Models.},
author = {Vugrin, Eric D. and Trucano, Timothy G. and Swiler, Laura Painton and Finley, Patrick D. and Flanagan, Tatiana Paz and Naugle, Asmeret Bier and Tsao, Jeffrey Y. and Verzi, Stephen Joseph},
abstractNote = {Improved validation for models of complex systems has been a primary focus over the past year for the Resilience in Complex Systems Research Challenge. This document describes a set of research directions that are the result of distilling those ideas into three categories of research -- epistemic uncertainty, strong tests, and value of information. The content of this document can be used to transmit valuable information to future research activities, update the Resilience in Complex Systems Research Challenge's roadmap, inform the upcoming FY18 Laboratory Directed Research and Development (LDRD) call and research proposals, and facilitate collaborations between Sandia and external organizations. The recommended research directions can provide topics for collaborative research, development of proposals, workshops, and other opportunities.},
doi = {10.2172/1367494},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Wed Feb 01 00:00:00 EST 2017},
month = {Wed Feb 01 00:00:00 EST 2017}
}

Technical Report:

Save / Share:
  • This report contains the written footprint of a Sandia-hosted workshop held in Albuquerque, New Mexico, June 22-23, 2016 on “Complex Systems Models and Their Applications: Towards a New Science of Verification, Validation and Uncertainty Quantification,” as well as of pre-work that fed into the workshop. The workshop’s intent was to explore and begin articulating research opportunities at the intersection between two important Sandia communities: the complex systems (CS) modeling community, and the verification, validation and uncertainty quantification (VVUQ) community The overarching research opportunity (and challenge) that we ultimately hope to address is: how can we quantify the credibility of knowledgemore » gained from complex systems models, knowledge that is often incomplete and interim, but will nonetheless be used, sometimes in real-time, by decision makers?« less
  • The project under this CRADA will analyze field data of various flat-plate and concentrator module technologies and cell measurements at the laboratory level. The field data will consist of current versus voltage data collected over many years on a latitude tilt test bed for Si, CdTe, amorphous silicon, and CIGS technologies. The concentrator data will be for mirror- and lens-based module designs using multijunction cells. The laboratory data will come from new measurements of cell performance with systematic variation of irradiance, temperature and spectral composition. These measurements will be labor-intensive and the aim will be to cover the widest possiblemore » parameter space for as many different PV samples as possible. The data analysis will require software tools to be developed. These tools will be customized for use with the specific NREL datasets and will be unsuitable for commercial release. The tools will be used to evaluate different translation equations against NREL outdoor datasets.« less
  • Recommendations are presented for research areas concerned with seismic safety. These recommendations are based on an analysis of the answers to a questionnaire which was sent to over 80 persons working in the area of seismic safety of nuclear power plants. In addition to the answers of the 55 questionnaires which were received, the recommendations are based on ideas expressed at a meeting of an ad hoc group of professionals formed by Sandia, review of literature, current research programs, and engineering judgement.
  • The report recommends sub-slab depressurization systems design criteria to the State of Florida's Department of Community Affairs for their building code for radon resistant houses. Numerous details are set forth in the full report. Primary criteria include: (1) the operating soil depressurization system shall maintain under the entire building a static pressure less than the outdoor air static pressure; (2) suction shall be provided by a fan rated for continuous operation and having thermal overload protection with automatic reset features; (3) vent piping shall have a minimum slope of 1/8-in./ft (1.04 cm/m) in order to drain any condensation back tomore » the soil beneath the soil gas retarder; and (4) suction points shall be equally distributed as follows: a maximum of 1300 sq ft (120.8 sq m) per suction point, each suction point located not less than 6 ft (1.3 m) nor more than 18 ft (5.5 m) from the perimeter, and multiple suction points shall be located within 36 ft (11.0 m) of each other. Documentation is presented in support of the recommendations.« less
  • The objective of the research project was to investigate methods for improving the reliability of compartmental models such as conceptual rainfall-runoff models. The study focused on the structural nonidentifiability problems of such models that have been observed to cause severe parameter-estimation difficulties. In particular, the problems arising due to the threshold nature of some parameters were investigated. Three new mathematical procedures were developed. One is a new objective function for rainfall-runoff models that was developed using likelihood theory and based on the error structure arising due to the nonlinear nature of the rating curve.