DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Harnessing expert knowledge: Defining a Bayesian network decision model with limited data-Model structure for the vibration qualification problem

Journal Article · · Systems Engineering
DOI: https://doi.org/10.1002/sys.21431 · OSTI ID:1432479
ORCiD logo [1];  [2]
  1. Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
  2. Stevens Inst. of Technology, Hoboken, NJ (United States)

As systems become more complex, systems engineers rely on experts to inform decisions. There are few experts and limited data in many complex new technologies. This challenges systems engineers as they strive to plan activities such as qualification in an environment where technical constraints are coupled with the traditional cost, risk, and schedule constraints. Bayesian network (BN) models provide a framework to aid systems engineers in planning qualification efforts with complex constraints by harnessing expert knowledge and incorporating technical factors. By quantifying causal factors, a BN model can provide data about the risk of implementing a decision supplemented with information on driving factors. This allows a systems engineer to make informed decisions and examine “what-if” scenarios. This paper discusses a novel process developed to define a BN model structure based primarily on expert knowledge supplemented with extremely limited data (25 data sets or less). The model was developed to aid qualification decisions—specifically to predict the suitability of six degrees of freedom (6DOF) vibration testing for qualification. The process defined the model structure with expert knowledge in an unbiased manner. Finally, validation during the process execution and of the model provided evidence the process may be an effective tool in harnessing expert knowledge for a BN model.

Research Organization:
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Sponsoring Organization:
USDOE National Nuclear Security Administration (NNSA)
Grant/Contract Number:
AC04-94AL85000; NA0003525
OSTI ID:
1432479
Alternate ID(s):
OSTI ID: 1478216
Report Number(s):
SAND-2018-3223J; SAND-2017-2685J; 661799
Journal Information:
Systems Engineering, Vol. 21, Issue 4; ISSN 1098-1241
Publisher:
WileyCopyright Statement
Country of Publication:
United States
Language:
English
Citation Metrics:
Cited by: 5 works
Citation information provided by
Web of Science

References (19)

Decision support analysis for safety control in complex project environments based on Bayesian Networks journal September 2013
Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. journal January 1993
Use of Bayesian Networks for Qualification Planning: Early Results of Factor Analysis journal January 2016
From complex questionnaire and interviewing data to intelligent Bayesian network models for medical decision support journal February 2016
Risk modelling of a hydrogen refuelling station using Bayesian network journal February 2011
Use of Bayesian Networks for Qualification Planning: A Predictive Analysis Framework for a Technically Complex Systems Engineering Problem journal January 2015
Metrics for evaluating performance and uncertainty of Bayesian network models journal April 2012
Assessing structural knowledge. journal March 1991
Assessment of Catastrophic Risk Using Bayesian Network Constructed from Domain Knowledge and Spatial Data: Assessment of Catastrophic Risk Using Bayesian Network journal April 2010
A Method for Integrating Expert Knowledge When Learning Bayesian Networks From Data journal October 2011
Drawbacks of complex models in frequentist and Bayesian approaches to natural-resource management journal January 2009
Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. journal January 1993
Good practice in Bayesian network modelling journal November 2012
Interdisciplinary Aspects of Cost-Risk Tradeoffs conference September 2006
A proposed validation framework for expert elicited Bayesian Networks journal January 2013
Analyzing the structure of expert knowledge journal January 2006
Application of a Bayesian model for the quantification of the European methodology for qualification of non-destructive testing journal February 2010
Mapping model validation metrics to subject matter expert scores for model adequacy assessment journal December 2014
The case for objective Bayesian analysis journal September 2006

Cited By (1)

Elemental patterns of verification strategies journal March 2019