skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Application of a variance-based sensitivity analysis method to the Biomass Scenario Learning Model

Journal Article · · System Dynamics Review
DOI:https://doi.org/10.1002/sdr.1594· OSTI ID:1459456
 [1];  [1]; ORCiD logo [1];  [1];  [2]
  1. National Renewable Energy Lab. (NREL), Golden, CO (United States)
  2. National Renewable Energy Lab. (NREL), Golden, CO (United States); Dartmouth College, Hanover, NH (United States)

Variance-based sensitivity analysis can provide a comprehensive understanding of the input factors that drive model behavior, complementing more traditional system dynamics methods with quantitative metrics. This paper presents the methodology of a variance-based sensitivity analysis of the Biomass Scenario Learning Model, a published STELLA model of interactions among investment, production, and learning in an emerging competitive industry. We document the methodology requirements, interpretations, and constraints, and compute estimated sensitivity indices and their uncertainties. Here in this paper we show that application of variance-based sensitivity analysis to the model allows us to test for non-additivity, identify influential and interactive variables, and confirm model formulation. To enable use of this type of sensitivity analysis in other system dynamics models, we provide this study's R code, annotated to facilitate adaptation to other studies. A related paper describes application of these techniques to the much larger Biomass Scenario Model.

Research Organization:
National Renewable Energy Laboratory (NREL), Golden, CO (United States)
Sponsoring Organization:
USDOE Office of Energy Efficiency and Renewable Energy (EERE), Sustainable Transportation Office. Bioenergy Technologies Office (BETO)
Grant/Contract Number:
AC36-08GO28308
OSTI ID:
1459456
Alternate ID(s):
OSTI ID: 1460765; OSTI ID: 1464323
Report Number(s):
NREL/JA-6A20-73821
Journal Information:
System Dynamics Review, Journal Name: System Dynamics Review Vol. 33 Journal Issue: 3-4; ISSN 0883-7066
Publisher:
WileyCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (15)

Analysis of variance designs for model output journal March 1999
Making best use of model evaluations to compute sensitivity indices journal May 2002
Improving model understanding using statistical screening journal December 2009
Sensitivity analysis of environmental models: A systematic review with practical workflow journal May 2016
Importance measures in global sensitivity analysis of nonlinear models journal April 1996
Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index journal February 2010
Quantifying the impacts of rework, schedule pressure, and ripple effect loops on project schedule performance: Quantifying Reinforcing Loop Impacts journal January 2016
Factorial Sampling Plans for Preliminary Computational Experiments journal May 1991
Sensitivity analysis and optimization of system dynamics models: Regression analysis and statistical design of experiments journal January 1995
Determining intervention thresholds that change output behavior patterns: Determining intervention thresholds journal July 2016
Sensitivity analysis for models with multiple behavior modes: a method based on behavior pattern measures: Sensitivity Analysis by Behavior Pattern Measures journal July 2016
Sensitivity analysis of graphical functions: Sensitivity Analysis of Graphical Functions journal July 2014
Estimating the approximation error when fixing unessential factors in global sensitivity analysis journal July 2007
Statistical screening of system dynamics models journal January 2005
Sensitivity measures,anova-like Techniques and the use of bootstrap journal May 1997