DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Energy sector portfolio analysis with uncertainty

Abstract

Governments are dealing with the challenge of how to efficiently invest in research and development portfolios related to energy technologies. Research and development investment decisions in the energy space are especially difficult due to numerous risks and uncertainties, and due to the complexity of energy's interactions with the broad economy. Historically, much of the U.S. Department of Energy's in-depth research and development analyses focused on assessing the impact of a research and development activity in isolation from other available opportunities and did not substantially consider risk and uncertainty. Endeavoring to combine integrated energy-economy modeling with uncertainty analysis and technology-specific research and development activities, the U.S. Department of Energy commissioned the development of the Stochastic Energy Deployment System to support and improve public energy research and development decision-making. The Stochastic Energy Deployment System draws from expert-elicited probability distributions for research and development-driven improvements in technology cost and performance, and it uses Monte Carlo simulations to evaluate the likelihood of outcomes within a system dynamics energy-economy model. The framework estimates the uncertain benefits and costs of various research and development portfolios and provides insight into the probability of meeting national technology goals, while accounting for interactions with the larger economy and formore » interactions among research and development investments spanning many energy sectors.« less

Authors:
 [1];  [1]; ORCiD logo [2]; ORCiD logo [2];  [2];  [3]
  1. Lumina Decision Systems, Los Gatos, CA (United States)
  2. National Renewable Energy Lab. (NREL), Golden, CO (United States)
  3. US Department of Energy (USDOE), Washington DC (United States)
Publication Date:
Research Org.:
National Renewable Energy Lab. (NREL), Golden, CO (United States)
Sponsoring Org.:
USDOE Office of Energy Efficiency and Renewable Energy (EERE), Strategic Programs (EE-SP)
OSTI Identifier:
1828146
Report Number(s):
NREL/JA-6A20-78746
Journal ID: ISSN 0306-2619; MainId:32663;UUID:d7baf4c3-6832-4de2-b8df-4a0d58b136db;MainAdminID:63246
Grant/Contract Number:  
AC36-08GO28308
Resource Type:
Accepted Manuscript
Journal Name:
Applied Energy
Additional Journal Information:
Journal Volume: 306; Journal Issue: Part A; Journal ID: ISSN 0306-2619
Publisher:
Elsevier
Country of Publication:
United States
Language:
English
Subject:
29 ENERGY PLANNING, POLICY, AND ECONOMY; energy system; expert elicitation; portfolio analysis; Stochastic Energy Deployment System; stochasticity; uncertainty

Citation Formats

Milford, James, Henrion, Max, Hunter, Chad, Newes, Emily, Hughes, Caroline, and Baldwin, Samuel F. Energy sector portfolio analysis with uncertainty. United States: N. p., 2021. Web. doi:10.1016/j.apenergy.2021.117926.
Milford, James, Henrion, Max, Hunter, Chad, Newes, Emily, Hughes, Caroline, & Baldwin, Samuel F. Energy sector portfolio analysis with uncertainty. United States. https://doi.org/10.1016/j.apenergy.2021.117926
Milford, James, Henrion, Max, Hunter, Chad, Newes, Emily, Hughes, Caroline, and Baldwin, Samuel F. Sat . "Energy sector portfolio analysis with uncertainty". United States. https://doi.org/10.1016/j.apenergy.2021.117926. https://www.osti.gov/servlets/purl/1828146.
@article{osti_1828146,
title = {Energy sector portfolio analysis with uncertainty},
author = {Milford, James and Henrion, Max and Hunter, Chad and Newes, Emily and Hughes, Caroline and Baldwin, Samuel F.},
abstractNote = {Governments are dealing with the challenge of how to efficiently invest in research and development portfolios related to energy technologies. Research and development investment decisions in the energy space are especially difficult due to numerous risks and uncertainties, and due to the complexity of energy's interactions with the broad economy. Historically, much of the U.S. Department of Energy's in-depth research and development analyses focused on assessing the impact of a research and development activity in isolation from other available opportunities and did not substantially consider risk and uncertainty. Endeavoring to combine integrated energy-economy modeling with uncertainty analysis and technology-specific research and development activities, the U.S. Department of Energy commissioned the development of the Stochastic Energy Deployment System to support and improve public energy research and development decision-making. The Stochastic Energy Deployment System draws from expert-elicited probability distributions for research and development-driven improvements in technology cost and performance, and it uses Monte Carlo simulations to evaluate the likelihood of outcomes within a system dynamics energy-economy model. The framework estimates the uncertain benefits and costs of various research and development portfolios and provides insight into the probability of meeting national technology goals, while accounting for interactions with the larger economy and for interactions among research and development investments spanning many energy sectors.},
doi = {10.1016/j.apenergy.2021.117926},
journal = {Applied Energy},
number = Part A,
volume = 306,
place = {United States},
year = {Sat Oct 09 00:00:00 EDT 2021},
month = {Sat Oct 09 00:00:00 EDT 2021}
}

Works referenced in this record:

Selecting balanced portfolios of R&D projects with interdependencies: A Cross-Entropy based methodology
journal, January 2014


Energy technology expert elicitations: An application to natural gas turbine efficiencies
journal, July 2014


Future Prospects for Energy Technologies: Insights from Expert Elicitations
journal, January 2018

  • Verdolini, Elena; Anadón, Laura Díaz; Baker, Erin
  • Review of Environmental Economics and Policy, Vol. 12, Issue 1
  • DOI: 10.1093/reep/rex028

Expert Elicitation: Using the Classical Model to Validate Experts’ Judgments
journal, January 2018

  • Colson, Abigail R.; Cooke, Roger M.
  • Review of Environmental Economics and Policy, Vol. 12, Issue 1
  • DOI: 10.1093/reep/rex022

Optimizing the level of renewable electric R&D expenditures using real options analysis
journal, December 2003


Multi-period project portfolio selection under risk considerations and stochastic income
journal, February 2018

  • Tofighian, Ali Asghar; Moezzi, Hamid; Khakzar Barfuei, Morteza
  • Journal of Industrial Engineering International, Vol. 14, Issue 3
  • DOI: 10.1007/s40092-017-0242-6

Climate change and optimal energy technology R&D policy
journal, September 2011


Special issue on defining robust energy R&D portfolios
journal, May 2015


Real options valuation of a federally funded small Business portfolio
conference, June 2017


Contingent Portfolio Programming for the Management of Risky Projects
journal, December 2005


Future costs of key low-carbon energy technologies: Harmonization and aggregation of energy technology expert elicitation data
journal, May 2015


A comprehensive approach for the selection of a portfolio of interdependent projects. An application to subsidized projects in Spain
journal, April 2018


Addressing R&D investment decisions: a cross analysis of R&D project selection methods
journal, August 2010


An optimization methodology for identifying robust process integration investments under uncertainty
journal, February 2009


Rethinking CCS – Developing Quantitative Tools for Analyzing Investments in CCS
journal, January 2013


Carbon capture and storage: combining economic analysis with expert elicitations to inform climate policy
journal, July 2009


Sensitivity to energy technology costs: A multi-model comparison analysis
journal, May 2015


Optimal strategies for selecting project portfolios using uncertain value estimates
journal, March 2014

  • Vilkkumaa, Eeva; Liesiö, Juuso; Salo, Ahti
  • European Journal of Operational Research, Vol. 233, Issue 3
  • DOI: 10.1016/j.ejor.2013.09.023

Wright meets Markowitz: How standard portfolio theory changes when assets are technologies following experience curves
journal, April 2019

  • Way, Rupert; Lafond, François; Lillo, Fabrizio
  • Journal of Economic Dynamics and Control, Vol. 101
  • DOI: 10.1016/j.jedc.2018.10.006

Energy R&D portfolio analysis based on climate change mitigation
journal, July 2011


Contingency Planning in Project Selection Using Multiobjective Optimization and Chance Constraints
journal, June 2006


Modeling uncertainty of expert elicitation for use in risk-based optimization
journal, September 2018

  • Teter, Michael D.; Royset, Johannes O.; Newman, Alexandra M.
  • Annals of Operations Research, Vol. 280, Issue 1-2
  • DOI: 10.1007/s10479-018-3011-z

Combining Probability Distributions From Experts in Risk Analysis
journal, April 1999


Expert elicitation survey predicts 37% to 49% declines in wind energy costs by 2050
journal, April 2021


A Through-Life Cost Analysis Model to Support Investment Decision-Making in Concentrated Solar Power Projects
journal, March 2020

  • Shafiee, Mahmood; Alghamdi, Adel; Sansom, Chris
  • Energies, Vol. 13, Issue 7
  • DOI: 10.3390/en13071553

The effect of near-term policy choices on long-term greenhouse gas transformation pathways
journal, September 2015


Multiobjective strategies for New Product Development in the pharmaceutical industry
journal, February 2012


Robust portfolios: contributions from operations research and finance
journal, January 2009

  • Fabozzi, Frank J.; Huang, Dashan; Zhou, Guofu
  • Annals of Operations Research, Vol. 176, Issue 1
  • DOI: 10.1007/s10479-009-0515-6

Static R&D project portfolio selection in public organizations
journal, April 2016


Modeling the future costs of carbon capture using experts' elicited probabilities under policy scenarios
journal, July 2013


R&D project evaluation: An integrated DEA and balanced scorecard approach
journal, October 2008


Sustainable fuel portfolio optimization: Integrated fuzzy multi-objective programming and multi-criteria decision making
journal, March 2018


How grid integration costs impact the optimal R&D portfolio into electricity supply technologies in the face of climate change
journal, September 2014

  • Barron, Robert; Djimadoumbaye, Noubara; Baker, Erin
  • Sustainable Energy Technologies and Assessments, Vol. 7
  • DOI: 10.1016/j.seta.2014.02.007

Project evaluation and selection in a network of collaboration: A consensual disaggregation multi-criterion approach
journal, April 2001

  • Oral, Muhittin; Kettani, Ossama; Çınar, Ünver
  • European Journal of Operational Research, Vol. 130, Issue 2
  • DOI: 10.1016/S0377-2217(00)00040-0

A portfolio model for siting offshore wind farms with economic and environmental objectives
journal, May 2018

  • Cranmer, Alexana; Baker, Erin; Liesiö, Juuso
  • European Journal of Operational Research, Vol. 267, Issue 1
  • DOI: 10.1016/j.ejor.2017.11.026

Stochastic Combinatorial Optimization Approach to Biopharmaceutical Portfolio Management
journal, October 2008

  • George, Edmund D.; Farid, Suzanne S.
  • Industrial & Engineering Chemistry Research, Vol. 47, Issue 22
  • DOI: 10.1021/ie8003144

Integrating uncertainty into public energy research and development decisions
journal, May 2017

  • Anadón, Laura Díaz; Baker, Erin; Bosetti, Valentina
  • Nature Energy, Vol. 2, Issue 5
  • DOI: 10.1038/nenergy.2017.71

A multistage stochastic programming approach for capital budgeting problems under uncertainty
journal, October 2012

  • Beraldi, P.; Violi, A.; De Simone, F.
  • IMA Journal of Management Mathematics, Vol. 24, Issue 1
  • DOI: 10.1093/imaman/dps018

A practical R&D project-selection scoring tool
journal, May 1999

  • Henriksen, A. D.; Traynor, A. J.
  • IEEE Transactions on Engineering Management, Vol. 46, Issue 2
  • DOI: 10.1109/17.759144

Optimal energy investment and R&D strategies to stabilize atmospheric greenhouse gas concentrations
journal, May 2009


A multistage stochastic energy model with endogenous probabilities and a rolling horizon
journal, January 2017


Review on multi-criteria decision analysis aid in sustainable energy decision-making
journal, December 2009

  • Wang, Jiang-Jiang; Jing, You-Yin; Zhang, Chun-Fa
  • Renewable and Sustainable Energy Reviews, Vol. 13, Issue 9
  • DOI: 10.1016/j.rser.2009.06.021

Real options analysis on strategic partnerships of biotechnological start-ups
journal, June 2014


Mean–Gini analysis in R&D portfolio selection
journal, April 2004

  • Ringuest, Jeffrey L.; Graves, Samuel B.; Case, Randy H.
  • European Journal of Operational Research, Vol. 154, Issue 1
  • DOI: 10.1016/S0377-2217(02)00708-7

Application of Bayesian approach to numerical methods of global and stochastic optimization
journal, June 1994


One-stage R&D portfolio optimization with an application to solid oxide fuel cells
journal, January 2010


Robust portfolio decision analysis: An application to the energy research and development portfolio problem
journal, August 2020

  • Baker, Erin; Bosetti, Valentina; Salo, Ahti
  • European Journal of Operational Research, Vol. 284, Issue 3
  • DOI: 10.1016/j.ejor.2020.01.038

Developing a decision support system for R&D project portfolio selection with interdependencies
conference, January 2012

  • Ashrafi, Maryam; Davoudpour, Hamid; Abbassi, Mohammad
  • PROCEEDINGS OF THE SIXTH GLOBAL CONFERENCE ON POWER CONTROL AND OPTIMIZATION, AIP Conference Proceedings
  • DOI: 10.1063/1.4769016

Shared Socio-Economic Pathways of the Energy Sector – Quantifying the Narratives
journal, January 2017


Comment on Cooke's classical method
journal, May 2008


Management of Energy Technology for Sustainability: How to Fund Energy Technology Research and Development
journal, August 2013

  • Baker, Erin; Solak, Senay
  • Production and Operations Management, Vol. 23, Issue 3
  • DOI: 10.1111/poms.12068

Integrating stochastic programming and decision tree techniques in land conversion problems
journal, February 2006


Solving mixed-integer robust optimization problems with interval uncertainty using Benders decomposition
journal, April 2015

  • Siddiqui, Sauleh; Gabriel, Steven A.; Azarm, Shapour
  • Journal of the Operational Research Society, Vol. 66, Issue 4
  • DOI: 10.1057/jors.2014.41

An Empirical Bayes Approach to Efficient Portfolio Selection
journal, September 1986

  • Frost, Peter A.; Savarino, James E.
  • The Journal of Financial and Quantitative Analysis, Vol. 21, Issue 3
  • DOI: 10.2307/2331043

Decision frameworks and the investment in R&D
journal, May 2015


Real Options Based Analysis of Optimal Pharmaceutical Research and Development Portfolios
journal, November 2002

  • Rogers, Michael J.; Gupta, Anshuman; Maranas, Costas D.
  • Industrial & Engineering Chemistry Research, Vol. 41, Issue 25
  • DOI: 10.1021/ie020385p

A fuzzy set approach for R&D portfolio selection using a real options valuation model
journal, June 2007


An economic–probabilistic model for project selection and prioritization
journal, August 2014

  • Dutra, Camila Costa; Ribeiro, José Luis Duarte; de Carvalho, Marly Monteiro
  • International Journal of Project Management, Vol. 32, Issue 6
  • DOI: 10.1016/j.ijproman.2013.12.004

The future prospect of PV and CSP solar technologies: An expert elicitation survey
journal, October 2012


A portfolio decision analysis approach to support energy research and development resource allocation
journal, June 2017


A comprehensive framework for project selection problem under uncertainty and real-world constraints
journal, August 2011

  • Shakhsi-Niaei, M.; Torabi, S. A.; Iranmanesh, S. H.
  • Computers & Industrial Engineering, Vol. 61, Issue 1
  • DOI: 10.1016/j.cie.2011.03.015

Optimal Energy R&D Portfolio Investments in Response to a Carbon Tax
journal, November 2010

  • Shittu, Ekundayo; Baker, Erin
  • IEEE Transactions on Engineering Management, Vol. 57, Issue 4
  • DOI: 10.1109/TEM.2009.2023107

Optimization of R&D project portfolios under endogenous uncertainty
journal, November 2010

  • Solak, Senay; Clarke, John-Paul B.; Johnson, Ellis L.
  • European Journal of Operational Research, Vol. 207, Issue 1
  • DOI: 10.1016/j.ejor.2010.04.032

Exceptional Paper—Probability Encoding in Decision Analysis
journal, November 1975

  • Spetzler, Carl S.; Staël Von Holstein, Carl-Axel S.
  • Management Science, Vol. 22, Issue 3
  • DOI: 10.1287/mnsc.22.3.340

Assessing uncertainty in physical constants
journal, September 1986

  • Henrion, Max; Fischhoff, Baruch
  • American Journal of Physics, Vol. 54, Issue 9
  • DOI: 10.1119/1.14447

Stochastic multi-objective optimization: a survey on non-scalarizing methods
journal, April 2013


An Integer Programming Approach for Evaluating R&D Funding Decisions With Optimal Budget Allocations
journal, November 2012

  • Eckhause, Jeremy M.; Gabriel, Steven A.; Hughes, Danny R.
  • IEEE Transactions on Engineering Management, Vol. 59, Issue 4
  • DOI: 10.1109/TEM.2012.2183132

Linking the Balanced Scorecard to Strategy
journal, October 1996

  • Kaplan, Robert S.; Norton, David P.
  • California Management Review, Vol. 39, Issue 1
  • DOI: 10.2307/41165876

Bayesian portfolio selection with multi-variate random variance models
journal, June 2006


Portfolio management for new product development: results of an industry practices study
journal, October 2001