Energy sector portfolio analysis with uncertainty
Abstract
Governments are dealing with the challenge of how to efficiently invest in research and development portfolios related to energy technologies. Research and development investment decisions in the energy space are especially difficult due to numerous risks and uncertainties, and due to the complexity of energy's interactions with the broad economy. Historically, much of the U.S. Department of Energy's in-depth research and development analyses focused on assessing the impact of a research and development activity in isolation from other available opportunities and did not substantially consider risk and uncertainty. Endeavoring to combine integrated energy-economy modeling with uncertainty analysis and technology-specific research and development activities, the U.S. Department of Energy commissioned the development of the Stochastic Energy Deployment System to support and improve public energy research and development decision-making. The Stochastic Energy Deployment System draws from expert-elicited probability distributions for research and development-driven improvements in technology cost and performance, and it uses Monte Carlo simulations to evaluate the likelihood of outcomes within a system dynamics energy-economy model. The framework estimates the uncertain benefits and costs of various research and development portfolios and provides insight into the probability of meeting national technology goals, while accounting for interactions with the larger economy and formore »
- Authors:
-
- Lumina Decision Systems, Los Gatos, CA (United States)
- National Renewable Energy Lab. (NREL), Golden, CO (United States)
- US Department of Energy (USDOE), Washington DC (United States)
- Publication Date:
- Research Org.:
- National Renewable Energy Lab. (NREL), Golden, CO (United States)
- Sponsoring Org.:
- USDOE Office of Energy Efficiency and Renewable Energy (EERE), Strategic Programs (EE-SP)
- OSTI Identifier:
- 1828146
- Report Number(s):
- NREL/JA-6A20-78746
Journal ID: ISSN 0306-2619; MainId:32663;UUID:d7baf4c3-6832-4de2-b8df-4a0d58b136db;MainAdminID:63246
- Grant/Contract Number:
- AC36-08GO28308
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Applied Energy
- Additional Journal Information:
- Journal Volume: 306; Journal Issue: Part A; Journal ID: ISSN 0306-2619
- Publisher:
- Elsevier
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 29 ENERGY PLANNING, POLICY, AND ECONOMY; energy system; expert elicitation; portfolio analysis; Stochastic Energy Deployment System; stochasticity; uncertainty
Citation Formats
Milford, James, Henrion, Max, Hunter, Chad, Newes, Emily, Hughes, Caroline, and Baldwin, Samuel F. Energy sector portfolio analysis with uncertainty. United States: N. p., 2021.
Web. doi:10.1016/j.apenergy.2021.117926.
Milford, James, Henrion, Max, Hunter, Chad, Newes, Emily, Hughes, Caroline, & Baldwin, Samuel F. Energy sector portfolio analysis with uncertainty. United States. https://doi.org/10.1016/j.apenergy.2021.117926
Milford, James, Henrion, Max, Hunter, Chad, Newes, Emily, Hughes, Caroline, and Baldwin, Samuel F. Sat .
"Energy sector portfolio analysis with uncertainty". United States. https://doi.org/10.1016/j.apenergy.2021.117926. https://www.osti.gov/servlets/purl/1828146.
@article{osti_1828146,
title = {Energy sector portfolio analysis with uncertainty},
author = {Milford, James and Henrion, Max and Hunter, Chad and Newes, Emily and Hughes, Caroline and Baldwin, Samuel F.},
abstractNote = {Governments are dealing with the challenge of how to efficiently invest in research and development portfolios related to energy technologies. Research and development investment decisions in the energy space are especially difficult due to numerous risks and uncertainties, and due to the complexity of energy's interactions with the broad economy. Historically, much of the U.S. Department of Energy's in-depth research and development analyses focused on assessing the impact of a research and development activity in isolation from other available opportunities and did not substantially consider risk and uncertainty. Endeavoring to combine integrated energy-economy modeling with uncertainty analysis and technology-specific research and development activities, the U.S. Department of Energy commissioned the development of the Stochastic Energy Deployment System to support and improve public energy research and development decision-making. The Stochastic Energy Deployment System draws from expert-elicited probability distributions for research and development-driven improvements in technology cost and performance, and it uses Monte Carlo simulations to evaluate the likelihood of outcomes within a system dynamics energy-economy model. The framework estimates the uncertain benefits and costs of various research and development portfolios and provides insight into the probability of meeting national technology goals, while accounting for interactions with the larger economy and for interactions among research and development investments spanning many energy sectors.},
doi = {10.1016/j.apenergy.2021.117926},
journal = {Applied Energy},
number = Part A,
volume = 306,
place = {United States},
year = {2021},
month = {10}
}
Works referenced in this record:
Selecting balanced portfolios of R&D projects with interdependencies: A Cross-Entropy based methodology
journal, January 2014
- Abbassi, Mohammad; Ashrafi, Maryam; Sharifi Tashnizi, Ebrahim
- Technovation, Vol. 34, Issue 1
Energy technology expert elicitations: An application to natural gas turbine efficiencies
journal, July 2014
- Bistline, John E.
- Technological Forecasting and Social Change, Vol. 86
Future Prospects for Energy Technologies: Insights from Expert Elicitations
journal, January 2018
- Verdolini, Elena; Anadón, Laura Díaz; Baker, Erin
- Review of Environmental Economics and Policy, Vol. 12, Issue 1
Expert Elicitation: Using the Classical Model to Validate Experts’ Judgments
journal, January 2018
- Colson, Abigail R.; Cooke, Roger M.
- Review of Environmental Economics and Policy, Vol. 12, Issue 1
Optimizing the level of renewable electric R&D expenditures using real options analysis
journal, December 2003
- Davis, Graham A.; Owens, Brandon
- Energy Policy, Vol. 31, Issue 15
Multi-period project portfolio selection under risk considerations and stochastic income
journal, February 2018
- Tofighian, Ali Asghar; Moezzi, Hamid; Khakzar Barfuei, Morteza
- Journal of Industrial Engineering International, Vol. 14, Issue 3
Climate change and optimal energy technology R&D policy
journal, September 2011
- Baker, Erin; Solak, Senay
- European Journal of Operational Research, Vol. 213, Issue 2
Special issue on defining robust energy R&D portfolios
journal, May 2015
- Baker, Erin; Bosetti, Valentina; Anadon, Laura Diaz
- Energy Policy, Vol. 80
Real options valuation of a federally funded small Business portfolio
conference, June 2017
- Belz, Andrea
- 2017 IEEE Technology & Engineering Management Conference (TEMSCON)
Contingent Portfolio Programming for the Management of Risky Projects
journal, December 2005
- Gustafsson, Janne; Salo, Ahti
- Operations Research, Vol. 53, Issue 6
Future costs of key low-carbon energy technologies: Harmonization and aggregation of energy technology expert elicitation data
journal, May 2015
- Baker, Erin; Bosetti, Valentina; Anadon, Laura Diaz
- Energy Policy, Vol. 80
A comprehensive approach for the selection of a portfolio of interdependent projects. An application to subsidized projects in Spain
journal, April 2018
- Alvarez-García, B.; Fernández-Castro, A. S.
- Computers & Industrial Engineering, Vol. 118
Addressing R&D investment decisions: a cross analysis of R&D project selection methods
journal, August 2010
- Verbano, Chiara; Nosella, Anna
- European Journal of Innovation Management, Vol. 13, Issue 3
An optimization methodology for identifying robust process integration investments under uncertainty
journal, February 2009
- Svensson, Elin; Berntsson, Thore; Strömberg, Ann-Brith
- Energy Policy, Vol. 37, Issue 2
Rethinking CCS – Developing Quantitative Tools for Analyzing Investments in CCS
journal, January 2013
- Eide, Jan; Herzog, Howard; Webster, Mort
- Energy Procedia, Vol. 37
Carbon capture and storage: combining economic analysis with expert elicitations to inform climate policy
journal, July 2009
- Baker, Erin; Chon, Haewon; Keisler, Jeffrey
- Climatic Change, Vol. 96, Issue 3
Sensitivity to energy technology costs: A multi-model comparison analysis
journal, May 2015
- Bosetti, Valentina; Marangoni, Giacomo; Borgonovo, Emanuele
- Energy Policy, Vol. 80
Optimal strategies for selecting project portfolios using uncertain value estimates
journal, March 2014
- Vilkkumaa, Eeva; Liesiö, Juuso; Salo, Ahti
- European Journal of Operational Research, Vol. 233, Issue 3
Wright meets Markowitz: How standard portfolio theory changes when assets are technologies following experience curves
journal, April 2019
- Way, Rupert; Lafond, François; Lillo, Fabrizio
- Journal of Economic Dynamics and Control, Vol. 101
Energy R&D portfolio analysis based on climate change mitigation
journal, July 2011
- Pugh, Graham; Clarke, Leon; Marlay, Robert
- Energy Economics, Vol. 33, Issue 4
Contingency Planning in Project Selection Using Multiobjective Optimization and Chance Constraints
journal, June 2006
- Gabriel, Steven A.; Ordóñez, Javier F.; Faria, José A.
- Journal of Infrastructure Systems, Vol. 12, Issue 2
Modeling uncertainty of expert elicitation for use in risk-based optimization
journal, September 2018
- Teter, Michael D.; Royset, Johannes O.; Newman, Alexandra M.
- Annals of Operations Research, Vol. 280, Issue 1-2
Combining Probability Distributions From Experts in Risk Analysis
journal, April 1999
- Clemen, Robert T.; Winkler, Robert L.
- Risk Analysis, Vol. 19, Issue 2
Expert elicitation survey predicts 37% to 49% declines in wind energy costs by 2050
journal, April 2021
- Wiser, Ryan; Rand, Joseph; Seel, Joachim
- Nature Energy, Vol. 6, Issue 5
A Through-Life Cost Analysis Model to Support Investment Decision-Making in Concentrated Solar Power Projects
journal, March 2020
- Shafiee, Mahmood; Alghamdi, Adel; Sansom, Chris
- Energies, Vol. 13, Issue 7
The effect of near-term policy choices on long-term greenhouse gas transformation pathways
journal, September 2015
- Isley, Steven C.; Lempert, Robert J.; Popper, Steven W.
- Global Environmental Change, Vol. 34
Multiobjective strategies for New Product Development in the pharmaceutical industry
journal, February 2012
- Perez-Escobedo, José L.; Azzaro-Pantel, Catherine; Pibouleau, Luc
- Computers & Chemical Engineering, Vol. 37
Holistic multi-criteria decision analysis evaluation of sustainable electric generation portfolios: New England case study
journal, May 2019
- Nock, Destenie; Baker, Erin
- Applied Energy, Vol. 242
Robust portfolios: contributions from operations research and finance
journal, January 2009
- Fabozzi, Frank J.; Huang, Dashan; Zhou, Guofu
- Annals of Operations Research, Vol. 176, Issue 1
Static R&D project portfolio selection in public organizations
journal, April 2016
- Arratia M., N. M.; Lόpez I., F.; Schaeffer, S. E.
- Decision Support Systems, Vol. 84
Modeling the future costs of carbon capture using experts' elicited probabilities under policy scenarios
journal, July 2013
- Nemet, Gregory F.; Baker, Erin; Jenni, Karen E.
- Energy, Vol. 56
R&D project evaluation: An integrated DEA and balanced scorecard approach
journal, October 2008
- Eilat, Harel; Golany, Boaz; Shtub, Avraham
- Omega, Vol. 36, Issue 5
Sustainable fuel portfolio optimization: Integrated fuzzy multi-objective programming and multi-criteria decision making
journal, March 2018
- Sehatpour, Mohammad-Hadi; Kazemi, Aliyeh
- Journal of Cleaner Production, Vol. 176
How grid integration costs impact the optimal R&D portfolio into electricity supply technologies in the face of climate change
journal, September 2014
- Barron, Robert; Djimadoumbaye, Noubara; Baker, Erin
- Sustainable Energy Technologies and Assessments, Vol. 7
Project evaluation and selection in a network of collaboration: A consensual disaggregation multi-criterion approach
journal, April 2001
- Oral, Muhittin; Kettani, Ossama; Çınar, Ünver
- European Journal of Operational Research, Vol. 130, Issue 2
A portfolio model for siting offshore wind farms with economic and environmental objectives
journal, May 2018
- Cranmer, Alexana; Baker, Erin; Liesiö, Juuso
- European Journal of Operational Research, Vol. 267, Issue 1
Stochastic Combinatorial Optimization Approach to Biopharmaceutical Portfolio Management
journal, October 2008
- George, Edmund D.; Farid, Suzanne S.
- Industrial & Engineering Chemistry Research, Vol. 47, Issue 22
Integrating uncertainty into public energy research and development decisions
journal, May 2017
- Anadón, Laura Díaz; Baker, Erin; Bosetti, Valentina
- Nature Energy, Vol. 2, Issue 5
A multistage stochastic programming approach for capital budgeting problems under uncertainty
journal, October 2012
- Beraldi, P.; Violi, A.; De Simone, F.
- IMA Journal of Management Mathematics, Vol. 24, Issue 1
A practical R&D project-selection scoring tool
journal, May 1999
- Henriksen, A. D.; Traynor, A. J.
- IEEE Transactions on Engineering Management, Vol. 46, Issue 2
Optimal energy investment and R&D strategies to stabilize atmospheric greenhouse gas concentrations
journal, May 2009
- Bosetti, Valentina; Carraro, Carlo; Massetti, Emanuele
- Resource and Energy Economics, Vol. 31, Issue 2
A multistage stochastic energy model with endogenous probabilities and a rolling horizon
journal, January 2017
- Champion, Billy R.; Gabriel, Steven A.
- Energy and Buildings, Vol. 135
Review on multi-criteria decision analysis aid in sustainable energy decision-making
journal, December 2009
- Wang, Jiang-Jiang; Jing, You-Yin; Zhang, Chun-Fa
- Renewable and Sustainable Energy Reviews, Vol. 13, Issue 9
Evaluating sustainability of biofuels feedstocks: A multi-objective framework for supporting decision making
journal, December 2013
- Ziolkowska, Jadwiga R.
- Biomass and Bioenergy, Vol. 59
Real options analysis on strategic partnerships of biotechnological start-ups
journal, June 2014
- Fujiwara, Takao
- Technology Analysis & Strategic Management, Vol. 26, Issue 6
Mean–Gini analysis in R&D portfolio selection
journal, April 2004
- Ringuest, Jeffrey L.; Graves, Samuel B.; Case, Randy H.
- European Journal of Operational Research, Vol. 154, Issue 1
Application of Bayesian approach to numerical methods of global and stochastic optimization
journal, June 1994
- Mockus, Jonas
- Journal of Global Optimization, Vol. 4, Issue 4
One-stage R&D portfolio optimization with an application to solid oxide fuel cells
journal, January 2010
- Hannah, Lauren; Powell, Warren; Stewart, Jeffrey
- Energy Systems, Vol. 1, Issue 2
Robust portfolio decision analysis: An application to the energy research and development portfolio problem
journal, August 2020
- Baker, Erin; Bosetti, Valentina; Salo, Ahti
- European Journal of Operational Research, Vol. 284, Issue 3
Developing a decision support system for R&D project portfolio selection with interdependencies
conference, January 2012
- Ashrafi, Maryam; Davoudpour, Hamid; Abbassi, Mohammad
- PROCEEDINGS OF THE SIXTH GLOBAL CONFERENCE ON POWER CONTROL AND OPTIMIZATION, AIP Conference Proceedings
Shared Socio-Economic Pathways of the Energy Sector – Quantifying the Narratives
journal, January 2017
- Bauer, Nico; Calvin, Katherine; Emmerling, Johannes
- Global Environmental Change, Vol. 42
Comment on Cooke's classical method
journal, May 2008
- Clemen, Robert T.
- Reliability Engineering & System Safety, Vol. 93, Issue 5
Management of Energy Technology for Sustainability: How to Fund Energy Technology Research and Development
journal, August 2013
- Baker, Erin; Solak, Senay
- Production and Operations Management, Vol. 23, Issue 3
Integrating stochastic programming and decision tree techniques in land conversion problems
journal, February 2006
- Messina, Vincenzina; Bosetti, Valentina
- Annals of Operations Research, Vol. 142, Issue 1
Solving mixed-integer robust optimization problems with interval uncertainty using Benders decomposition
journal, April 2015
- Siddiqui, Sauleh; Gabriel, Steven A.; Azarm, Shapour
- Journal of the Operational Research Society, Vol. 66, Issue 4
An Empirical Bayes Approach to Efficient Portfolio Selection
journal, September 1986
- Frost, Peter A.; Savarino, James E.
- The Journal of Financial and Quantitative Analysis, Vol. 21, Issue 3
Decision frameworks and the investment in R&D
journal, May 2015
- Baker, Erin; Olaleye, Olaitan; Aleluia Reis, Lara
- Energy Policy, Vol. 80
Real Options Based Analysis of Optimal Pharmaceutical Research and Development Portfolios
journal, November 2002
- Rogers, Michael J.; Gupta, Anshuman; Maranas, Costas D.
- Industrial & Engineering Chemistry Research, Vol. 41, Issue 25
A fuzzy set approach for R&D portfolio selection using a real options valuation model
journal, June 2007
- Wang, Juite; Hwang, W. -L.
- Omega, Vol. 35, Issue 3
An economic–probabilistic model for project selection and prioritization
journal, August 2014
- Dutra, Camila Costa; Ribeiro, José Luis Duarte; de Carvalho, Marly Monteiro
- International Journal of Project Management, Vol. 32, Issue 6
Energy technology R&D portfolio management: Modeling uncertain returns and market diffusion
journal, December 2016
- Bistline, John E.
- Applied Energy, Vol. 183
The future prospect of PV and CSP solar technologies: An expert elicitation survey
journal, October 2012
- Bosetti, Valentina; Catenacci, Michela; Fiorese, Giulia
- Energy Policy, Vol. 49
A portfolio decision analysis approach to support energy research and development resource allocation
journal, June 2017
- Kurth, Margaret; Keisler, Jeffrey M.; Bates, Matthew E.
- Energy Policy, Vol. 105
A comprehensive framework for project selection problem under uncertainty and real-world constraints
journal, August 2011
- Shakhsi-Niaei, M.; Torabi, S. A.; Iranmanesh, S. H.
- Computers & Industrial Engineering, Vol. 61, Issue 1
Optimal Energy R&D Portfolio Investments in Response to a Carbon Tax
journal, November 2010
- Shittu, Ekundayo; Baker, Erin
- IEEE Transactions on Engineering Management, Vol. 57, Issue 4
Optimization of R&D project portfolios under endogenous uncertainty
journal, November 2010
- Solak, Senay; Clarke, John-Paul B.; Johnson, Ellis L.
- European Journal of Operational Research, Vol. 207, Issue 1
Exceptional Paper—Probability Encoding in Decision Analysis
journal, November 1975
- Spetzler, Carl S.; Staël Von Holstein, Carl-Axel S.
- Management Science, Vol. 22, Issue 3
Assessing uncertainty in physical constants
journal, September 1986
- Henrion, Max; Fischhoff, Baruch
- American Journal of Physics, Vol. 54, Issue 9
Stochastic multi-objective optimization: a survey on non-scalarizing methods
journal, April 2013
- Gutjahr, Walter J.; Pichler, Alois
- Annals of Operations Research, Vol. 236, Issue 2
An Integer Programming Approach for Evaluating R&D Funding Decisions With Optimal Budget Allocations
journal, November 2012
- Eckhause, Jeremy M.; Gabriel, Steven A.; Hughes, Danny R.
- IEEE Transactions on Engineering Management, Vol. 59, Issue 4
Linking the Balanced Scorecard to Strategy
journal, October 1996
- Kaplan, Robert S.; Norton, David P.
- California Management Review, Vol. 39, Issue 1
Bayesian portfolio selection with multi-variate random variance models
journal, June 2006
- Soyer, Refik; Tanyeri, Kadir
- European Journal of Operational Research, Vol. 171, Issue 3
Portfolio management for new product development: results of an industry practices study
journal, October 2001
- Cooper, Robert; Edgett, Scott; Kleinschmidt, Elko
- R&D Management, Vol. 31, Issue 4
The differential impact of low-carbon technologies on climate change mitigation cost under a range of socioeconomic and climate policy scenarios
journal, May 2015
- Barron, Robert; McJeon, Haewon
- Energy Policy, Vol. 80