Evaluation of calibration efficacy under different levels of uncertainty
Abstract
This study examines how calibration performs under different levels of uncertainty in model input data. It specifically assesses the efficacy of Bayesian calibration to enhance the reliability of EnergyPlus model predictions. A Bayesian approach can be used to update uncertain values of parameters, given measured energy-use data, and to quantify the associated uncertainty.We assess the efficacy of Bayesian calibration under a controlled virtual-reality setup, which enables rigorous validation of the accuracy of calibration results in terms of both calibrated parameter values and model predictions. Case studies demonstrate the performance of Bayesian calibration of base models developed from audit data with differing levels of detail in building design, usage, and operation.
- Authors:
-
- Univ. of Cambridge, Cambridge (United Kingdom)
- Argonne National Lab. (ANL), Lemont, IL (United States)
- Publication Date:
- Research Org.:
- Argonne National Laboratory (ANL), Argonne, IL (United States)
- Sponsoring Org.:
- USDOE Office of Energy Efficiency and Renewable Energy (EERE), Energy Efficiency Office. Building Technologies Office
- OSTI Identifier:
- 1391908
- Grant/Contract Number:
- AC02-06CH11357
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Journal of Building Performance Simulation
- Additional Journal Information:
- Journal Volume: 8; Journal Issue: 3; Journal ID: ISSN 1940-1493
- Publisher:
- Taylor & Francis
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING; Bayesian Calibration; Building Energy; Energy Audit; Energy Simulation Model; Uncertainty Analysis
Citation Formats
Heo, Yeonsook, Graziano, Diane J., Guzowski, Leah, and Muehleisen, Ralph T. Evaluation of calibration efficacy under different levels of uncertainty. United States: N. p., 2014.
Web. doi:10.1080/19401493.2014.896947.
Heo, Yeonsook, Graziano, Diane J., Guzowski, Leah, & Muehleisen, Ralph T. Evaluation of calibration efficacy under different levels of uncertainty. United States. https://doi.org/10.1080/19401493.2014.896947
Heo, Yeonsook, Graziano, Diane J., Guzowski, Leah, and Muehleisen, Ralph T. Tue .
"Evaluation of calibration efficacy under different levels of uncertainty". United States. https://doi.org/10.1080/19401493.2014.896947. https://www.osti.gov/servlets/purl/1391908.
@article{osti_1391908,
title = {Evaluation of calibration efficacy under different levels of uncertainty},
author = {Heo, Yeonsook and Graziano, Diane J. and Guzowski, Leah and Muehleisen, Ralph T.},
abstractNote = {This study examines how calibration performs under different levels of uncertainty in model input data. It specifically assesses the efficacy of Bayesian calibration to enhance the reliability of EnergyPlus model predictions. A Bayesian approach can be used to update uncertain values of parameters, given measured energy-use data, and to quantify the associated uncertainty.We assess the efficacy of Bayesian calibration under a controlled virtual-reality setup, which enables rigorous validation of the accuracy of calibration results in terms of both calibrated parameter values and model predictions. Case studies demonstrate the performance of Bayesian calibration of base models developed from audit data with differing levels of detail in building design, usage, and operation.},
doi = {10.1080/19401493.2014.896947},
journal = {Journal of Building Performance Simulation},
number = 3,
volume = 8,
place = {United States},
year = {Tue Jun 10 00:00:00 EDT 2014},
month = {Tue Jun 10 00:00:00 EDT 2014}
}
Web of Science
Works referenced in this record:
Calibration Procedure for Energy Performance Simulation of a Commercial Building
journal, August 2003
- Yoon, Jongho; Lee, E. J.; Claridge, D. E.
- Journal of Solar Energy Engineering, Vol. 125, Issue 3
Quantitative risk management for energy retrofit projects
journal, July 2013
- Heo, Yeonsook; Augenbroe, Godfried; Choudhary, Ruchi
- Journal of Building Performance Simulation, Vol. 6, Issue 4
Calibrating whole building energy models: An evidence-based methodology
journal, September 2011
- Raftery, Paul; Keane, Marcus; O’Donnell, James
- Energy and Buildings, Vol. 43, Issue 9
Evaluating the use of “goodness-of-fit” Measures in hydrologic and hydroclimatic model validation
journal, January 1999
- Legates, David R.; McCabe, Gregory J.
- Water Resources Research, Vol. 35, Issue 1
Bayesian Calibration of a Stochastic Kinetic Computer Model Using Multiple Data Sources
journal, April 2009
- Henderson, D. A.; Boys, R. J.; Wilkinson, D. J.
- Biometrics, Vol. 66, Issue 1
Application of global sensitivity analysis of model output to building thermal simulations
journal, December 2008
- Mara, Thierry A.; Tarantola, Stefano
- Building Simulation, Vol. 1, Issue 4
Factorial Sampling Plans for Preliminary Computational Experiments
journal, May 1991
- Morris, Max D.
- Technometrics, Vol. 33, Issue 2
Understanding the Metropolis-Hastings Algorithm
journal, November 1995
- Chib, Siddhartha; Greenberg, Edward
- The American Statistician, Vol. 49, Issue 4
Calibrated building energy simulation and its application in a high-rise commercial building in Shanghai
journal, June 2007
- Pan, Yiqun; Huang, Zhizhong; Wu, Gang
- Energy and Buildings, Vol. 39, Issue 6
Bayesian calibration of computer models
journal, August 2001
- Kennedy, Marc C.; O'Hagan, Anthony
- Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 63, Issue 3
Applying computer-based simulation to energy auditing: A case study
journal, May 2006
- Zhu, Yimin
- Energy and Buildings, Vol. 38, Issue 5
A user's guide to LHS: Sandia's Latin Hypercube Sampling Software
report, February 1998
- Wyss, G. D.; Jorgensen, K. H.
Bayesian calibration of process-based forest models: bridging the gap between models and data
journal, July 2005
- Van Oijen, M.; Rougier, J.; Smith, R.
- Tree Physiology, Vol. 25, Issue 7
Calibration of building energy models for retrofit analysis under uncertainty
journal, April 2012
- Heo, Y.; Choudhary, R.; Augenbroe, G. A.
- Energy and Buildings, Vol. 47
Combining Field Data and Computer Simulations for Calibration and Prediction
journal, January 2004
- Higdon, Dave; Kennedy, Marc; Cavendish, James C.
- SIAM Journal on Scientific Computing, Vol. 26, Issue 2
Bayesian calibration of simultaneity in tactile temporal order judgment
journal, May 2006
- Miyazaki, Makoto; Yamamoto, Shinya; Uchida, Sunao
- Nature Neuroscience, Vol. 9, Issue 7
Uncertainty quantification of microclimate variables in building energy models
journal, January 2013
- Sun, Yuming; Heo, Yeonsook; Tan, Matthias
- Journal of Building Performance Simulation, Vol. 7, Issue 1
Bayesian Parameter Estimation of Convective Heat Transfer Coefficients of a Roof-Mounted Radiant Barrier System
journal, September 2005
- Lauret, Philippe; Miranville, Frédéric; Boyer, Harry
- Journal of Solar Energy Engineering, Vol. 128, Issue 2
Bayesian calibration of a large-scale geothermal reservoir model by a new adaptive delayed acceptance Metropolis Hastings algorithm: ADAPTIVE DELAYED ACCEPTANCE METROPOLIS-HASTINGS ALGORITHM
journal, October 2011
- Cui, T.; Fox, C.; O'Sullivan, M. J.
- Water Resources Research, Vol. 47, Issue 10
Gaussian Processes in Machine Learning
book, January 2004
- Rasmussen, Carl Edward
- Advanced Lectures on Machine Learning
A methodology for building energy modelling and calibration in warm climates
journal, August 2002
- Pedrini, A.; Westphal, F. S.; Lamberts, R.
- Building and Environment, Vol. 37, Issue 8-9
Calibration of Building Energy Simulation Programs Using the Analytic Optimization Approach (RP-1051)
journal, January 2006
- Sun, Jian; Reddy, T. Agami
- HVAC&R Research, Vol. 12, Issue 1
Bayesian Data Analysis
book, July 2003
- Gelman, Andrew; Carlin, John B.; Stern, Hal S.
- Chapman and Hall/CRC
Works referencing / citing this record:
Review on stochastic modeling methods for building stock energy prediction
journal, May 2017
- Lim, Hyunwoo; Zhai, Zhiqiang John
- Building Simulation, Vol. 10, Issue 5
Influence of error terms in Bayesian calibration of energy system models
journal, May 2018
- Menberg, Kathrin; Heo, Yeonsook; Choudhary, Ruchi
- Journal of Building Performance Simulation, Vol. 12, Issue 1
Bayesian Energy Measurement and Verification Analysis
journal, February 2018
- Carstens, Herman; Xia, Xiaohua; Yadavalli, Sarma
- Energies, Vol. 11, Issue 2
Bayesian Energy Measurement and Verification Analysis
journal, December 2017
- Carstens, Herman; Xia, Xiaohua; Yadavalli, Sarma
- Energies, Vol. 11
Influence of error terms in Bayesian calibration of energy system models
text, January 2019
- Menberg, K.; Heo, Yeonsook; Choudhary, Ruchi
- Apollo - University of Cambridge Repository