Evaluation of “Autotune” calibration against manual calibration of building energy models

Chaudhary, Gaurav; New, Joshua; Sanyal, Jibonananda; Im, Piljae; O’Neill, Zheng; Garg, Vishal

doi:10.1016/j.apenergy.2016.08.073

Title: Evaluation of “Autotune” calibration against manual calibration of building energy models

Journal Article · Fri Aug 26 00:00:00 EDT 2016 · Applied Energy

DOI:https://doi.org/10.1016/j.apenergy.2016.08.073· OSTI ID:1311239

Chaudhary, Gaurav ^[1]; New, Joshua ^[2]; Sanyal, Jibonananda ^[2]; Im, Piljae ^[2]; O’Neill, Zheng ^[3]; Garg, Vishal ^[4]

Indian Ins., of Technology, Roorkee (India). Dept. of Architecture and Planning
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
Univ. of Alabama, Tuscaloosa, AL (United States). Dept. of Mechanical Engineering
International Inst. of Information Technology, Hyderabad (India)

Our paper demonstrates the application of Autotune, a methodology aimed at automatically producing calibrated building energy models using measured data, in two case studies. In the first case, a building model is de-tuned by deliberately injecting faults into more than 60 parameters. This model was then calibrated using Autotune and its accuracy with respect to the original model was evaluated in terms of the industry-standard normalized mean bias error and coefficient of variation of root mean squared error metrics set forth in ASHRAE Guideline 14. In addition to whole-building energy consumption, outputs including lighting, plug load profiles, HVAC energy consumption, zone temperatures, and other variables were analyzed. In the second case, Autotune calibration is compared directly to experts’ manual calibration of an emulated-occupancy, full-size residential building with comparable calibration results in much less time. Lastly, our paper concludes with a discussion of the key strengths and weaknesses of auto-calibration approaches.

View Accepted Manuscript (DOE)

View Accepted Manuscript (Publisher)

Cite

Export

Save

Research Organization:: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)

Sponsoring Organization:: USDOE Office of Energy Efficiency and Renewable Energy (EERE)

Grant/Contract Number:: AC05-00OR22725; BT0201000; DEAC05-00OR22725

OSTI ID:: 1311239

Alternate ID(s):: OSTI ID: 1550719

Journal Information:: Applied Energy, Vol. 182, Issue C; ISSN 0306-2619

Publisher:: ElsevierCopyright Statement

Country of Publication:: United States

Language:: English

Citation Metrics:

Cited by: 57 works

Citation information provided by
Web of Science

References (65)

Data and analytics to inform energy retrofit of high performance buildings Hong, Tianzhen; Yang, Le; Hill, David Applied Energy, Vol. 126 https://doi.org/10.1016/j.apenergy.2014.03.052	journal	August 2014
Current Size and Remaining Market Potential of the U.S. Energy Service Company Industry Stuart, Elizabeth; Larsen, Peter H.; Goldman, Charles A. https://doi.org/10.2172/1170751	report	June 2013
Model-based real-time whole building energy performance monitoring and diagnostics O'Neill, Zheng; Pang, Xiufeng; Shashanka, Madhusudana Journal of Building Performance Simulation, Vol. 7, Issue 2 https://doi.org/10.1080/19401493.2013.777118	journal	April 2013
Experimental analysis of model predictive control for an energy efficient building heating system Široký, Jan; Oldewurtel, Frauke; Cigler, Jiří Applied Energy, Vol. 88, Issue 9 https://doi.org/10.1016/j.apenergy.2011.03.009	journal	September 2011
A method for assessing buildings’ energy efficiency by dynamic simulation and experimental activity Pisello, Anna Laura; Goretti, Michele; Cotana, Franco Applied Energy, Vol. 97 https://doi.org/10.1016/j.apenergy.2011.12.094	journal	September 2012
Study on performance of energy-efficient retrofitting measures on commercial building external walls in cooling-dominant cities Huang, Yu; Niu, Jian-lei; Chung, Tse-ming Applied Energy, Vol. 103 https://doi.org/10.1016/j.apenergy.2012.09.003	journal	March 2013
A model calibration framework for simultaneous multi-level building energy simulation Yang, Zheng; Becerik-Gerber, Burcin Applied Energy, Vol. 149 https://doi.org/10.1016/j.apenergy.2015.03.048	journal	July 2015
An investigation of design parameters that affect commercial high-rise office building energy consumption and demand Langner, M. Rois; Henze, Gregor P.; Corbin, Charles D. Journal of Building Performance Simulation, Vol. 5, Issue 5 https://doi.org/10.1080/19401493.2011.590607	journal	September 2012
Validation of an algorithm to disaggregate whole-building hourly electrical load into end uses Akbari, H. Energy, Vol. 20, Issue 12 https://doi.org/10.1016/0360-5442(95)00033-D	journal	December 1995
Experimental estimation of building energy performance by robust regression Ghiaus, Cristian Energy and Buildings, Vol. 38, Issue 6 https://doi.org/10.1016/j.enbuild.2005.08.014	journal	June 2006
Calibration and uncertainty analysis for computer models – A meta-model based approach for integrated building energy simulation Manfren, Massimiliano; Aste, Niccolò; Moshksar, Reza Applied Energy, Vol. 103 https://doi.org/10.1016/j.apenergy.2012.10.031	journal	March 2013
Annual electricity consumption forecasting by neural network in high energy consuming industrial sectors Azadeh, A.; Ghaderi, S. F.; Sohrabkhani, S. Energy Conversion and Management, Vol. 49, Issue 8 https://doi.org/10.1016/j.enconman.2008.01.035	journal	August 2008
Prediction of building energy consumption by using artificial neural networks Ekici, Betul Bektas; Aksoy, U. Teoman Advances in Engineering Software, Vol. 40, Issue 5 https://doi.org/10.1016/j.advengsoft.2008.05.003	journal	May 2009
Multiobjective optimization of building design using TRNSYS simulations, genetic algorithm, and Artificial Neural Network Magnier, Laurent; Haghighat, Fariborz Building and Environment, Vol. 45, Issue 3 https://doi.org/10.1016/j.buildenv.2009.08.016	journal	March 2010
Load Forecasting Using Support Vector Machines: A Study on EUNITE Competition 2001 Chen, B. -J.; Chang, M. -W.; Lin, C. -J. IEEE Transactions on Power Systems, Vol. 19, Issue 4 https://doi.org/10.1109/TPWRS.2004.835679	journal	November 2004
Applying support vector machines to predict building energy consumption in tropical region Dong, Bing; Cao, Cheng; Lee, Siew Eang Energy and Buildings, Vol. 37, Issue 5 https://doi.org/10.1016/j.enbuild.2004.09.009	journal	May 2005
Applying support vector machine to predict hourly cooling load in the building Li, Qiong; Meng, Qinglin; Cai, Jiejin Applied Energy, Vol. 86, Issue 10 https://doi.org/10.1016/j.apenergy.2008.11.035	journal	October 2009
Decision tree approach to power systems security assessment Wehenkel, L. International Journal of Electrical Power & Energy Systems, Vol. 15, Issue 1 https://doi.org/10.1016/0142-0615(93)90014-E	journal	February 1993
A decision tree method for building energy demand modeling Yu, Zhun; Haghighat, Fariborz; Fung, Benjamin C. M. Energy and Buildings, Vol. 42, Issue 10 https://doi.org/10.1016/j.enbuild.2010.04.006	journal	October 2010
HVAC terminal hourly end-use disaggregation in commercial buildings with Fourier series model Ji, Ying; Xu, Peng; Ye, Yunyang Energy and Buildings, Vol. 97 https://doi.org/10.1016/j.enbuild.2015.03.048	journal	June 2015
Simulation and experimental validation of the variable-refrigerant-volume (VRV) air-conditioning system in EnergyPlus Zhou, Y. P.; Wu, J. Y.; Wang, R. Z. Energy and Buildings, Vol. 40, Issue 6 https://doi.org/10.1016/j.enbuild.2007.04.025	journal	January 2008
Simulation of energy consumption for Kuwaiti domestic buildings Al-ajmi, Farraj F.; Hanby, V. I. Energy and Buildings, Vol. 40, Issue 6 https://doi.org/10.1016/j.enbuild.2007.10.010	journal	January 2008
A bottom-up and procedural calibration method for building energy simulation models based on hourly electricity submetering data Ji, Ying; Xu, Peng Energy, Vol. 93 https://doi.org/10.1016/j.energy.2015.10.109	journal	December 2015
Contrasting the capabilities of building energy performance simulation programs Crawley, Drury B.; Hand, Jon W.; Kummert, Michaël Building and Environment, Vol. 43, Issue 4, p. 661-673 https://doi.org/10.1016/j.buildenv.2006.10.027	journal	April 2008
EnergyPlus: creating a new-generation building energy simulation program Crawley, Drury B.; Lawrie, Linda K.; Winkelmann, Frederick C. Energy and Buildings, Vol. 33, Issue 4 https://doi.org/10.1016/S0378-7788(00)00114-6	journal	April 2001
Methodology to estimate building energy consumption using EnergyPlus Benchmark Models Fumo, Nelson; Mago, Pedro; Luck, Rogelio Energy and Buildings, Vol. 42, Issue 12 https://doi.org/10.1016/j.enbuild.2010.07.027	journal	December 2010
A review of methods to match building energy simulation models to measured data Coakley, Daniel; Raftery, Paul; Keane, Marcus Renewable and Sustainable Energy Reviews, Vol. 37 https://doi.org/10.1016/j.rser.2014.05.007	journal	September 2014
Calibrating whole building energy models: Detailed case study using hourly measured data Raftery, Paul; Keane, Marcus; Costa, Andrea Energy and Buildings, Vol. 43, Issue 12 https://doi.org/10.1016/j.enbuild.2011.09.039	journal	December 2011
Model calibration for building energy efficiency simulation Mustafaraj, Giorgio; Marini, Dashamir; Costa, Andrea Applied Energy, Vol. 130 https://doi.org/10.1016/j.apenergy.2014.05.019	journal	October 2014
Measured and predicted energy demand of a low energy building: important aspects when using Building Energy Simulation Karlsson, F.; Rohdin, P.; Persson, M. -L. Building Services Engineering Research and Technology, Vol. 28, Issue 3 https://doi.org/10.1177/0143624407077393	journal	August 2007
Do LEED-certified buildings save energy? Not really… Scofield, John H. Energy and Buildings, Vol. 41, Issue 12 https://doi.org/10.1016/j.enbuild.2009.08.006	journal	December 2009
Uncalibrated Building Energy Simulation Modeling Results Ahmad, Mushtaq; Culp, Charles HVAC&R Research, Vol. 12, Issue 4 https://doi.org/10.1080/10789669.2006.10391455	journal	October 2006
Simulation of occupancy in buildings Feng, Xiaohang; Yan, Da; Hong, Tianzhen Energy and Buildings, Vol. 87 https://doi.org/10.1016/j.enbuild.2014.11.067	journal	January 2015
Importance of occupancy information for building climate control Oldewurtel, Frauke; Sturzenegger, David; Morari, Manfred Applied Energy, Vol. 101 https://doi.org/10.1016/j.apenergy.2012.06.014	journal	January 2013
Climate models for the assessment of office buildings energy performance Gugliermetti, F.; Passerini, G.; Bisegna, F. Building and Environment, Vol. 39, Issue 1 https://doi.org/10.1016/S0360-1323(03)00138-0	journal	January 2004
A fresh look at weather impact on peak electricity demand and energy use of buildings using 30-year actual weather data Hong, Tianzhen; Chang, Wen-Kuei; Lin, Hung-Wen Applied Energy, Vol. 111 https://doi.org/10.1016/j.apenergy.2013.05.019	journal	November 2013
Predicted vs. actual energy performance of non-domestic buildings: Using post-occupancy evaluation data to reduce the performance gap Menezes, Anna Carolina; Cripps, Andrew; Bouchlaghem, Dino Applied Energy, Vol. 97 https://doi.org/10.1016/j.apenergy.2011.11.075	journal	September 2012
An insight into actual energy use and its drivers in high-performance buildings Li, Cheng; Hong, Tianzhen; Yan, Da Applied Energy, Vol. 131 https://doi.org/10.1016/j.apenergy.2014.06.032	journal	October 2014
Assessing building performance by simulation Clarke, J. A. Building and Environment, Vol. 28, Issue 4 https://doi.org/10.1016/0360-1323(93)90019-Y	journal	October 1993
A methodology for building energy modelling and calibration in warm climates Pedrini, A.; Westphal, F. S.; Lamberts, R. Building and Environment, Vol. 37, Issue 8-9 https://doi.org/10.1016/S0360-1323(02)00051-3	journal	August 2002
A review on the basics of building energy estimation Fumo, Nelson Renewable and Sustainable Energy Reviews, Vol. 31 https://doi.org/10.1016/j.rser.2013.11.040	journal	March 2014
Stochastic modeling of overtime occupancy and its application in building energy simulation and calibration Sun, Kaiyu; Yan, Da; Hong, Tianzhen Building and Environment, Vol. 79 https://doi.org/10.1016/j.buildenv.2014.04.030	journal	September 2014
Energy signatures for assessing the energy performance of chillers Yu, F. W.; Chan, K. T. Energy and Buildings, Vol. 37, Issue 7 https://doi.org/10.1016/j.enbuild.2004.10.004	journal	July 2005
A rapid calibration procedure and case study for simplified simulation models of commonly used HVAC systems Liu, Guopeng; Liu, Mingsheng Building and Environment, Vol. 46, Issue 2 https://doi.org/10.1016/j.buildenv.2010.08.002	journal	February 2011
Calibrated building energy simulation and its application in a high-rise commercial building in Shanghai Pan, Yiqun; Huang, Zhizhong; Wu, Gang Energy and Buildings, Vol. 39, Issue 6 https://doi.org/10.1016/j.enbuild.2006.09.013	journal	June 2007
Calibrating whole building energy models: An evidence-based methodology Raftery, Paul; Keane, Marcus; O’Donnell, James Energy and Buildings, Vol. 43, Issue 9 https://doi.org/10.1016/j.enbuild.2011.05.020	journal	September 2011
Calibrating Detailed Building Energy Simulation Programs with Measured Data—Part I: General Methodology (RP-1051) Reddy, T. Agami; Maor, Itzhak; Panjapornpon, Chanin HVAC&R Research, Vol. 13, Issue 2 https://doi.org/10.1080/10789669.2007.10390952	journal	March 2007
Calibration of Building Energy Simulation Programs Using the Analytic Optimization Approach (RP-1051) Sun, Jian; Reddy, T. Agami HVAC&R Research, Vol. 12, Issue 1 https://doi.org/10.1080/10789669.2006.10391173	journal	January 2006
Bayesian calibration of computer models Kennedy, Marc C.; O'Hagan, Anthony Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 63, Issue 3 https://doi.org/10.1111/1467-9868.00294	journal	August 2001
Sensitivity analysis techniques for building thermal simulation programs Lomas, Kevin J.; Eppel, Herbert Energy and Buildings, Vol. 19, Issue 1 https://doi.org/10.1016/0378-7788(92)90033-D	journal	January 1992
Calibration of building energy models for retrofit analysis under uncertainty Heo, Y.; Choudhary, R.; Augenbroe, G. A. Energy and Buildings, Vol. 47 https://doi.org/10.1016/j.enbuild.2011.12.029	journal	April 2012
Reduced-order modeling and simulated annealing optimization for efficient residential building utility bill calibration Robertson, Joseph J.; Polly, Ben J.; Collis, Jon M. Applied Energy, Vol. 148 https://doi.org/10.1016/j.apenergy.2015.03.049	journal	June 2015
Development of a probabilistic graphical model for predicting building energy performance O’Neill, Zheng; O’Neill, Charles Applied Energy, Vol. 164 https://doi.org/10.1016/j.apenergy.2015.12.015	journal	February 2016
Calibration of Dynamic Building Energy Models with Multiple Responses Using Bayesian Inference and Linear Regression Models Li, Qi; Gu, Li; Augenbroe, Godfried Energy Procedia, Vol. 78 https://doi.org/10.1016/j.egypro.2015.11.037	journal	November 2015
Identifying informative energy data in Bayesian calibration of building energy models Tian, Wei; Yang, Song; Li, Zhanyong Energy and Buildings, Vol. 119 https://doi.org/10.1016/j.enbuild.2016.03.042	journal	May 2016
Genetic algorithm for building envelope calibration Ramos Ruiz, Germán; Fernández Bandera, Carlos; Gómez-Acebo Temes, Tomás Applied Energy, Vol. 168 https://doi.org/10.1016/j.apenergy.2016.01.075	journal	April 2016
Scalable tuning of building models to hourly data Garrett, Aaron; New, Joshua Energy, Vol. 84 https://doi.org/10.1016/j.energy.2015.03.014	journal	May 2015
A general approach for generating reduced-order models for large multi-zone buildings Kim, Donghun; Braun, James E. Journal of Building Performance Simulation, Vol. 8, Issue 6 https://doi.org/10.1080/19401493.2014.977952	journal	November 2014
An introduction to simulated evolutionary optimization Fogel, D. B. IEEE Transactions on Neural Networks, Vol. 5, Issue 1 https://doi.org/10.1109/72.265956	journal	January 1994
What is evolutionary computation? Fogel, D. B. IEEE Spectrum, Vol. 37, Issue 2 https://doi.org/10.1109/6.819926	journal	February 2000
Straight-line correlations for annual energy-consumption predictions? Deeble, V. C.; Probert, S. D. Applied Energy, Vol. 25, Issue 1 https://doi.org/10.1016/0306-2619(86)90060-7	journal	January 1986
Assessment of the energy savings due to the building retrofit Zmeureanu, Radu Building and Environment, Vol. 25, Issue 2 https://doi.org/10.1016/0360-1323(90)90020-R	journal	January 1990
PRISM: An introduction Fels, Margaret F. Energy and Buildings, Vol. 9, Issue 1-2 https://doi.org/10.1016/0378-7788(86)90003-4	journal	February 1986
Building vintage and electricity use: Old homes use less electricity in hot weather Chong, Howard European Economic Review, Vol. 56, Issue 5 https://doi.org/10.1016/j.euroecorev.2012.02.009	journal	July 2012
Development of methodology for calibrated simulation in single-family residential buildings using three-parameter change-point regression model Kim, Kee Han; Haberl, Jeff S. Energy and Buildings, Vol. 99 https://doi.org/10.1016/j.enbuild.2015.04.032	journal	July 2015

Cited By (4)

Development of building thermal environment emulator to evaluate the performance of the HVAC system operation Togashi, Eisuke; Miyata, Masato Journal of Building Performance Simulation, Vol. 12, Issue 5 https://doi.org/10.1080/19401493.2019.1601259	journal	April 2019
Validation of Calibrated Energy Models: Common Errors Ruiz, Germán; Bandera, Carlos Energies, Vol. 10, Issue 10 https://doi.org/10.3390/en10101587	journal	October 2017
Effectiveness of Automatic and Manual Calibration of an Office Building Energy Model Cornaro, Cristina; Bosco, Francesco; Lauria, Marco Applied Sciences, Vol. 9, Issue 10 https://doi.org/10.3390/app9101985	journal	May 2019
Uncertainy’s Indices Assessment for Calibrated Energy Models González, Vicente Gutiérrez; Colmenares, Lissette Álvarez; Fidalgo, Jesús Fernando López Energies, Vol. 12, Issue 11 https://doi.org/10.3390/en12112096	journal	May 2019

Similar Records

Scalable tuning of building models to hourly data

Journal Article · Tue Mar 31 00:00:00 EDT 2015 · Energy (Oxford) · OSTI ID:1311239

Garrett, Aaron; New, Joshua Ryan

Energy Performance Assessment of Radiant Cooling System through Modeling and Calibration at Component Level

Conference · Fri Jan 01 00:00:00 EST 2016 · OSTI ID:1311239

Khan, Yasin; Mathur, Jyotirmay; Bhandari, Mahabir S

Commercial Building Technology Demonstration (Final Scientific/Technical Report)

Technical Report · Tue Aug 13 00:00:00 EDT 2019 · OSTI ID:1311239

Meirav, Udi

Related Subjects

29 ENERGY PLANNING, POLICY, AND ECONOMY

Title: Evaluation of “Autotune” calibration against manual calibration of building energy models

Citation Formats

References (65)

Cited By (4)

Similar Records

Related Subjects