skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Accuracy of automated measurement and verification (M&V) techniques for energy savings in commercial buildings

Abstract

© 2016. Trustworthy savings calculations are critical to convincing investors in energy efficiency projects of the benefit and cost-effectiveness of such investments and their ability to replace or defer supply-side capital investments. However, today's methods for measurement and verification (M & V) of energy savings constitute a significant portion of the total costs of efficiency projects. They also require time-consuming manual data acquisition and often do not deliver results until years after the program period has ended. The rising availability of "smart" meters, combined with new analytical approaches to quantifying savings, has opened the door to conducting M & V more quickly and at lower cost, with comparable or improved accuracy. These meter- and software-based approaches, increasingly referred to as "M & V 2.0", are the subject of surging industry interest, particularly in the context of utility energy efficiency programs. Program administrators, evaluators, and regulators are asking how M & V 2.0 compares with more traditional methods, how proprietary software can be transparently performance tested, how these techniques can be integrated into the next generation of whole-building focused efficiency programs.This paper expands recent analyses of public-domain whole-building M & V methods, focusing on more novel M & V 2.0 modelingmore » approaches that are used in commercial technologies, as well as approaches that are documented in the literature, and/or developed by the academic building research community. We present a testing procedure and metrics to assess the performance of whole-building M & V methods. We then illustrate the test procedure by evaluating the accuracy of ten baseline energy use models, against measured data from a large dataset of 537 buildings. The results of this study show that the already available advanced interval data baseline models hold great promise for scaling the adoption of building measured savings calculations using Advanced Metering Infrastructure (AMI) data. Median coefficient of variation of the root mean squared error (CV(RMSE)) was less than 25% for every model tested when twelve months of training data were used. With even six months of training data, median CV(RMSE) for daily energy total was under 25% for all models tested. These findings can be used to build confidence in model robustness, and the readiness of these approaches for industry uptake and adoption.« less

Authors:
 [1];  [1];  [1];  [1];  [2];  [1]
  1. Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
  2. Quantum Energy Services and Technologies, Inc., Berkeley, CA (United States)
Publication Date:
Research Org.:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Org.:
USDOE Office of Energy Efficiency and Renewable Energy (EERE), Energy Efficiency Office. Building Technologies Office
OSTI Identifier:
1340305
Alternate Identifier(s):
OSTI ID: 1324858; OSTI ID: 1379412
Report Number(s):
LBNL-1005181
Journal ID: ISSN 0306-2619; ir:1005181
Grant/Contract Number:  
AC02-05CH11231
Resource Type:
Journal Article: Accepted Manuscript
Journal Name:
Applied Energy
Additional Journal Information:
Journal Volume: 173; Journal Issue: C; Journal ID: ISSN 0306-2619
Publisher:
Elsevier
Country of Publication:
United States
Language:
English
Subject:
29 ENERGY PLANNING, POLICY, AND ECONOMY; 32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION; baseline model; measurement and verification; whole-building energy; predictive performance accuracy; building energy analysis; M&V 2.0

Citation Formats

Granderson, Jessica, Touzani, Samir, Custodio, Claudine, Sohn, Michael D., Jump, David, and Fernandes, Samuel. Accuracy of automated measurement and verification (M&V) techniques for energy savings in commercial buildings. United States: N. p., 2016. Web. doi:10.1016/j.apenergy.2016.04.049.
Granderson, Jessica, Touzani, Samir, Custodio, Claudine, Sohn, Michael D., Jump, David, & Fernandes, Samuel. Accuracy of automated measurement and verification (M&V) techniques for energy savings in commercial buildings. United States. https://doi.org/10.1016/j.apenergy.2016.04.049
Granderson, Jessica, Touzani, Samir, Custodio, Claudine, Sohn, Michael D., Jump, David, and Fernandes, Samuel. 2016. "Accuracy of automated measurement and verification (M&V) techniques for energy savings in commercial buildings". United States. https://doi.org/10.1016/j.apenergy.2016.04.049. https://www.osti.gov/servlets/purl/1340305.
@article{osti_1340305,
title = {Accuracy of automated measurement and verification (M&V) techniques for energy savings in commercial buildings},
author = {Granderson, Jessica and Touzani, Samir and Custodio, Claudine and Sohn, Michael D. and Jump, David and Fernandes, Samuel},
abstractNote = {© 2016. Trustworthy savings calculations are critical to convincing investors in energy efficiency projects of the benefit and cost-effectiveness of such investments and their ability to replace or defer supply-side capital investments. However, today's methods for measurement and verification (M & V) of energy savings constitute a significant portion of the total costs of efficiency projects. They also require time-consuming manual data acquisition and often do not deliver results until years after the program period has ended. The rising availability of "smart" meters, combined with new analytical approaches to quantifying savings, has opened the door to conducting M & V more quickly and at lower cost, with comparable or improved accuracy. These meter- and software-based approaches, increasingly referred to as "M & V 2.0", are the subject of surging industry interest, particularly in the context of utility energy efficiency programs. Program administrators, evaluators, and regulators are asking how M & V 2.0 compares with more traditional methods, how proprietary software can be transparently performance tested, how these techniques can be integrated into the next generation of whole-building focused efficiency programs.This paper expands recent analyses of public-domain whole-building M & V methods, focusing on more novel M & V 2.0 modeling approaches that are used in commercial technologies, as well as approaches that are documented in the literature, and/or developed by the academic building research community. We present a testing procedure and metrics to assess the performance of whole-building M & V methods. We then illustrate the test procedure by evaluating the accuracy of ten baseline energy use models, against measured data from a large dataset of 537 buildings. The results of this study show that the already available advanced interval data baseline models hold great promise for scaling the adoption of building measured savings calculations using Advanced Metering Infrastructure (AMI) data. Median coefficient of variation of the root mean squared error (CV(RMSE)) was less than 25% for every model tested when twelve months of training data were used. With even six months of training data, median CV(RMSE) for daily energy total was under 25% for all models tested. These findings can be used to build confidence in model robustness, and the readiness of these approaches for industry uptake and adoption.},
doi = {10.1016/j.apenergy.2016.04.049},
url = {https://www.osti.gov/biblio/1340305}, journal = {Applied Energy},
issn = {0306-2619},
number = C,
volume = 173,
place = {United States},
year = {Sat Apr 16 00:00:00 EDT 2016},
month = {Sat Apr 16 00:00:00 EDT 2016}
}

Journal Article:

Citation Metrics:
Cited by: 53 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Building energy information systems: user case studies
journal, June 2010


Quantifying Changes in Building Electricity Use, With Application to Demand Response
journal, September 2011


Baseline building energy modeling and localized uncertainty quantification using Gaussian mixture models
journal, October 2013


Gaussian process modeling for measurement and verification of building energy savings
journal, October 2012


A review on the prediction of building energy consumption
journal, August 2012


Uncertainty estimation improves energy measurement and verification procedures
journal, October 2014


Random Forests
journal, January 2001


Extremely randomized trees
journal, March 2006


Works referencing / citing this record:

More Buildings Make More Generalizable Models—Benchmarking Prediction Methods on Open Electrical Meter Data
journal, August 2019


Bayesian Energy Measurement and Verification Analysis
journal, February 2018


An Improved Residual Network for Electricity Power Meter Error Estimation
journal, June 2019


Bayesian Energy Measurement and Verification Analysis
journal, December 2017


The Building Data Genome Project 2, energy meter data from the ASHRAE Great Energy Predictor III competition
journal, October 2020


Bayesian Energy Measurement and Verification Analysis
journal, February 2018


Low-Cost Energy Meter Calibration Method for Measurement and Verification
text, January 2016