Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

A Pattern-Recognition-Based Ensemble Data Imputation Framework for Sensors from Building Energy Systems

Journal Article · · Sensors
DOI:https://doi.org/10.3390/s20205947· OSTI ID:1770910
Building operation data are important for monitoring, analysis, modeling, and control of building energy systems. However, missing data is one of the major data quality issues, making data imputation techniques become increasingly important. There are two key research gaps for missing sensor data imputation in buildings: the lack of customized and automated imputation methodology, and the difficulty of the validation of data imputation methods. In this paper, a framework is developed to address these two gaps. First, a validation data generation module is developed based on pattern recognition to create a validation dataset to quantify the performance of data imputation methods. Second, a pool of data imputation methods is tested under the validation dataset to find an optimal single imputation method for each sensor, which is termed as an ensemble method. The method can reflect the specific mechanism and randomness of missing data from each sensor. The effectiveness of the framework is demonstrated by 18 sensors from a real campus building. The overall accuracy of data imputation for those sensors improves by 18.2% on average compared with the best single data imputation method.
Research Organization:
National Renewable Energy Laboratory (NREL), Golden, CO (United States)
Sponsoring Organization:
USDOE Office of Energy Efficiency and Renewable Energy (EERE), Energy Efficiency Office. Building Technologies Office
Grant/Contract Number:
AC36-08GO28308
OSTI ID:
1770910
Report Number(s):
NREL/JA--5500-77488; MainId:27424; UUID:b129e4bf-a432-4a5a-9531-116c73646407; MainAdminID:19944
Journal Information:
Sensors, Journal Name: Sensors Journal Issue: 20 Vol. 20; ISSN 1424-8220
Publisher:
MDPI AGCopyright Statement
Country of Publication:
United States
Language:
English

References (11)

Multiple imputation: review of theory, implementation and software journal January 2007
Predicting electricity consumption for commercial and residential buildings using deep recurrent neural networks journal February 2018
Data association mining for identifying lighting energy waste patterns in educational institutes journal July 2013
Data mining in building automation system for improving building operational performance journal June 2014
Comparison of building energy use data between the United States and China journal August 2014
A systematic feature selection procedure for short-term data-driven building energy forecasting model development journal January 2019
A bi-directional missing data imputation scheme based on LSTM and transfer learning for building energy data journal June 2020
A Review of Methods for Missing Data journal December 2001
Missing Data, Imputation, and the Bootstrap journal June 1994
A case study to examine the imputation of missing data to improve clustering analysis of building electrical demand journal February 2015
Missing-Data Methods for Generalized Linear Models: A Comparative Review journal March 2005

Similar Records

A General Spatiotemporal Imputation Framework for Missing Sensor Data
Conference · Thu Aug 31 00:00:00 EDT 2023 · OSTI ID:2000020

Effective Missing Value Imputation Methods for Building Monitoring Data
Conference · Wed Dec 09 23:00:00 EST 2020 · OSTI ID:1783136

Imputation for multisource data with comparison and assessment techniques
Journal Article · Tue Dec 26 19:00:00 EST 2017 · Applied Stochastic Models in Business and Industry · OSTI ID:1416279