Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Emulation and detection of physical faults and cyber-attacks on building energy systems through real-time hardware-in-the-loop experiments

Journal Article · · Energy and Buildings
 [1];  [2];  [3];  [1];  [3];  [1];  [1];  [1];  [4];  [4];  [4];  [5];  [6]
  1. Texas A & M Univ., College Station, TX (United States)
  2. Raytheon Technologies Research Center, East Hartford, CT (United States)
  3. Drexel Univ., Philadelphia, PA (United States)
  4. Arizona State Univ., Tempe, AZ (United States)
  5. Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)
  6. Northwestern Univ., Evanston, IL (United States)

The increasing use of remote or mobile access, integrated wearable technologies, data exchange, and cloud-based data analytics in modern smart buildings is steering the building industry towards open communication technologies. The increased connectivity and accessibility could lead to more cyber-attacks in smart buildings. On the other hand, physical faults (e.g., HVAC -heating, ventilation, and air-conditioning faults) may have similar adverse impacts as those from the cyber-attacks on building energy systems, such as occupant discomfort, energy wastage, and equipment downtime. However, current physical behavior-based anomaly detection methods fail to differentiate between cyber-attacks and physical faults in building energy systems. Moreover, the challenge in collecting real-world threat data with ground truth has led researchers to rely on numerical models with user-defined assumptions, which may not accurately reflect real-world conditions due to the lack of in-situ experimental datasets. To address these challenges and gaps, this paper presents a flexible hardware-in-the-loop (HIL) testbed for generating cyber-attack and physical fault datasets and demonstrating threat detection algorithms in a real building automation system (BAS) environment. This testbed combines hardware (i.e., real BAS with local HVAC controllers and a physical network) with software (i.e., high-fidelity models to represent behaviors of building envelope and HVAC energy systems), enabling emulations of realistic threats. Five HIL experiments, including one baseline without any threats, two with physical faults, and two with cyber-attacks, were conducted to generate datasets containing detailed network traffic and system states. A joint classification framework, incorporating a network analyzer and a physical HVAC fault detector, was proposed to automatically detect cyber-physical abnormalities on BAS at both the network and the physical HVAC levels. The network analyzer comprises a conditional random fields (CRF) based command validator and a statistics-based detection strategy. The fault detector employs a weather and schedule-based pattern matching and feature-based principal component analysis (WPM-FPCA) method. Evaluation of the classification using four metrics from the multi-class confusion matrix revealed an average accuracy of 90.2%, recall of 89.7%, precision of 88.5% and F1-score of 89.2%. Finally, these results demonstrate that the proposed joint classification framework can effectively differentiate between specific types of cyber-attacks (e.g., device reinitialization attack, network Denial-of-Service attack) and physical faults (e.g., air handling unit operational fault, cooling coil valve stuck) in real time for improved building energy management.

Research Organization:
Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)
Sponsoring Organization:
USDOE Office of Energy Efficiency and Renewable Energy (EERE), Energy Efficiency Office. Building Technologies Office
Grant/Contract Number:
AC05-76RL01830; EE0009150
OSTI ID:
2458230
Alternate ID(s):
OSTI ID: 2466310
OSTI ID: 2567482
Report Number(s):
PNNL-SA--197891
Journal Information:
Energy and Buildings, Journal Name: Energy and Buildings Vol. 320; ISSN 0378-7788
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English

References (38)

Secure the Internet, one home at a time journal July 2016
Hardware-in-the-loop simulation for the design and testing of engine-control systems journal May 1999
Fault detection for non-condensing boilers using simulated building automation system sensor data journal October 2020
Modeling and evaluation of cyber-attacks on grid-interactive efficient buildings journal December 2021
A review of data-driven fault detection and diagnostics for building HVAC systems journal June 2023
A critical review of cyber-physical security for building automation systems journal January 2023
A data-driven approach to simultaneous fault detection and diagnosis in data centers journal October 2021
Automated daily pattern filtering of measured building performance data journal January 2015
Generative adversarial network for fault detection diagnosis of chillers journal April 2020
Context aware intrusion detection for building automation systems journal August 2019
Online model-based fault detection and diagnosis strategy for VAV air handling units journal December 2012
Improved sensor fault detection, diagnosis and estimation for screw chillers using density-based clustering and principal component analysis journal August 2018
An agent-based hardware-in-the-loop simulation framework for building controls journal December 2018
Unsupervised learning for fault detection and diagnosis of air handling units journal March 2020
A flexible and generic functional mock-up unit based threat injection framework for grid-interactive efficient buildings: A case study in Modelica journal November 2021
A holistic fault impact analysis of the high-performance sequences of operation for HVAC systems: Modelica-based case study in a medium-office building journal December 2021
Real vs. simulated: Questions on the capability of simulated datasets on building fault detection for energy efficiency from a data-driven perspective journal March 2022
Fault detection analysis using data mining techniques for a cluster of smart office buildings journal June 2015
Active Model Discrimination with Applications to Fraud Detection in Smart Buildings * *This work is supported in part by an Early Career Faculty grant from NASA’s Space Technology Research Grants Program and DARPA grant N66001-14-1-4045. journal July 2017
Understanding the physical and economic consequences of attacks on control systems journal October 2009
Modeling, analyzing and predicting security cascading attacks in smart buildings systems-of-systems journal April 2020
A Method for Revealing and Addressing Security Vulnerabilities in Cyber-physical Systems by Modeling Malicious Agent Interactions with Formal Verification journal January 2016
Application of data-driven attack detection framework for secure operation in smart buildings journal June 2021
Review Article: Methods for Fault Detection, Diagnostics, and Prognostics for Building Systems—A Review, Part I journal January 2005
Review Article: Methods for Fault Detection, Diagnostics, and Prognostics for Building Systems—A Review, Part II journal April 2005
Modelica Buildings library journal March 2013
A cosine-based correlation information entropy approach for building automatic fault detection baseline construction journal June 2022
Empirical analysis of the prevalence of HVAC faults in commercial buildings journal October 2023
A hardware-in-the-loop (HIL) testbed for cyber-physical energy systems in smart commercial buildings journal April 2024
A research study on unsupervised machine learning algorithms for early fault detection in predictive maintenance conference April 2018
Intrusion Detection & Response using an Unsupervised Artificial Neural Network on a Single Board Computer for Building Control Resilience conference August 2018
Multilayer Data-Driven Cyber-Attack Detection System for Industrial Control Systems Based on Network, System, and Process Data journal July 2019
Model-Based Attack Detection and Mitigation for Automatic Generation Control journal March 2014
Review of hardware-in-the-loop simulation and its prospects in the automotive area conference May 2006
Automatic Deployment of Specification-based Intrusion Detection in the BACnet Protocol conference November 2017
Assessing and mitigating impact of time delay attack conference April 2019
Learning-based framework for sensor fault-tolerant building HVAC control with model-assisted learning
  • Xu, Shichao; Fu, Yangyang; Wang, Yixuan
  • Proceedings of the 8th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation https://doi.org/10.1145/3486611.3486644
conference November 2021
CYDRES: CYber Defense and REsilient System for securing grid-interactive efficient buildings
  • Li, Guowen; O'Neill, Zheng; Wen, Jin
  • Proceedings of the 10th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation https://doi.org/10.1145/3600100.3626273
conference November 2023