Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Evaluating the Adaptability of Reinforcement Learning Based HVAC Control for Residential Houses

Journal Article · · Sustainability (Basel)
DOI:https://doi.org/10.3390/su12187727· OSTI ID:2391022

Intelligent Heating, Ventilation, and Air Conditioning (HVAC) control using deep reinforcement learning (DRL) has recently gained a lot of attention due to its ability to optimally control the complex behavior of the HVAC system. However, more exploration is needed on understanding the adaptability challenges that the DRL agent could face during the deployment phase. Using online learning for such applications is not realistic due to the long learning period and likely poor comfort control during the learning process. Alternatively, DRL can be pre-trained using a building model prior to deployment. However, developing an accurate building model for every house and deploying a pre-trained DRL model for HVAC control would not be cost-effective. In this study, we focus on evaluating the ability of DRL-based HVAC control to provide cost savings when pre-trained on one building model and deployed on different house models with varying user comforts. We observed around 30% of cost reduction by pre-trained model over baseline when validated in a simulation environment and achieved up to 21% cost reduction when deployed in the real house. This finding provides experimental evidence that the pre-trained DRL has the potential to adapt to different house environments and comfort settings.

Sponsoring Organization:
USDOE
Grant/Contract Number:
AC05-00OR22725
OSTI ID:
2391022
Alternate ID(s):
OSTI ID: 1665985
Journal Information:
Sustainability (Basel), Journal Name: Sustainability (Basel) Journal Issue: 18 Vol. 12; ISSN SUSTDE; ISSN 2071-1050
Publisher:
MDPI AGCopyright Statement
Country of Publication:
Switzerland
Language:
English

References (15)

Advanced fuzzy logic controllers design and evaluation for buildings’ occupants thermal–visual comfort and indoor air quality satisfaction journal July 2001
Fuzzy logic-based advanced on–off control for thermal comfort in residential buildings journal October 2015
Theory and applications of HVAC control systems – A review of model predictive control (MPC) journal February 2014
Optimal design of building environment with hybrid genetic algorithm, artificial neural network, multivariate regression analysis and fuzzy logic controller journal May 2020
Reinforcement learning for whole-building HVAC control and demand response journal November 2020
Optimal control of HVAC and window systems for natural ventilation through reinforcement learning journal June 2018
Whole building energy model for HVAC optimal control: A practical framework based on deep reinforcement learning journal September 2019
A review on optimized control systems for building energy and comfort management of smart sustainable buildings journal June 2014
Human-level control through deep reinforcement learning journal February 2015
Application of deep Q-networks for model-free optimal control balancing between different HVAC systems journal October 2019
Advanced Fuzzy-Logic-Based Context-Driven Control for HVAC Management Systems in Buildings journal January 2020
A multi-grid reinforcement learning method for energy conservation and comfort of HVAC in buildings conference August 2015
Practical implementation and evaluation of deep reinforcement learning control for a radiant heating system
  • Zhang, Zhiang; Lam, Khee Poh
  • BuildSys '18: The 5th ACM International Conference on Systems for Built Environments, Proceedings of the 5th Conference on Systems for Built Environments https://doi.org/10.1145/3276774.3276775
conference November 2018
Thermal comfort based fuzzy logic controller journal November 2001
A Long-Short Term Memory Recurrent Neural Network Based Reinforcement Learning Controller for Office Heating Ventilation and Air Conditioning Systems journal August 2017

Similar Records

Electricity Pricing aware Deep Reinforcement Learning based Intelligent HVAC Control
Conference · Sun Nov 01 00:00:00 EDT 2020 · OSTI ID:1720222

Deep Reinforcement Learning for Residential HVAC Control with Consideration of Human Occupancy
Conference · Mon Nov 30 23:00:00 EST 2020 · OSTI ID:1760143

Related Subjects