Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Reinforcement-Learning-Based Smart Water Heater Control: An Actual Deployment

Conference ·

Utilizing smart control algorithms for electric water heaters (EWHs) is essential for fully harnessing the demand response (DR) potential of EWHs. For this reason, the use of reinforcement learning (RL) algorithms for EWHs has received increasing attention in recent years. However, existing RL approaches are either simulation-based or use pretrained RL agents. To this end, this paper presents the real-world deployment of a set of model-free RL approaches that aim to minimize the electricity cost of a EWH under a time-of-use electricity pricing policy using standard DR commands (e.g., shed, load up). The experiment results showed that the RL agents can help save electricity cost in the range of 11% to 14% compared to the baseline operation. This study demonstrated that RL-based EWH controllers can be deployed in real world without any prior training and can still save electricity cost.

Research Organization:
National Renewable Energy Lab. (NREL), Golden, CO (United States)
Sponsoring Organization:
USDOE Office of Energy Efficiency and Renewable Energy (EERE), Energy Efficiency Office. Building Technologies Office
DOE Contract Number:
AC36-08GO28308
OSTI ID:
1974026
Report Number(s):
NREL/CP-5600-86283; MainId:87056; UUID:c9494324-585a-41a9-831d-181aadd58922; MainAdminID:69518
Resource Relation:
Conference: Presented at the 2023 IEEE Power & Energy Society Innovative Smart Grid Technologies Conference (ISGT), 16-19 January 2023, Washington, D.C.
Country of Publication:
United States
Language:
English

References (10)

A review of reinforcement learning based energy management systems for electrified powertrains: Progress, challenge, and potential solution journal February 2022
Electric Water Heaters Management via Reinforcement Learning With Time-Delay in Isolated Microgrids journal January 2021
Electric Water Heaters for Transactive Systems: Model Evaluations and Performance Quantification journal September 2022
Deep Reinforcement Learning for Autonomous Water Heater Control journal November 2021
Real-Time MPC for Residential Building Water Heater Systems to Support the Electric Grid conference February 2020
Domain Randomization for Demand Response of an Electric Water Heater journal March 2021
Equivalent Electric and Heat-Pump Water Heater Models for Aggregated Community-Level Demand Response Virtual Power Plant Controls journal January 2021
Building Energy Management With Reinforcement Learning and Model Predictive Control: A Survey journal January 2022
Rule-based demand-side management of domestic hot water production with heat pumps in zero energy neighbourhoods journal June 2013
Dynamic Modeling and Optimal Design for Net Zero Energy Houses Including Hybrid Electric and Thermal Energy Storage journal January 2020