Multi-Agent Hierarchical Deep Reinforcement Learning for HVAC Control With Flexible DERs
Journal Article
·
· IEEE Transactions on Smart Grid
- Univ. of Connecticut, Storrs, CT (United States)
- National Renewable Energy Laboratory (NREL), Golden, CO (United States)
As electricity consumption in commercial and residential buildings continues to rise, reducing energy costs presents an increasing challenge. Heating, ventilating, and air-conditioning (HVAC) systems, which typically account for 40%-50% of a building's energy use, are prime targets for energy savings. Intelligent control of HVAC temperature through the exploitation of HVAC load flexibility brings significant potential to reduce energy consumption and electricity expenses. The nonlinear models of HVAC systems challenge traditional control methods, while the uncertainty introduced by HVAC load flexibility complicates distributed energy resource (DER) management using conventional optimal dispatch techniques. In response to these challenges, we propose a hierarchical multi-agent deep reinforcement learning (DRL) approach. The lower-level agents focus on balancing comfort and energy conservation, while the upper-level DRL agents optimize the use of DERs to reduce peak demand based on the control outcomes of the HVAC by the lower-level agents. Here, in the upper-level agents, we incorporate a multi-agent structure based on ensemble learning, which acts based on historical and current data without relying on precise load forecasting to address the delayed rewarding issue in DRL. This allows for the effective reduction of energy costs. The proposed method is tested using a real-world microgrid comprising 413 buildings in Southern California, and the results demonstrate that our approach can significantly reduce overall electricity bills while ensuring the comfort of consumers and residents.
- Research Organization:
- National Renewable Energy Laboratory (NREL), Golden, CO (United States)
- Sponsoring Organization:
- USDOE; USDOD
- Grant/Contract Number:
- AC36-08GO28308
- OSTI ID:
- 2587057
- Report Number(s):
- NREL/JA--5D00-91137
- Journal Information:
- IEEE Transactions on Smart Grid, Journal Name: IEEE Transactions on Smart Grid Journal Issue: 6 Vol. 16; ISSN 1949-3053; ISSN 1949-3061
- Publisher:
- IEEECopyright Statement
- Country of Publication:
- United States
- Language:
- English
Similar Records
Deep Reinforcement Learning for Microgrid Cost Optimization Considering Load Flexibility
Evaluating the Adaptability of Reinforcement Learning Based HVAC Control for Residential Houses
Conference
·
Fri Oct 04 00:00:00 EDT 2024
·
OSTI ID:2477396
Evaluating the Adaptability of Reinforcement Learning Based HVAC Control for Residential Houses
Journal Article
·
Fri Sep 18 00:00:00 EDT 2020
· Sustainability (Basel)
·
OSTI ID:2391022