Enhancing Distribution System Resilience: A First-Order Meta-RL Algorithm for Critical Load Restoration
The increasing frequency of extreme events and the integration of distributed energy resources (DERs) into modern grids have elevated the need for resilient and efficient critical load restoration strategies in distribution systems. However, the stochastic nature of renewable DERs, limited energy resource availability and the intricate nonlinearities inherent in complex grid control problem make the problem challenging. Although reinforcement learning (RL) and warm-start RL methods have shown promising results, their performance often falls short in rapidly adapting to new, unseen situations and typically requires exhaustive problem-specific tuning. To address these gaps, we propose a First-Order Meta-based RL (FOM-RL) algorithm within an online framework for adaptive and robust critical load restoration. By harnessing local DERs as the enabling technology, FOM-RL allows the RL agent to swiftly adapt to new unseen scenarios by leveraging previously acquired knowledge of different tasks. Experimental results provide evidence that proposed algorithm learns more efficiently and showcases generalization capabilities across diverse set of operational scenarios. Moreover, a rigorous theoretical analysis yields a tight sublinear regret bound, sensitive to temporal variability, with a task-averaged optimality gap bounded by O(VM+D*/(Tsquare root(M))). These results suggest that optimality improves with task similarity and an increased number of tasks M, reaffirming the efficacy and scalability of the proposed approach in addressing the complexities of critical load restoration in distribution systems.
- Research Organization:
- National Renewable Energy Laboratory (NREL), Golden, CO (United States)
- Sponsoring Organization:
- National Science Foundation (NSF)
- DOE Contract Number:
- AC36-08GO28308
- OSTI ID:
- 2497732
- Report Number(s):
- NREL/CP-2C00-92622; MainId:94403; UUID:ce8a0d08-dbdc-40c0-88da-2fea98477a75; MainAdminId:75660
- Country of Publication:
- United States
- Language:
- English
Similar Records
Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning
Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning: Preprint
Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning
Conference
·
Tue Dec 29 23:00:00 EST 2020
·
OSTI ID:1766867
Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning: Preprint
Conference
·
Mon Oct 19 00:00:00 EDT 2020
·
OSTI ID:1686139
Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning
Conference
·
Mon Sep 20 00:00:00 EDT 2021
·
OSTI ID:1821621