DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Postdisaster Routing of Movable Energy Resources for Enhanced Distribution System Resilience: A Deep Reinforcement Learning-Based Approach

Journal Article · · IEEE Industry Applications Magazine

The deployment of movable energy resources (MERs) can be an effective strategy to restore critical loads to enhance power system resilience when no other energy sources are available after the occurrence of an extreme event. Since the optimal locations of MERs following an extreme event are dependent on system operating states (e.g., the loads at each node, on/off status of system branches, and so on), existing analytical and population-based approaches must repeat the entire analysis and calculation when the system operating states change. On the contrary, if deep reinforcement learning (DRL)-based algorithms are sufficiently trained with a wide range of scenarios, they can quickly find optimal or near-optimal locations irrespective of changes in system states. A deep Q-learning-based approach is proposed for optimal MER deployment to enhance power system resilience. MERs can be also utilized to complement other types of resources, if available. The proposed approach operates in two stages after the occurrence of extreme events. In the first stage, the distribution network is represented as a graph, and the network is then reconfigured using tie switches by using Kruskal’s spanning forest search algorithm (KSFSA). To maximize critical load recovery, the optimal or near-optimal locations of MERs are chosen in the second stage. Further, case studies on a 33-node distribution system and a modified IEEE 123-node system demonstrate the effectiveness of the proposed approach for postdisaster routing of MERs.

Research Organization:
Idaho National Laboratory (INL), Idaho Falls, ID (United States); Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
Sponsoring Organization:
USDOE; National Science Foundation (NSF)
Grant/Contract Number:
AC07-05ID14517; NSF 1847578; AC05-00OR22725
OSTI ID:
2204847
Alternate ID(s):
OSTI ID: 2283855
Report Number(s):
INL/JOU-23-74337-Rev.000; TRN: US2406860
Journal Information:
IEEE Industry Applications Magazine, Vol. 30, Issue 1; ISSN 1077-2618
Publisher:
IEEECopyright Statement
Country of Publication:
United States
Language:
English

References (13)

Formulations and Branch-and-Cut Algorithm for the K-rooted Mini-Max Spanning Forest Problem book January 2011
Network Reconfiguration in Distribution Systems for Loss Reduction and Load Balancing journal January 1989
Enhancing Seismic Resilience of Electric Power Distribution Systems with Mobile Power Sources conference September 2019
Application of Mobile Energy Storage for Enhancing Power Grid Resilience: A Review journal October 2021
Human-level control through deep reinforcement learning journal February 2015
Cascading risks: Understanding the 2021 winter blackout in Texas journal July 2021
Experience Replay for Real-Time Reinforcement Learning Control journal March 2012
Solution of minimum spanning forest problems with reliability constraints journal April 2020
Detection of Static and Mobile Targets by an Autonomous Agent with Deep Q-Learning Abilities journal August 2022
Deep reinforcement learning assisted co-optimization of Volt-VAR grid service in distribution networks journal September 2023
GCPSO in cooperation with graph theory to distribution network reconfiguration for energy saving journal March 2010
Continuous control for robot based on deep reinforcement learning dissertation January 2019
A graph theory and coalitional game theory-based pre-positioning of movable energy resources for enhanced distribution system resilience journal September 2023