Reinforcement Learning for Intentional Islanding in Resilient Power Transmission Systems
- The University of Texas at Dallas
- Idaho National Laboratory
Intentional islanding is the process of identifying and deliberately decomposing the transmission network to form self-sustained islands from an endangered network during disruptions to improve resilience and security. Most existing intentional islanding models are offline resilience decision tools and hence do not provide outage responses in a timely manner. In this paper, a reinforcement learning (RL) based model for intentional islanding is developed, which offers real-time switching control, online deployability, and adaptability to varying system conditions. The intentional islanding process is formulated as a Markov decision process, where the optimal transmission switching policy is learned using the RL approach. The control policy is learned over an environment that encompasses a Power System Simulator for Engineering (PSS/E) model of the transmission network, facilitated by an interface to the standard openAI Gym framework. The proposed RL-based methodology aims to form stable and self-sustainable islands by ensuring voltage stability while reducing the power mismatch in the formed islands. A proximal policy optimization algorithm is designed, which is suitable for controlling the on/off status of the switches with multi-layer perceptron as value and actor networks. The effectiveness of the proposed framework in the self-recovery of the grid by island formation is applied on the modified IEEE 39-bus test network and validated by dynamic simulations.
- Research Organization:
- Idaho National Laboratory (INL), Idaho Falls, ID (United States)
- Sponsoring Organization:
- 58
- DOE Contract Number:
- AC07-05ID14517
- OSTI ID:
- 1987459
- Report Number(s):
- INL/CON-23-72499-Rev000
- Country of Publication:
- United States
- Language:
- English
Similar Records
Hybrid-RL-MPC4CLR (Hybird-Reinforcement-Learning-Model-Predictive-Control-for-Reserve-Policy-Assisted-Critical-Load-Restoration-in-Distribution-Grids)
A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration
Enhancing Cyber Resilience of Networked Microgrids using Vertical Federated Reinforcement Learning
Software
·
Thu Mar 17 20:00:00 EDT 2022
·
OSTI ID:code-72315
A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration
Conference
·
Fri Jul 22 00:00:00 EDT 2022
·
OSTI ID:1878557
Enhancing Cyber Resilience of Networked Microgrids using Vertical Federated Reinforcement Learning
Conference
·
Mon Sep 25 00:00:00 EDT 2023
·
OSTI ID:2228805