Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Fast Frequency Response using Reinforcement Learning-Controlled Wind Turbines

Conference ·
 [1];  [1];  [2];  [3];  [1]
  1. University of Denver
  2. University of Nebraska - Lincoln
  3. BATTELLE (PACIFIC NW LAB)

To fulfill the auxiliary grid services such as load regulation, spin and non-spin reserve, and frequency support during emergencies, power system operators often require certain wind farms to operate in de-loaded modes. By leveraging the fast response capability of wind farms, the reserved power in deloaded modes can significantly enhance the stability and reliability of power grids. This paper presents a novel methodology that incorporates wind turbines into reinforcement learning-based solutions for frequency response. The proposed approach employs the state-of-the-art reinforcement learning algorithm, surrogategradient- based evolution strategy (GSES), for continuous control of the wind farm output. Our methodology is tested on a modified IEEE-39 bus system, and simulation outcomes demonstrate that the proposed approach can reliably support the frequency of the power system and prevent unnecessary load shedding.

Research Organization:
Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)
Sponsoring Organization:
USDOE
DOE Contract Number:
AC05-76RL01830
OSTI ID:
2407018
Report Number(s):
PNNL-SA-188156
Country of Publication:
United States
Language:
English

Similar Records

Deep Reinforcement Learning Based Control of Wind Turbines for Fast Frequency Response
Journal Article · Mon May 26 20:00:00 EDT 2025 · IEEE Transactions on Industry Applications · OSTI ID:3008524

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration
Conference · Fri Jul 22 00:00:00 EDT 2022 · OSTI ID:1878557

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration: Preprint
Conference · Tue Feb 01 23:00:00 EST 2022 · OSTI ID:1844201

Related Subjects