Damping inter-area oscillation using reinforcement learning controlled TCSC

Huang, Renke; Gao, Wei; Fan, Rui; Huang, Qiuhua

doi:10.1049/gtd2.12441

Damping inter-area oscillation using reinforcement learning controlled TCSC

Journal Article · Sat Mar 12 23:00:00 EST 2022 · IET Generation, Transmission, & Distribution

DOI:https://doi.org/10.1049/gtd2.12441· OSTI ID:2447152

Huang, Renke ^[1]; Gao, Wei ^[2]; ^[2]; Huang, Qiuhua ^[1]

Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)
Univ. of Colorado, Denver, CO (United States)

Appropriate damping control of the inter-area oscillation would ensure the grid stability and maintain the tie-line power transfer capability. In this paper, we proposed a novel reinforcement learning (RL) based power oscillation damping (POD) controller that uses Thyristor Controlled Series Compensators (TCSC) to damp inter-area oscillations. By leveraging the unbiased gradient direction estimation of the natural evolution strategy (NES), we successfully regulated the power flows on the tie-lines and damped inter-area oscillations through dynamically modulating the inserted reactance of the TCSC. The proposed RL-based POD controller has been tested on both two-area four-machine system and North American Minni-WECC system. Extensive studies have demonstrated the excellent performance of the proposed RL-based TCSC POD controller in damping inter-area oscillations.

View Accepted Manuscript (DOE)

Research Organization:: Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)

Sponsoring Organization:: USDOE Office of Electricity (OE)

Grant/Contract Number:: AC05-76RL01830

OSTI ID:: 2447152

Report Number(s):: PNNL-SA--171507

Journal Information:: IET Generation, Transmission, & Distribution, Journal Name: IET Generation, Transmission, & Distribution Journal Issue: 11 Vol. 16; ISSN 1751-8687

Publisher:: Institution of Engineering and Technology (IET)Copyright Statement

Country of Publication:: United States

Language:: English

References (26)

Advanced Power Applications for System Reliability Monitoring Zhang, Hongming; Kincic, Slaven; Edwards, Sherrill Power Systems https://doi.org/10.1007/978-3-030-44544-7	book	January 2021
Nonlinear controller design of thyristor controlled series compensation for damping inter-area power oscillation Li, X. Y. Electric Power Systems Research, Vol. 76, Issue 12 https://doi.org/10.1016/j.epsr.2005.12.025	journal	August 2006
Wide-area measurement-based modal decoupling for power system oscillation damping Fan, Rui; Wang, Shaobu; Huang, Renke Electric Power Systems Research, Vol. 178 https://doi.org/10.1016/j.epsr.2019.106022	journal	January 2020
Design and Implementation of a Wide-Area Damping Controller Using High Voltage DC Modulation and Synchrophasor Feedback * The authors gratefully acknowledge financial support for this project from the Bonneville Power Administration (BPA) Office of Technology Innovation and the U.S. Department of Energy Office of Electricity (DOE/OE) Transmission Reliability and Energy Storage programs. * **Sandia National Laboratories is a multi-mission laboratory managed & operated by Sandia Corporation, a wholly owned subsidiary of Lockheed Martin Corporation, for the US Department of Energy National Nuclear Security Administration, under contract DE-AC04-94AL85000. SAND2016-11534 C Schoenwald, David A.; Pierre, Brian J.; Wilches-Bernal, Felipe IFAC-PapersOnLine, Vol. 50, Issue 1 https://doi.org/10.1016/j.ifacol.2017.08.012	journal	July 2017
Effective oscillation damping of an interconnected multi-source power system with automatic generation control and TCSC Zare, Kazem; Hagh, Mehrdad Tarafdar; Morsali, Javad International Journal of Electrical Power & Energy Systems, Vol. 65 https://doi.org/10.1016/j.ijepes.2014.10.009	journal	February 2015
Robust signal selection for damping of inter-area oscillations Kunjumuhammed, L. P.; Singh, R.; Pal, B. C. IET Generation, Transmission & Distribution, Vol. 6, Issue 5 https://doi.org/10.1049/iet-gtd.2011.0670	journal	May 2012
Power system stabiliser and flexible alternating current transmission systems controller coordinated design using adaptive velocity update relaxation particle swarm optimisation algorithm in multi‐machine power system Shahgholian, Ghazanfar; Movahedi, Amir IET Generation, Transmission & Distribution, Vol. 10, Issue 8 https://doi.org/10.1049/iet-gtd.2015.1002	journal	May 2016
Risk‐based placement of TCSC for transient stability enhancement Abapour, Mehdi; Aliasghari, Parinaz; Haghifam, Mahmoud‐Reza IET Generation, Transmission & Distribution, Vol. 10, Issue 13 https://doi.org/10.1049/iet-gtd.2016.0170	journal	October 2016
Modelling and control of thyristor-controlled series compensators Ghosh, A. IEE Proceedings - Generation, Transmission and Distribution, Vol. 142, Issue 3 https://doi.org/10.1049/ip-gtd:19951742	journal	January 1995
A toolbox for power system dynamics and control engineering education and research Chow, J. H.; Cheung, K. W. IEEE Transactions on Power Systems, Vol. 7, Issue 4 https://doi.org/10.1109/59.207380	journal	January 1992
TCSC controller design for damping interarea oscillations Yang, N.; Liu, Q.; McCalley, J. D. IEEE Transactions on Power Systems, Vol. 13, Issue 4 https://doi.org/10.1109/59.736269	journal	January 1998
The application of TCSC for damping inter-area oscillations Liu, Jingli; Ding, Lei; Cai, Deyu 2015 IEEE PES Asia-Pacific Power and Energy Engineering Conference (APPEEC) https://doi.org/10.1109/APPEEC.2015.7381060	conference	November 2015
Damping inter-area oscillation in power system by using global control signals based on PSS devices Ranjbar, Soheil; Aghamohammadi, Mohammad Reza; Haghjoo, Farhad 2017 Iranian Conference on Electrical Engineering (ICEE) https://doi.org/10.1109/IranianCEE.2017.7985248	conference	May 2017
Oscillation Damping Control Using Multiple High Voltage DC Transmission Lines: Controllability Exploration Fan, Rui; Elizondo, Marcelo A.; Kirkham, Harold 2018 IEEE/PES Transmission and Distribution Conference and Exposition (T&D) https://doi.org/10.1109/TDC.2018.8440281	conference	April 2018
Rényi Divergence and Kullback-Leibler Divergence van Erven, Tim; Harremoes, Peter IEEE Transactions on Information Theory, Vol. 60, Issue 7 https://doi.org/10.1109/TIT.2014.2320500	journal	July 2014
A Novel Modal Decomposition Control and Its Application to PSS Design for Damping Interarea Oscillations in Power Systems Zhang, Junbo; Chung, C. Y.; Han, Yingduo IEEE Transactions on Power Systems, Vol. 27, Issue 4 https://doi.org/10.1109/TPWRS.2012.2188820	journal	November 2012
Loop Shaping of a Wide-Area Damping Controller Using HVDC Roberson, Dakota; O'Brien, John F. IEEE Transactions on Power Systems, Vol. 32, Issue 3 https://doi.org/10.1109/TPWRS.2016.2608356	journal	May 2017
Interarea Oscillation Damping Control Using High-Voltage DC Transmission: A Survey Elizondo, Marcelo A.; Fan, Rui; Kirkham, Harold IEEE Transactions on Power Systems, Vol. 33, Issue 6 https://doi.org/10.1109/TPWRS.2018.2832227	journal	November 2018
Wide-Area Damping Control of Power Systems Using Dynamic Clustering and TCSC-Based Redesigns Chakrabortty, Aranya IEEE Transactions on Smart Grid, Vol. 3, Issue 3 https://doi.org/10.1109/TSG.2012.2197029	journal	September 2012
Adaptive Power System Emergency Control Using Deep Reinforcement Learning Huang, Qiuhua; Huang, Renke; Hao, Weituo IEEE Transactions on Smart Grid, Vol. 11, Issue 2 https://doi.org/10.1109/TSG.2019.2933191	journal	March 2020
Deep Reinforcement Learning-Based Approach for Proportional Resonance Power System Stabilizer to Prevent Ultra-Low-Frequency Oscillations Zhang, Guozhou; Hu, Weihao; Cao, Di IEEE Transactions on Smart Grid, Vol. 11, Issue 6 https://doi.org/10.1109/TSG.2020.2997790	journal	November 2020
Wide-Area Measurement System-Based Low Frequency Oscillation Damping Control Through Reinforcement Learning Hashmy, Yousuf; Yu, Zhe; Shi, Di IEEE Transactions on Smart Grid, Vol. 11, Issue 6 https://doi.org/10.1109/TSG.2020.3008364	journal	November 2020
Exponential natural evolution strategies Glasmachers, Tobias; Schaul, Tom; Yi, Sun Proceedings of the 12th annual conference on Genetic and evolutionary computation - GECCO '10 https://doi.org/10.1145/1830483.1830557	conference	January 2010
Temporal difference learning and TD-Gammon Tesauro, Gerald Communications of the ACM, Vol. 38, Issue 3 https://doi.org/10.1145/203330.203343	journal	March 1995
Natural Gradient Learning for Over- and Under-Complete Bases in ICA Amari, Shun-ichi Neural Computation, Vol. 11, Issue 8 https://doi.org/10.1162/089976699300015990	journal	November 1999
Reinforcement Learning and Its Applications in Modern Power and Energy Systems: A Review Cao, Di; Hu, Weihao; Zhao, Junbo Journal of Modern Power Systems and Clean Energy, Vol. 8, Issue 6 https://doi.org/10.35833/MPCE.2020.000552	journal	January 2020

Similar Records

Wide-Area Measurement-Based Modal Decoupling for Power System Oscillation Damping

Journal Article · Tue Dec 31 23:00:00 EST 2019 · Electric Power Systems Research · OSTI ID:1569041

A study of TCSC optimal damping control parameters for different operating conditions

Journal Article · Tue Oct 31 23:00:00 EST 1995 · IEEE Transactions on Power Systems · OSTI ID:160614

A Localized Cyber Threat Mitigation Approach For Wide Area Control of FACTS

Conference · Mon Oct 25 00:00:00 EDT 2021 · 2021 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm) · OSTI ID:2223078

Related Subjects

24 POWER TRANSMISSION AND DISTRIBUTION

Damping inter-area oscillation using reinforcement learning controlled TCSC

Citation Formats

References (26)

Similar Records

Related Subjects