Distributed reinforcement learning and consensus control of energy systems
Abstract
Disclosed herein are methods, systems, and devices for utilizing distributed reinforcement learning and consensus control to most effectively generate and utilize energy. In some embodiments, individual turbines within a wind farm may communicate to reach a consensus as to the desired yaw angle based on the wind conditions.
- Inventors:
- Issue Date:
- Research Org.:
- National Renewable Energy Laboratory (NREL), Golden, CO (United States)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 2222113
- Patent Number(s):
- 11725625
- Application Number:
- 17/264,967
- Assignee:
- Alliance for Sustainable Energy, LLC (Golden, CO)
- Patent Classifications (CPCs):
-
F - MECHANICAL ENGINEERING F03 - MACHINES OR ENGINES FOR LIQUIDS F03D - WIND MOTORS
F - MECHANICAL ENGINEERING F05 - INDEXING SCHEMES RELATING TO ENGINES OR PUMPS IN VARIOUS SUBCLASSES OF CLASSES F01-F04 F05B - INDEXING SCHEME RELATING TO MACHINES OR ENGINES OTHER THAN NON-POSITIVE-DISPLACEMENT MACHINES OR ENGINES, TO WIND MOTORS, TO NON-POSITIVE DISPLACEMENT PUMPS, AND TO GENERATING COMBUSTION PRODUCTS OF HIGH PRESSURE OR HIGH VELOCITY
- DOE Contract Number:
- AC36-08GO28308
- Resource Type:
- Patent
- Resource Relation:
- Patent File Date: 07/31/2019
- Country of Publication:
- United States
- Language:
- English
Citation Formats
King, Jennifer Rose Rose, Fleming, Paul Aaron, Dall'Anese, Emiliano, Bay, Christopher Joseph, and Graf, Peter Andrew. Distributed reinforcement learning and consensus control of energy systems. United States: N. p., 2023.
Web.
King, Jennifer Rose Rose, Fleming, Paul Aaron, Dall'Anese, Emiliano, Bay, Christopher Joseph, & Graf, Peter Andrew. Distributed reinforcement learning and consensus control of energy systems. United States.
King, Jennifer Rose Rose, Fleming, Paul Aaron, Dall'Anese, Emiliano, Bay, Christopher Joseph, and Graf, Peter Andrew. Tue .
"Distributed reinforcement learning and consensus control of energy systems". United States. https://www.osti.gov/servlets/purl/2222113.
@article{osti_2222113,
title = {Distributed reinforcement learning and consensus control of energy systems},
author = {King, Jennifer Rose Rose and Fleming, Paul Aaron and Dall'Anese, Emiliano and Bay, Christopher Joseph and Graf, Peter Andrew},
abstractNote = {Disclosed herein are methods, systems, and devices for utilizing distributed reinforcement learning and consensus control to most effectively generate and utilize energy. In some embodiments, individual turbines within a wind farm may communicate to reach a consensus as to the desired yaw angle based on the wind conditions.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {2023},
month = {8}
}
Works referenced in this record:
Distributed hierarchical control architecture for integrating smart grid assets during normal and disrupted operations
patent, September 2017
- Kalsi, Karan; Fuller, Jason C.; Somani, Abhishek
- US Patent Document 9,762,060
A distributed consensus control under disturbances for wind farm power maximization
conference, December 2017
- Gionfra, N.; Sandou, G.; Siguerdidjane, H.
- 2017 IEEE 56th Annual Conference on Decision and Control (CDC)
Flexible control architecture for microgrid resiliency
patent, October 2018
- Srivastava, Sanjeev; Suresh, Sindhu; Bruschi, Paul J.
- US Patent Document 10,116,164
Real time voltage regulation through gather and broadcast techniques
patent, December 2018
- Dall'Anese, Emiliano; Simonetto, Andrea; Dhople, Sairaj Vijaykumar
- US Patent Document 10,148,092
Control systems for microgrid power inverter and methods thereof
patent, May 2018
- Holveck, Mark; Kocherov, Yevgeniy
- US Patent Document 9,964,978
Decentralized optimal dispatch of photovoltaic inverters in power distribution systems
patent, November 2018
- Dhople, Sairaj Vijaykumar; Giannakis, Georgios B.; Dall'Anese, Emiliano
- US Patent Document 10,139,800
A fully decentralized control of grid-connected cascaded inverters
journal, January 2019
- Hou, Xiaochao; Sun, Yao; Han, Hua
- IEEE Transactions on Sustainable Energy, Vol. 10, Issue 1
Dynamic Distribution Power Grid Control System
patent-application, February 2012
- Cherian, Sunil; Kley, Holger; Pacific, Oliver
- US Patent Application 13/099,326; 2012/0029720
Consensus Control for Energy Storage Systems
journal, July 2018
- Khazaei, Javad; Miao, Zhixin
- IEEE Transactions on Smart Grid, Vol. 9, Issue 4
Use of Blockchain Based Distributed Consensus Control
patent-application, April 2017
- Orsini, Lawrence; Wei, Yun; Lubin, Joseph
- US Patent Application 15/292783; 20170103468
Resonant wave energy harvester based on dielectric elastomer generator
journal, February 2018
- Moretti, Giacomo; Papini, Gastone Pietro Rosati; Righi, Michele
- Smart Materials and Structures, Vol. 27, Issue 3
Peer-to-peer relay network with decentralized control
patent, March 2013
- Van Datta, Glen; Mai, Anthony
- US Patent Document 8,396,984
Method for controlling a wind turbine, and wind turbine arrangement
patent, September 2012
- Loh, Friedrich; Scholte-Wassink, Hartmut; Hoffmann, Till
- US Patent Document 8,267,655
Data-Driven Decentralized Algorithm for Wind Farm Control with Population-Games Assistance
journal, March 2019
- Barreiro-Gomez, Julian; Ocampo-Martinez, Carlos; Bianchi, Fernando
- Energies, Vol. 12, Issue 6
Distributed grid-interactive photovoltaic-based power dispatching
patent, January 2013
- Haugh, Julianne Frances
- US Patent Document 8,352,091
Consensus-based distributed cooperative control for microgrid voltage regulation and reactive power sharing
patent, January 2018
- He, Dawei; Sharma, Ratnesh; Shi, Di
- US Patent Document 9,882,386
Managing coordinated control by multiple decision modules
patent, September 2018
- Kohn, Wolf; Sandoval, Michael; Vettrivel, Vishnu
- US Patent Document 10,082,778
Wind farm layout design optimization through multi-scenario decomposition with complementarity constraints
journal, January 2014
- Lu, Shen; Kim, Harrison M.
- Engineering Optimization, Vol. 46, Issue 12
Wind direction estimation using SCADA data with consensus-based optimization
journal, January 2019
- Annoni, Jennifer; Bay, Christopher; Johnson, Kathryn
- Wind Energy Science, Vol. 4, Issue 2
Hierarchal Framework for Integrating Distributed Energy Resources into Distribution Systems
patent-application, January 2019
- Lian, Jianming; Kalsi, Karanjit; Wu, Di
- US Patent Application 16/035377; 20190020220
Consensus-based power control apparatus
patent, February 2018
- Chu, Chia-Chi; Lu, Lin
- US Patent Document 9,906,033
Computerized system and method for distributed energy resource scheduling
patent, June 2016
- Pande, Shashank; Dromey, Ian Robert
- US Patent Document 9,373,960