Please use this identifier to cite or link to this item:
http://hdl.handle.net/10397/93975
Title: | Hierarchical correlated Q-learning for multi-layer optimal generation command dispatch | Authors: | Yu, T Zhang, XS Zhou, B Chan, KW |
Issue Date: | Jun-2016 | Source: | International journal of electrical power and energy systems, June 2016, v. 78, p. 1-12 | Abstract: | This paper presents a novel hierarchical correlated Q-learning (HCEQ) algorithm to solve the dynamic optimization of generation command dispatch (GCD) in the Automatic Generation Control (AGC). The GCD problem is to dynamically allocate the total AGC generation command from the central to each individual AGC generator. The proposed HCEQ is a novel multi-agent Q-learning algorithm based on the concept of correlated equilibrium point, and each AGC generator with an agent is to optimize its regulation participation factor and coordinate its decision with others for the overall GCD performance enhancement. In order to cope with the curse of dimensionality in the GCD problem with the increased number of AGC plants involved, a multi-layer optimum GCD framework is developed in this paper. In this hierarchical framework, the multiobjective design and a time-varying coordination factor have been formulated into the reward functions to improve the optimization efficiency and convergence of HCEQ. The application of the proposed approach has been fully verified on the China southern power grid (CSG) model to demonstrate its superior performance and dynamic optimization capability in various power system scenarios. | Keywords: | Automatic generation control Control performance standards Correlated equilibrium Dynamic generation allocation Hierarchical multi-agent reinforcement learning |
Publisher: | Elsevier | Journal: | International journal of electrical power and energy systems | ISSN: | 0142-0615 | DOI: | 10.1016/j.ijepes.2015.11.057 | Rights: | © 2015 Elsevier Ltd. All rights reserved. © 2015. This manuscript version is made available under the CC-BY-NC-ND 4.0 license http://creativecommons.org/licenses/by-nc-nd/4.0/. The following publication Yu, T., Zhang, X. S., Zhou, B., & Chan, K. W. (2016). Hierarchical correlated Q-learning for multi-layer optimal generation command dispatch. International Journal of Electrical Power & Energy Systems, 78, 1-12 is available at https://doi.org/10.1016/j.ijepes.2015.11.057. |
Appears in Collections: | Journal/Magazine Article |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Chan_Hierarchical_Correlated_Q-Learning.pdf | Pre-Published version | 640.01 kB | Adobe PDF | View/Open |
Page views
45
Last Week
1
1
Last month
Citations as of Apr 28, 2024
Downloads
33
Citations as of Apr 28, 2024
SCOPUSTM
Citations
27
Citations as of May 3, 2024
WEB OF SCIENCETM
Citations
21
Citations as of May 2, 2024
Google ScholarTM
Check
Altmetric
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.