Please use this identifier to cite or link to this item: http://hdl.handle.net/10397/32158
Title: Stochastic optimal relaxed automatic generation control in non-Markov environment based on multi-step Q(λ) learning
Authors: Yu, T
Zhou, B
Chan, KW 
Chen, L
Yang, B
Keywords: AGC
CPS
multi-step Q(λ) learning
non-Markov environment
relaxed control
stochastic optimization
Issue Date: 2011
Publisher: Institute of Electrical and Electronics Engineers
Source: IEEE transactions on power systems, 2011, v. 26, no. 3, 5706397, p. 1272-1282 How to cite?
Journal: IEEE transactions on power systems 
Abstract: This paper proposes a stochastic optimal relaxed control methodology based on reinforcement learning (RL) for solving the automatic generation control (AGC) under NERC's control performance standards (CPS). The multi-step Q(λ) learning algorithm is introduced to effectively tackle the long time-delay control loop for AGC thermal plants in non-Markov environment. The moving averages of CPS1/ACE are adopted as the state feedback input, and the CPS control and relaxed control objectives are formulated as multi-criteria reward function via linear weighted aggregate method. This optimal AGC strategy provides a customized platform for interactive self-learning rules to maximize the long-run discounted reward. Statistical experiments show that the RL theory based Q(λ) controllers can effectively enhance the robustness and dynamic performance of AGC systems, and reduce the number of pulses and pulse reversals while the CPS compliances are ensured. The novel AGC scheme also provides a convenient way of controlling the degree of CPS compliance and relaxation by online tuning relaxation factors to implement the desirable relaxed control.
URI: http://hdl.handle.net/10397/32158
ISSN: 0885-8950
EISSN: 1558-0679
DOI: 10.1109/TPWRS.2010.2102372
Appears in Collections:Journal/Magazine Article

Access
View full-text via PolyU eLinks SFX Query
Show full item record

SCOPUSTM   
Citations

36
Last Week
0
Last month
1
Citations as of Aug 11, 2017

WEB OF SCIENCETM
Citations

29
Last Week
0
Last month
1
Citations as of Aug 12, 2017

Page view(s)

40
Last Week
6
Last month
Checked on Aug 13, 2017

Google ScholarTM

Check

Altmetric



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.