• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Chen, J. (Chen, J..) [1] | Wang, J. (Wang, J..) [2] | Huang, J. (Huang, J..) [3]

Indexed by:

Scopus

Abstract:

In this paper, the Q-learning method for quadratic optimal control problem of discrete-time linear systems is reconsidered. The theoretical results prove that the quadratic optimal controller cannot be solved directly due to the linear correlation of the data sets. The following corollaries have been made: (1) The correlation of data is the key factor in the success for the calculation of quadratic optimal control laws by Q-learning method; (2) The control laws for linear systems cannot be derived directly by the existing Q-learning method; (3) For nonlinear systems, there are some doubts about the data independence of current method. Therefore, it is necessary to discuss the probability of the controllers established by the existing Q-learning method. To solve this problem, based on the ridge regression, an improved model-free Q-learning quadratic optimal control method for discrete-time linear systems is proposed in this paper. Therefore, the computation process can be implemented correctly, and the effective controller can be solved. The simulation results show that the proposed method can not only overcome the problem caused by the data correlation, but also derive proper control laws for discrete-time linear systems. © 2020 by the authors.

Keyword:

Least squares regression; Model-free control; Optimal control; Q-learning; Reinforcement learning; Ridge regression

Community:

  • [ 1 ] [Chen, J.]College of Electrical Engineering and Automation, Fuzhou University, Fuzhou, 350108, China
  • [ 2 ] [Wang, J.]College of Electrical Engineering and Automation, Fuzhou University, Fuzhou, 350108, China
  • [ 3 ] [Wang, J.]Fujian Key Laboratory of New Energy Generation and Power Conversion, Fuzhou, 350108, China
  • [ 4 ] [Huang, J.]College of Electrical Engineering and Automation, Fuzhou University, Fuzhou, 350108, China

Reprint 's Address:

  • [Huang, J.]College of Electrical Engineering and Automation, Fuzhou UniversityChina

Show more details

Related Keywords:

Related Article:

Source :

Processes

ISSN: 2227-9717

Year: 2020

Issue: 3

Volume: 8

2 . 8 4 7

JCR@2020

2 . 8 0 0

JCR@2023

ESI HC Threshold:160

JCR Journal Grade:3

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 1

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Affiliated Colleges:

Online/Total:79/10068555
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1