• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Chen, Jian (Chen, Jian.) [1] | Wang, Jinhua (Wang, Jinhua.) [2] (Scholars:王进华) | Huang, Jie (Huang, Jie.) [3] (Scholars:黄捷)

Indexed by:

Scopus SCIE

Abstract:

In this paper, the Q-learning method for quadratic optimal control problem of discrete-time linear systems is reconsidered. The theoretical results prove that the quadratic optimal controller cannot be solved directly due to the linear correlation of the data sets. The following corollaries have been made: (1) The correlation of data is the key factor in the success for the calculation of quadratic optimal control laws by Q-learning method; (2) The control laws for linear systems cannot be derived directly by the existing Q-learning method; (3) For nonlinear systems, there are some doubts about the data independence of current method. Therefore, it is necessary to discuss the probability of the controllers established by the existing Q-learning method. To solve this problem, based on the ridge regression, an improved model-free Q-learning quadratic optimal control method for discrete-time linear systems is proposed in this paper. Therefore, the computation process can be implemented correctly, and the effective controller can be solved. The simulation results show that the proposed method can not only overcome the problem caused by the data correlation, but also derive proper control laws for discrete-time linear systems.

Keyword:

least squares regression model-free control optimal control Q-learning reinforcement learning ridge regression

Community:

  • [ 1 ] [Chen, Jian]Fuzhou Univ, Coll Elect Engn & Automat, Fuzhou 350108, Peoples R China
  • [ 2 ] [Wang, Jinhua]Fuzhou Univ, Coll Elect Engn & Automat, Fuzhou 350108, Peoples R China
  • [ 3 ] [Huang, Jie]Fuzhou Univ, Coll Elect Engn & Automat, Fuzhou 350108, Peoples R China
  • [ 4 ] [Wang, Jinhua]Fujian Key Lab New Energy Generat & Power Convers, Fuzhou 350108, Peoples R China

Reprint 's Address:

  • 黄捷

    [Huang, Jie]Fuzhou Univ, Coll Elect Engn & Automat, Fuzhou 350108, Peoples R China

Show more details

Related Keywords:

Source :

PROCESSES

ISSN: 2227-9717

Year: 2020

Issue: 3

Volume: 8

2 . 8 4 7

JCR@2020

2 . 8 0 0

JCR@2023

ESI Discipline: CHEMISTRY;

ESI HC Threshold:160

JCR Journal Grade:3

Cited Count:

WoS CC Cited Count: 1

SCOPUS Cited Count: 1

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Online/Total:144/10067539
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1