Adaptive dynamic programming-based decentralised control for large-scale nonlinear systems subject to mismatched interconnections with unknown time-delay

This paper addresses decentralised optimal control problems for large-scale nonlinear systems subject to mismatched interconnections with unknown time-delay by adaptive dynamic programming. To eliminate the effects of mismatched interconnections with unknown time-delay, a novel local value function...

Full description

Saved in:
Bibliographic Details
Published inInternational journal of systems science Vol. 51; no. 15; pp. 2883 - 2898
Main Authors Wu, Qiuye, Zhao, Bo, Liu, Derong
Format Journal Article
LanguageEnglish
Published London Taylor & Francis 17.11.2020
Taylor & Francis Ltd
Subjects
Adaptive control
Adaptive dynamic programming
decentralised control
Decentralized control
Delay
Dynamic programming
Interconnections
Iterative algorithms
large-scale nonlinear systems
Nonlinear control
Nonlinear systems
Optimal control
reinforcement learning
Robust control
unknown mismatched interconnection
unknown time-delay
Online AccessGet full text

Cover

Abstract This paper addresses decentralised optimal control problems for large-scale nonlinear systems subject to mismatched interconnections with unknown time-delay by adaptive dynamic programming. To eliminate the effects of mismatched interconnections with unknown time-delay, a novel local value function is constructed to transform the decentralised control problem into an optimal control problem. A local robust observer is established to identify the bound of the unknown interconnections. Then, based on the observer-critic architecture, the decentralised optimal control policy is achieved by solving local Hamiltonian-Jacobi-Bellman equation via local policy iteration algorithm. The stability of the closed-loop large-scale nonlinear system is guaranteed to be uniformly ultimately bounded by implementing a set of decentralised control policies. Simulation examples demonstrate the effectiveness of the proposed scheme.
AbstractList This paper addresses decentralised optimal control problems for large-scale nonlinear systems subject to mismatched interconnections with unknown time-delay by adaptive dynamic programming. To eliminate the effects of mismatched interconnections with unknown time-delay, a novel local value function is constructed to transform the decentralised control problem into an optimal control problem. A local robust observer is established to identify the bound of the unknown interconnections. Then, based on the observer-critic architecture, the decentralised optimal control policy is achieved by solving local Hamiltonian–Jacobi–Bellman equation via local policy iteration algorithm. The stability of the closed-loop large-scale nonlinear system is guaranteed to be uniformly ultimately bounded by implementing a set of decentralised control policies. Simulation examples demonstrate the effectiveness of the proposed scheme.
Author Wu, Qiuye
Zhao, Bo
Liu, Derong
Author_xml – sequence: 1
  givenname: Qiuye
  surname: Wu
  fullname: Wu, Qiuye
  organization: School of Automation, Guangdong University of Technology
– sequence: 2
  givenname: Bo
  surname: Zhao
  fullname: Zhao, Bo
  email: zhaobo@bnu.edn.cn
  organization: School of Systems Science, Beijing Normal University
– sequence: 3
  givenname: Derong
  surname: Liu
  fullname: Liu, Derong
  organization: School of Automation, Guangdong University of Technology
BookMark eNqFUcuO1DAQtNAiMbvwCUiWOGfwI54k4sJqxQLSSlzgbHWczqwHPwbbwyifwt_iaJYLBzh1t1xV7eq6JlchBiTkNWdbznr2ljHBuk7wrajNlvdMtnJ4Rja83bWNkny4IpsV06ygF-Q65wNjTCnBNuTX7QTHYn8inZYA3hp6THGfwHsb9s0IGSc6ocFQEji7TibWPjo6x0QdpD022YBDWj_lbEBINC-5oM80n8YDmkJLpN5mD8U8Vr4NBVMVCfXJxpDp2ZZHegrfQzwHWqzHZkIHy0vyfAaX8dVTvSHf7j98vfvUPHz5-Pnu9qExUvalGWdmZi7HeZDdNHcoezHM2A4chIIB2l6NfCe5nDhKI0AMgisUowAA1ldj8oa8uehW4z9OmIs-xFMKdaUWrVJd16pdW1HqgjIp5pxw1sdkPaRFc6bXFPSfFPSagn5KofLe_cUztsBqvB7Uuv-y31_YNtRzezjH5CZdYHExzQmCsVnLf0v8BsNlpxE
CitedBy_id crossref_primary_10_1080_00207721_2024_2312886
crossref_primary_10_1080_00207721_2022_2111236
crossref_primary_10_1016_j_neunet_2020_09_020
crossref_primary_10_1016_j_neucom_2021_06_014
crossref_primary_10_1016_j_isatra_2022_01_002
crossref_primary_10_1007_s11071_022_07624_y
crossref_primary_10_1016_j_chaos_2022_113034
crossref_primary_10_1049_cth2_12785
crossref_primary_10_1080_00207721_2021_1987578
crossref_primary_10_1109_TSMC_2024_3388530
crossref_primary_10_1109_TSMC_2020_3042876
crossref_primary_10_1109_TNNLS_2023_3245102
Cites_doi 10.1080/00207721.2016.1277408
10.1080/00207179.2013.848292
10.1109/JAS.2017.7510739
10.1109/TFUZZ.2020.2967295
10.1109/TNN.2011.2172628
10.1007/s10462-017-9603-1
10.1016/j.automatica.2008.08.017
10.1016/j.jmaa.2006.03.092
10.1109/TSMCC.2011.2161577
10.1109/TFUZZ.2017.2686373
10.1109/TSMCC.2003.819704
10.1109/TAC.2002.800773
10.1109/CDC.1995.478953
10.1613/jair.301
10.1109/TSMC.2015.2470635
10.1016/j.jfranklin.2018.12.008
10.1109/TSMCB.2008.926614
10.1080/00207721.2015.1029569
10.1109/TCYB.2017.2692384
10.1109/TFUZZ.2017.2787128
10.1016/j.jfranklin.2015.01.033
10.1109/JAS.2016.7510262
10.1109/TNNLS.2017.2749641
10.1016/j.ins.2011.10.004
10.1109/TSMCB.2009.2021950
10.1016/0005-1098(85)90076-7
10.1016/j.neucom.2013.12.038
10.1109/TSMC.2013.2295351
10.1109/TSMC.2015.2492941
10.1109/TSMC.2017.2690665
10.1109/72.623201
10.1007/s10462-017-9548-4
10.1109/TNNLS.2017.2693205
10.1007/978-3-319-50815-3
10.1049/iet-cta.2016.1383
10.1016/j.neucom.2014.12.066
10.1002/9781118122631
10.1080/00207179.2017.1372634
10.1007/s12555-013-0155-0
10.1109/TNNLS.2013.2280013
10.1016/j.automatica.2015.01.041
10.1109/TNNLS.2018.2869896
10.1016/j.ins.2016.12.016
ContentType Journal Article
Copyright 2020 Informa UK Limited, trading as Taylor & Francis Group 2020
2020 Informa UK Limited, trading as Taylor & Francis Group
Copyright_xml – notice: 2020 Informa UK Limited, trading as Taylor & Francis Group 2020
– notice: 2020 Informa UK Limited, trading as Taylor & Francis Group
DBID AAYXX
CITATION
7SC
8FD
JQ2
L7M
L~C
L~D
DOI 10.1080/00207721.2020.1803439
DatabaseName CrossRef
Computer and Information Systems Abstracts
Technology Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle CrossRef
Computer and Information Systems Abstracts
Technology Research Database
Computer and Information Systems Abstracts – Academic
Advanced Technologies Database with Aerospace
ProQuest Computer Science Collection
Computer and Information Systems Abstracts Professional
DatabaseTitleList Computer and Information Systems Abstracts
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 1464-5319
EndPage 2898
ExternalDocumentID 10_1080_00207721_2020_1803439
1803439
Genre Research Article
GroupedDBID -~X
.7F
.DC
.QJ
0BK
0R~
29J
30N
4.4
5GY
5VS
8VB
AAENE
AAJMT
AALDU
AAMIU
AAPUL
AAQRR
ABCCY
ABFIM
ABHAV
ABJNI
ABLIJ
ABPAQ
ABPEM
ABTAI
ABXUL
ABXYU
ACGEJ
ACGFS
ACNCT
ACTIO
ADCVX
ADGTB
ADXPE
AEISY
AENEX
AEOZL
AEPSL
AEYOC
AFKVX
AGDLA
AGMYJ
AHDZW
AIJEM
AJWEG
AKBVH
AKOOK
ALMA_UNASSIGNED_HOLDINGS
ALQZU
AQRUH
AVBZW
AWYRJ
BLEHA
CCCUG
CE4
CS3
DGEBU
DKSSO
DU5
EBS
E~A
E~B
F5P
GTTXZ
H13
HF~
HZ~
H~P
IPNFZ
J.P
KYCEM
LJTGL
M4Z
MS~
NA5
NX~
O9-
P2P
QWB
RIG
RNANH
ROSJB
RTWRZ
S-T
SNACF
TBQAZ
TDBHL
TEN
TFL
TFT
TFW
TNC
TTHFI
TUROJ
TWF
UT5
UU3
ZGOLN
ZL0
~02
~S~
AAGDL
AAHIA
AAYXX
ADYSH
AFRVT
AIYEW
AMPGV
CITATION
7SC
8FD
JQ2
L7M
L~C
L~D
TASJS
ID FETCH-LOGICAL-c338t-bf0cf13bf937df7e3829fe491a25a9a485b16313d1e3c2a29215e2b2aaa08ece3
ISSN 0020-7721
IngestDate Fri Jul 25 06:08:10 EDT 2025
Tue Jul 01 01:02:47 EDT 2025
Thu Apr 24 23:03:43 EDT 2025
Wed Dec 25 09:08:12 EST 2024
IsPeerReviewed true
IsScholarly true
Issue 15
Language English
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-c338t-bf0cf13bf937df7e3829fe491a25a9a485b16313d1e3c2a29215e2b2aaa08ece3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
PQID 2455774564
PQPubID 2045514
PageCount 16
ParticipantIDs informaworld_taylorfrancis_310_1080_00207721_2020_1803439
proquest_journals_2455774564
crossref_primary_10_1080_00207721_2020_1803439
crossref_citationtrail_10_1080_00207721_2020_1803439
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2020-11-17
PublicationDateYYYYMMDD 2020-11-17
PublicationDate_xml – month: 11
  year: 2020
  text: 2020-11-17
  day: 17
PublicationDecade 2020
PublicationPlace London
PublicationPlace_xml – name: London
PublicationTitle International journal of systems science
PublicationYear 2020
Publisher Taylor & Francis
Taylor & Francis Ltd
Publisher_xml – name: Taylor & Francis
– name: Taylor & Francis Ltd
References CIT0030
CIT0010
CIT0032
CIT0031
CIT0012
CIT0034
Zhao B. (CIT0044) 2019
CIT0011
CIT0014
CIT0036
Jiang Y. (CIT0004) 2012; 59
CIT0013
CIT0035
CIT0016
CIT0038
CIT0015
CIT0037
CIT0018
CIT0017
CIT0039
CIT0019
CIT0041
CIT0040
CIT0021
CIT0043
CIT0020
CIT0042
CIT0001
CIT0023
CIT0045
CIT0022
Werbos P. (CIT0033) 1992; 15
CIT0003
Khalil H. K. (CIT0007) 2002
CIT0025
CIT0047
CIT0002
CIT0024
CIT0046
CIT0005
CIT0027
CIT0026
CIT0048
CIT0029
CIT0006
CIT0028
CIT0009
CIT0008
References_xml – ident: CIT0016
  doi: 10.1080/00207721.2016.1277408
– volume: 59
  start-page: 693
  issue: 10
  year: 2012
  ident: CIT0004
  publication-title: IEEE Transactions on Circuits and Systems
– volume: 15
  start-page: 493
  year: 1992
  ident: CIT0033
  publication-title: Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches
– ident: CIT0036
  doi: 10.1080/00207179.2013.848292
– ident: CIT0014
  doi: 10.1109/JAS.2017.7510739
– ident: CIT0023
  doi: 10.1109/TFUZZ.2020.2967295
– ident: CIT0041
  doi: 10.1109/TNN.2011.2172628
– ident: CIT0005
  doi: 10.1007/s10462-017-9603-1
– ident: CIT0027
  doi: 10.1016/j.automatica.2008.08.017
– ident: CIT0034
  doi: 10.1016/j.jmaa.2006.03.092
– ident: CIT0043
  doi: 10.1109/TSMCC.2011.2161577
– ident: CIT0026
  doi: 10.1109/TFUZZ.2017.2686373
– ident: CIT0038
  doi: 10.1109/TSMCC.2003.819704
– ident: CIT0010
  doi: 10.1109/TAC.2002.800773
– ident: CIT0002
  doi: 10.1109/CDC.1995.478953
– ident: CIT0006
  doi: 10.1613/jair.301
– ident: CIT0015
  doi: 10.1109/TSMC.2015.2470635
– ident: CIT0020
  doi: 10.1016/j.jfranklin.2018.12.008
– ident: CIT0001
  doi: 10.1109/TSMCB.2008.926614
– ident: CIT0035
  doi: 10.1080/00207721.2015.1029569
– ident: CIT0025
  doi: 10.1109/TCYB.2017.2692384
– ident: CIT0009
  doi: 10.1109/TFUZZ.2017.2787128
– ident: CIT0047
  doi: 10.1016/j.jfranklin.2015.01.033
– ident: CIT0032
  doi: 10.1109/JAS.2016.7510262
– ident: CIT0030
  doi: 10.1109/TNNLS.2017.2749641
– ident: CIT0039
  doi: 10.1016/j.ins.2011.10.004
– ident: CIT0037
  doi: 10.1109/TSMCB.2009.2021950
– ident: CIT0003
  doi: 10.1016/0005-1098(85)90076-7
– ident: CIT0042
  doi: 10.1016/j.neucom.2013.12.038
– ident: CIT0011
  doi: 10.1109/TSMC.2013.2295351
– ident: CIT0031
  doi: 10.1109/TSMC.2015.2492941
– ident: CIT0046
  doi: 10.1109/TSMC.2017.2690665
– ident: CIT0019
  doi: 10.1109/72.623201
– ident: CIT0048
  doi: 10.1007/s10462-017-9548-4
– ident: CIT0017
  doi: 10.1109/TNNLS.2017.2693205
– ident: CIT0013
  doi: 10.1007/978-3-319-50815-3
– ident: CIT0028
  doi: 10.1049/iet-cta.2016.1383
– ident: CIT0024
  doi: 10.1109/TFUZZ.2020.2967295
– ident: CIT0022
  doi: 10.1016/j.neucom.2014.12.066
– year: 2019
  ident: CIT0044
  publication-title: IEEE Transactions on Industrial Electronics
– ident: CIT0008
  doi: 10.1002/9781118122631
– volume-title: Nonlinear systems
  year: 2002
  ident: CIT0007
– ident: CIT0040
  doi: 10.1080/00207179.2017.1372634
– ident: CIT0021
  doi: 10.1007/s12555-013-0155-0
– ident: CIT0012
  doi: 10.1109/TNNLS.2013.2280013
– ident: CIT0029
  doi: 10.1016/j.automatica.2015.01.041
– ident: CIT0018
  doi: 10.1109/TNNLS.2018.2869896
– ident: CIT0045
  doi: 10.1016/j.ins.2016.12.016
SSID ssj0005520
Score 2.3342626
Snippet This paper addresses decentralised optimal control problems for large-scale nonlinear systems subject to mismatched interconnections with unknown time-delay by...
SourceID proquest
crossref
informaworld
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 2883
SubjectTerms Adaptive control
Adaptive dynamic programming
decentralised control
Decentralized control
Delay
Dynamic programming
Interconnections
Iterative algorithms
large-scale nonlinear systems
Nonlinear control
Nonlinear systems
Optimal control
reinforcement learning
Robust control
unknown mismatched interconnection
unknown time-delay
Title Adaptive dynamic programming-based decentralised control for large-scale nonlinear systems subject to mismatched interconnections with unknown time-delay
URI https://www.tandfonline.com/doi/abs/10.1080/00207721.2020.1803439
https://www.proquest.com/docview/2455774564
Volume 51
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV3LitswFBVpZtMuSp902mnRorugYEuybC_TF6HQQiFDh9kYyZJoYJoMib2Y-ZP5iv5iryzZsSeB6WNjEsUPJef43ivl-Aiht0rmJhfcEiaMIFzqlMiYSmKVtYbbVKpmoPjlq5if8s9nydlo9KunWqorNS2vDz5X8i-oQhvg6p6S_Qtku5NCA7wGfGELCMP2jzCeaXnZSH-0X1e-VVv9hHxEXH7SE22C_HLp3rXCdKctvHAacLIFjMxk5Q0zZOvsvJ1sa-VmaFxpCkyAshbA1Y25xKZ02pjSK-iaadx65WbmVs069cS5Tg7-Kh7OOfacKrpL-fDSpYfawf5tWV91Tec_ZDOj-27d6YeWtY-Wm3VIvWHmAoapTj2Xdlxb7C0i0g_UsDsU_p52xsdmLjhxIaMfvINbbSBp0g_FmV8hJ6R1GFhmB1NGq7Gkkbve1HV0GmcR495k6ZYbd_jkHjqisDsdo6PZ_MP5952qKAlOoKH_7UNjzs790CUG5dDALHevOGgqnsUj9DAMVfDM8-4xGpnVE_SgZ2D5FN20DMSBgXiPgXjAQBwYiKEHuMdA3DEQB1rgwEBcrfGOgfg2A7FjIA4MxDsGPkOnnz4u3s9JWOyDlIxlFVE2Km3MlIV6WdvUsIzmEC3yWNJE5pJniYKhQ8x0bFhJJc2hVjVUUSlllMEXYc_RGLpqXiDMmRCUQuK0KuaRZiqWBvKYyJLSCk3TY8Tb37wogxO-W5Dloog7w1wPVeGgKgJUx2jaHXbprWDuOiDvA1pUDeGt53rB7jj2pEW_CHfmtqA8SWC4lgj-8j9O_Qrd392NJ2hcbWrzGirrSr0JbP4NuFzRTw
linkProvider Library Specific Holdings
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1LT9wwELYoHNoeCvQhaCn40KtXiV9JjqgqWgrsCSRulh3bEips0SZ7oP-k_7YzsQNLq4oDxyQay3bG45nRN98Q8sXZJjRaRiZ00ExaXzFbcsuiizHIWFk3BIpnMz29kN8v1eVKLQzCKjGGjokoYrDVeLgxGT1C4rCEuwCvEMM7Dq_qQsC1-oJsqEZX2MVAFLMHmIfK1IwQJqHMWMXzv2Ee3U-P2Ev_sdbDFXS0Sdpx8gl58mOy7N2k_fUXr-PzVrdF3mQPlR4mldoma2H-lrxe4S18R34fenuLdpL61NCeZpjXDXxmeDF66kPGfV7hU0bEU1gnvUbwOetAOQKdpynaBU2U0h3tlg5TQ7T_SUEFwZ8GrfIUWS0WLYJyhjqMjmL-mC7nmBKc0_7qJjCku7x7Ty6Ovp1_nbLc44G1EBz3zMWijaVwEdwkH6sgat6AkjSl5co2VtbKgcdYCl8G0XLLG3BRAnfcWlvUsBDxgazDVMMOoVJozTnYy-ggavTClTaA-dK1aqP2vNolcvyzps0E6NiH49qU9zypaecN7rzJO79LJvdit4kB5CmBZlVtTD-kXmLqk2LEE7J7o46ZbEw6w6VS4KUrLT8-Y-gD8nJ6fnZqTo9nJ5_IK_yENZVltUfW-8UyfAbnqnf7w-n5A1dxGWc
linkToPdf http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV3BTtwwELVakFA5tBRaQbsUH7h6ldiOkxxX0BWl7YpDkbhZdmxLqLBdbbIH-JP-bWdih0JRxYFjEo1lO-PxzOjNG0IOral9rWRgQnnFpHElMzk3LNgQvAylsX2g-H2mTs7l6UUxoAnbBKvEGDpEoojeVuPhXrgwIOKwgjsDpxCjOw6vqkzArfqSrCskD8cqjmz2F-VRJGZGiJJQZiji-d8wD66nB-Slj4x1fwNN3xA7zD0CT36OV50dN7f_0Do-a3Fb5HXyT-kkKtRb8sLPt8nmPdbCHfJ74swCrSR1sZ09TSCva_jM8Fp01PmE-rzEp4SHp7BMeoXQc9aCang6jzM0SxoJpVvariwmhmj3i4ICgjcNOuUoclosG4Tk9FUYLcXsMV3NMSE4p93ltWdIdnnzjpxPP_84OmGpwwNrIDTumA1ZE3JhAzhJLpReVLwGFalzwwtTG1kVFvzFXLjci4YbXoOD4rnlxpisgoWI92QNpup3CZVCKc7BWgYLMaMTNjcejJeqiiYox8s9Iocfq5tEf45dOK50fseSGnde487rtPN7ZHwntoj8H08J1Pe1Rnd94iXELilaPCE7GlRMJ1PSai6LAnz0QskPzxj6gGycHU_1ty-zrx_JK_yCBZV5OSJr3XLl98Gz6uyn_uz8AcqKGAs
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Adaptive+dynamic+programming-based+decentralised+control+for+large-scale+nonlinear+systems+subject+to+mismatched+interconnections+with+unknown+time-delay&rft.jtitle=International+journal+of+systems+science&rft.au=Wu%2C+Qiuye&rft.au=Zhao%2C+Bo&rft.au=Liu%2C+Derong&rft.date=2020-11-17&rft.pub=Taylor+%26+Francis&rft.issn=0020-7721&rft.eissn=1464-5319&rft.volume=51&rft.issue=15&rft.spage=2883&rft.epage=2898&rft_id=info:doi/10.1080%2F00207721.2020.1803439&rft.externalDocID=1803439
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0020-7721&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0020-7721&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0020-7721&client=summon