非线性零和微分对策的事件触发自适应动态规划算法

TP273; 针对一类非线性零和微分对策问题,本文提出了一种事件触发自适应动态规划(event-triggered adaptive dynamic programming, ET-ADP)算法在线求解其鞍点.首先,提出一个新的自适应事件触发条件.然后,利用一个输入为采样数据的神经网络(评价网络)近似最优值函数,并设计了新型的神经网络权值更新律使得值函数、控制策略及扰动策略仅在事件触发时刻同步更新.进一步地,利用Lyapunov稳定性理论证明了所提出的算法能够在线获得非线性零和微分对策的鞍点且不会引起Zeno行为.所提出的ET-ADP算法仅在事件触发条件满足时才更新值函数、控制策略和扰动策略,...

Full description

Saved in:
Bibliographic Details
Published in控制理论与应用 Vol. 35; no. 5; pp. 610 - 618
Main Authors 崔黎黎, 张勇, 张欣
Format Journal Article
LanguageChinese
Published 沈阳师范大学科信软件学院,辽宁沈阳,110034%中国石油大学(华东)信息与控制工程学院,山东青岛,266580 01.05.2018
Subjects
Online AccessGet full text
ISSN1000-8152
DOI10.7641/CTA.2017.70674

Cover

Loading…
Abstract TP273; 针对一类非线性零和微分对策问题,本文提出了一种事件触发自适应动态规划(event-triggered adaptive dynamic programming, ET-ADP)算法在线求解其鞍点.首先,提出一个新的自适应事件触发条件.然后,利用一个输入为采样数据的神经网络(评价网络)近似最优值函数,并设计了新型的神经网络权值更新律使得值函数、控制策略及扰动策略仅在事件触发时刻同步更新.进一步地,利用Lyapunov稳定性理论证明了所提出的算法能够在线获得非线性零和微分对策的鞍点且不会引起Zeno行为.所提出的ET-ADP算法仅在事件触发条件满足时才更新值函数、控制策略和扰动策略,因而可有效减少计算量和降低网络负荷.最后,两个仿真例子验证了所提出的ET-ADP算法的有效性.
AbstractList TP273; 针对一类非线性零和微分对策问题,本文提出了一种事件触发自适应动态规划(event-triggered adaptive dynamic programming, ET-ADP)算法在线求解其鞍点.首先,提出一个新的自适应事件触发条件.然后,利用一个输入为采样数据的神经网络(评价网络)近似最优值函数,并设计了新型的神经网络权值更新律使得值函数、控制策略及扰动策略仅在事件触发时刻同步更新.进一步地,利用Lyapunov稳定性理论证明了所提出的算法能够在线获得非线性零和微分对策的鞍点且不会引起Zeno行为.所提出的ET-ADP算法仅在事件触发条件满足时才更新值函数、控制策略和扰动策略,因而可有效减少计算量和降低网络负荷.最后,两个仿真例子验证了所提出的ET-ADP算法的有效性.
Abstract_FL In this paper, an event-triggered adaptive dynamic programming algorithm (ET-ADP) is proposed to solve the saddle point of a class of nonlinear zero-sum differential games. Firstly, a new adaptive event-triggered condition is proposed. Then, a neural network (critic network) with the sampled state as its input is utilized to approximate the optimal value function. The new neural network weights updating law is designed to enable the value function, the control strategy and the disturbance strategy to be updated synchronously only at the event-triggered time. Further, the Lyapunov stability theory is used to prove that the proposed algorithm can obtain the saddle point of nonlinear zero-sum differential games online and avoid the occurrence of Zeno behavior. In the proposed ET-ADP algorithm, the value function, the control strategy and the disturbance strategy are updated only when the event-triggered condition is satisfied, as a result of which the computational burden is reduced and the network burden is eased effectively. Finally, two simulation examples validate the effectiveness of the proposed ET-ADP algorithm.
Author 张欣
张勇
崔黎黎
AuthorAffiliation 沈阳师范大学科信软件学院,辽宁沈阳,110034%中国石油大学(华东)信息与控制工程学院,山东青岛,266580
AuthorAffiliation_xml – name: 沈阳师范大学科信软件学院,辽宁沈阳,110034%中国石油大学(华东)信息与控制工程学院,山东青岛,266580
Author_FL ZHANG Xin
CUI Li-li
ZHANG Yong
Author_FL_xml – sequence: 1
  fullname: CUI Li-li
– sequence: 2
  fullname: ZHANG Yong
– sequence: 3
  fullname: ZHANG Xin
Author_xml – sequence: 1
  fullname: 崔黎黎
– sequence: 2
  fullname: 张勇
– sequence: 3
  fullname: 张欣
BookMark eNotj8tKw0AYRmdRwVq79RncJP7_ZJJJlqXUCxTc1HWZTBJRSwoGkbqKUrRYQSxeQNGlEcG6EApG0JfpJO1bWNDVtzmcw7dACmE79AlZQtC5xXCl2qjoFJDrHCzOCqSIAKDZaNJ5Uo6iHRcAESg3sUhq08enPP3J4mT6MFKDC_U9VL1T9f6Zv93m991x2h9_jSbJs7q8mpy9TuMTlV6r85csPp4kXdUb5MO77ONmkcwFohX55f8tka3VWqO6rtU31zaqlboWIRiWZnuuH3DHZSg9yTj1qWEICczw0bOlLaR0Awddwag1Q1FgIJGakjrMDByH20aJLP95D0UYiHC7uds-2A9nxebeUavV6XRmt20wASzjFysjZyQ
ClassificationCodes TP273
ContentType Journal Article
Copyright Copyright © Wanfang Data Co. Ltd. All Rights Reserved.
Copyright_xml – notice: Copyright © Wanfang Data Co. Ltd. All Rights Reserved.
DBID 2B.
4A8
92I
93N
PSX
TCJ
DOI 10.7641/CTA.2017.70674
DatabaseName Wanfang Data Journals - Hong Kong
WANFANG Data Centre
Wanfang Data Journals
万方数据期刊 - 香港版
China Online Journals (COJ)
China Online Journals (COJ)
DatabaseTitleList
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
DocumentTitle_FL Event-triggered adaptive dynamic programming algorithm for the nonlinear zero-sum differential games
EndPage 618
ExternalDocumentID kzllyyy201805006
GrantInformation_xml – fundername: 国家自然科学基金项目; 山东省自然科学基金项目; 辽宁省高等学校基本科研项目专项资金; 沈阳师范大学科技项目(L201510)资助.Supported by the National Natural Science Foundation of China; the National Natural Science Foundation of Shandong Province; the Special Fund of Liaoning Province Universities’ Fundamental Scientific Research Projects; the Science and Technology Project of Shenyang Normal University
  funderid: (61703289); (BX2015DX009); (LQN201720,LQN201702); (61703289); (BX2015DX009); (LQN201720, LQN201702); (L201510)
GroupedDBID -01
-0Y
2B.
4A8
5XA
5XJ
92H
92I
93N
ABJNI
ACGFS
ALMA_UNASSIGNED_HOLDINGS
CCEZO
CCVFK
CUBFJ
CW9
PSX
TCJ
TGT
U1G
U5S
UY8
ID FETCH-LOGICAL-s1036-8dbef79b41cdc472e233ac043e1d8c8accbf91ba4268db1a1fc125c2945f99783
ISSN 1000-8152
IngestDate Thu May 29 04:08:30 EDT 2025
IsPeerReviewed true
IsScholarly true
Issue 5
Keywords 最优控制
adaptive dynamic programming
nonlinear zero-sum differential games
event-triggered
自适应动态规划
optimal control
非线性零和微分对策
事件触发
神经网络
Language Chinese
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-s1036-8dbef79b41cdc472e233ac043e1d8c8accbf91ba4268db1a1fc125c2945f99783
PageCount 9
ParticipantIDs wanfang_journals_kzllyyy201805006
PublicationCentury 2000
PublicationDate 2018-05-01
PublicationDateYYYYMMDD 2018-05-01
PublicationDate_xml – month: 05
  year: 2018
  text: 2018-05-01
  day: 01
PublicationDecade 2010
PublicationTitle 控制理论与应用
PublicationTitle_FL Control Theory & Applications
PublicationYear 2018
Publisher 沈阳师范大学科信软件学院,辽宁沈阳,110034%中国石油大学(华东)信息与控制工程学院,山东青岛,266580
Publisher_xml – name: 沈阳师范大学科信软件学院,辽宁沈阳,110034%中国石油大学(华东)信息与控制工程学院,山东青岛,266580
SSID ssib001102751
ssib002258297
ssib023646306
ssib057620041
ssib051372463
ssj0042201
ssib023167526
Score 2.2067065
Snippet TP273; 针对一类非线性零和微分对策问题,本文提出了一种事件触发自适应动态规划(event-triggered adaptive dynamic programming,...
SourceID wanfang
SourceType Aggregation Database
StartPage 610
Title 非线性零和微分对策的事件触发自适应动态规划算法
URI https://d.wanfangdata.com.cn/periodical/kzllyyy201805006
Volume 35
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnR1NaxQxdCjtRQ_iJ35TwRy37mQyk-SY2Z2liHqxhd7qzOyOgrKCbQ_tqUrRooJY_ABFj1YE60EoWEH_TKfb_gvfe5PuTO0eqrAMmeTlfWaTl92XF8e53Gm7GTgWQc1LVVIT4FDUYq6zWgaru9KujtsZRfneCMYnxdUpf2po-FYlamluNhlLFwaeK_kfq0Id2BVPyf6DZftIoQLKYF94goXheSAbs0gz3WQ6YpFkoWFhi0UBxi4YSU0hCwMW-UxzphpYCCNmIiwoxRQ1mRYLNXY3gCfAgjZMCRYJRKhCKhR4FKI11Eu1mHaxRkGNQVpAVHEiYZgWBGOYUZYf5druSljqwBISjZiWCBN6rLgFc9dRpo4RCULwYcFbndhW2BEIIW8KwUq6Ep-mH59LLYJaNMqBsLawB6TBTJ0oQYsc0BIwAwWv-huJq8qIRBrVJAdHZlH3CmVCBIpqFFpAUY0RVixQuSGx4BXVKdCAhlQVNtEype77wIBZM8Phm0FgEUJia0Q63scAb2CyPk8w7lttGYLHodEkbbWIT-qIA2Efe1yRXpqkOsKgG4zrCrcBkrbcFtbYbzrQA4jpk7CKhtVAiQDMxU-fkB3gxcjiyDZvgLPnF_dy2dUU0xYo19-z3BbZaey04lfWzsDGN3fsmxq0wstA4ArfmDAYlinHJHhbovRl-hGmdxfu3Zufn8fBUPcpJ_8IlxIDOUZM8_q1m-WWwcU_7isuLPfxtPnuO8dMEX65RcH7FgKvjEzwXU_yyo0SsH3HGaofZiY4pyvY-6ooEseiGFf2CkGnBrtZ3L1dcXAnjjpH7M501BTTzDFnaOHOcedwJV_pCSfa-fCxt_F7a3F15_16vvI8_7WWLz_Ov_3ofX3Te7e0ufFs8-f69uqn_MXL7SdfdhYf5Ruv8qeftxYfbq8u5csrvbW3W99fn3QmW9FEY7xm72GpzbiUr7yddDKpE-Gm7VRI3uGeF6d14XXctkpVnKZJpt0kBmcfQN3YzVLYNqVcCz_T-NPyKWe4e7_bOe2MSi9IPS6TVAUebNSCOFb1zAcD-W2vnaTBGeeSVcK0nWdnpv825dkDwJxzDpXzwHlnePbBXOcC7B5mk4t2APwBHYHL3w
linkProvider EBSCOhost
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=%E9%9D%9E%E7%BA%BF%E6%80%A7%E9%9B%B6%E5%92%8C%E5%BE%AE%E5%88%86%E5%AF%B9%E7%AD%96%E7%9A%84%E4%BA%8B%E4%BB%B6%E8%A7%A6%E5%8F%91%E8%87%AA%E9%80%82%E5%BA%94%E5%8A%A8%E6%80%81%E8%A7%84%E5%88%92%E7%AE%97%E6%B3%95&rft.jtitle=%E6%8E%A7%E5%88%B6%E7%90%86%E8%AE%BA%E4%B8%8E%E5%BA%94%E7%94%A8&rft.au=%E5%B4%94%E9%BB%8E%E9%BB%8E&rft.au=%E5%BC%A0%E5%8B%87&rft.au=%E5%BC%A0%E6%AC%A3&rft.date=2018-05-01&rft.pub=%E6%B2%88%E9%98%B3%E5%B8%88%E8%8C%83%E5%A4%A7%E5%AD%A6%E7%A7%91%E4%BF%A1%E8%BD%AF%E4%BB%B6%E5%AD%A6%E9%99%A2%2C%E8%BE%BD%E5%AE%81%E6%B2%88%E9%98%B3%2C110034%25%E4%B8%AD%E5%9B%BD%E7%9F%B3%E6%B2%B9%E5%A4%A7%E5%AD%A6%28%E5%8D%8E%E4%B8%9C%29%E4%BF%A1%E6%81%AF%E4%B8%8E%E6%8E%A7%E5%88%B6%E5%B7%A5%E7%A8%8B%E5%AD%A6%E9%99%A2%2C%E5%B1%B1%E4%B8%9C%E9%9D%92%E5%B2%9B%2C266580&rft.issn=1000-8152&rft.volume=35&rft.issue=5&rft.spage=610&rft.epage=618&rft_id=info:doi/10.7641%2FCTA.2017.70674&rft.externalDocID=kzllyyy201805006
thumbnail_s http://utb.summon.serialssolutions.com/2.0.0/image/custom?url=http%3A%2F%2Fwww.wanfangdata.com.cn%2Fimages%2FPeriodicalImages%2Fkzllyyy%2Fkzllyyy.jpg