Stochastic LQ Optimal Control With Initial and Terminal Constraints
In this article, we consider the discrete-time stochastic linear quadratic (LQ) optimal control with both initial and terminal constraints. The main contribution includes two aspects: one is to provide a necessary and sufficient condition for the exact reachability of stochastic systems; the other i...
Saved in:
| Published in | IEEE transactions on automatic control Vol. 69; no. 9; pp. 6261 - 6268 |
|---|---|
| Main Authors | , , , |
| Format | Journal Article |
| Language | English |
| Published |
New York
IEEE
01.09.2024
The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Subjects | |
| Online Access | Get full text |
| ISSN | 0018-9286 1558-2523 |
| DOI | 10.1109/TAC.2024.3376422 |
Cover
| Abstract | In this article, we consider the discrete-time stochastic linear quadratic (LQ) optimal control with both initial and terminal constraints. The main contribution includes two aspects: one is to provide a necessary and sufficient condition for the exact reachability of stochastic systems; the other is to characterize the solvability condition of the constrained stochastic LQ optimal control problem based on the exact reachability of the stochastic systems and obtain the explicitly optimal controller. The key technique is to innovatively transform the stochastic system governed by a forward stochastic difference equation into one governed by a backward stochastic difference equation. This way, we are able to solve the forward and backward stochastic difference equations derived from the stochastic maximum principle. |
|---|---|
| AbstractList | In this article, we consider the discrete-time stochastic linear quadratic (LQ) optimal control with both initial and terminal constraints. The main contribution includes two aspects: one is to provide a necessary and sufficient condition for the exact reachability of stochastic systems; the other is to characterize the solvability condition of the constrained stochastic LQ optimal control problem based on the exact reachability of the stochastic systems and obtain the explicitly optimal controller. The key technique is to innovatively transform the stochastic system governed by a forward stochastic difference equation into one governed by a backward stochastic difference equation. This way, we are able to solve the forward and backward stochastic difference equations derived from the stochastic maximum principle. |
| Author | Liu, Jingmei Zhang, Huanshui Xu, Juanjuan Fu, Minyue |
| Author_xml | – sequence: 1 givenname: Jingmei orcidid: 0000-0003-1938-7930 surname: Liu fullname: Liu, Jingmei email: 201920506@mail.sdu.edu.cn organization: School of Control Science and Engineering, Shandong University, Jinan, China – sequence: 2 givenname: Juanjuan orcidid: 0000-0003-0331-9976 surname: Xu fullname: Xu, Juanjuan email: juanjuanxu@sdu.edu.cn organization: School of Control Science and Engineering, Shandong University, Jinan, China – sequence: 3 givenname: Huanshui orcidid: 0000-0002-8611-7327 surname: Zhang fullname: Zhang, Huanshui email: hszhang@sdu.edu.cn organization: College of Electrical Engineering and Automation, Shandong University of Science and Technology, Qingdao, China – sequence: 4 givenname: Minyue orcidid: 0000-0002-4659-601X surname: Fu fullname: Fu, Minyue email: fumy@sustech.edu.cn organization: Department of Mechanical and Energy Engineering, Southern University of Science and Technology, Shenzhen, Guangdong, China |
| BookMark | eNp9kEFLAzEQhYNUsK3ePXhY8Lw1mWSzm2NZtBYKRax4DNk0S1O22ZqkB_-9KduDePA0zPDezLxvgkaudwahe4JnhGDxtJnXM8DAZpSWnAFcoTEpiiqHAugIjTEmVS6g4jdoEsI-tZwxMkb1e-z1ToVodbZ6y9bHaA-qy-reRd932aeNu2zpbLRpqNw22xh_sG5QhOiVdTHcoutWdcHcXeoUfbw8b-rXfLVeLOv5KtcgIOZbyjClwkCDudIlwcAFxkZpTji0pqQM1JaV2PCqhYZoXVVlU6i20k3RaCXoFD0Oe4--_zqZEOW-P_n0TJAUi1IApBVJhQeV9n0I3rTy6FMm_y0JlmdUMqGSZ1TygipZ-B-LtlFFe4agbPef8WEwWmPMrzspBQNOfwBRF3b7 |
| CODEN | IETAA9 |
| CitedBy_id | crossref_primary_10_1002_asjc_3575 crossref_primary_10_1080_00207721_2025_2449587 |
| Cites_doi | 10.1016/S0005-1098(02)00041-9 10.1111/1467-9965.00022 10.1137/0306044 10.1109/TAC.2014.2385253 10.1137/16M1104597 10.1016/j.ast.2005.07.010 10.4310/CIS.2006.v6.n4.a4 10.1007/s002450010016 10.1016/j.automatica.2013.08.017 10.1016/j.amc.2013.09.036 10.1051/cocv/2014030 10.1007/s00245-019-09576-z 10.1109/TITS.2020.2972770 10.1109/TAC.2015.2411911 10.1016/j.automatica.2020.108809 10.1137/S036301299834973X 10.1137/15M103532X 10.1137/s0363012900378504 10.1051/cocv/2020027 10.1109/CDC.2016.7798422 10.1109/TIE.2013.2253073 10.1023/A:1016578629272 10.1137/S0363012904441969 10.1137/0314028 10.2514/2.4735 10.1109/TAC.2019.2931463 10.1109/9.911419 |
| ContentType | Journal Article |
| Copyright | Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024 |
| Copyright_xml | – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024 |
| DBID | 97E RIA RIE AAYXX CITATION 7SC 7SP 7TB 8FD FR3 JQ2 L7M L~C L~D |
| DOI | 10.1109/TAC.2024.3376422 |
| DatabaseName | IEEE Xplore (IEEE) IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE/IET Electronic Library CrossRef Computer and Information Systems Abstracts Electronics & Communications Abstracts Mechanical & Transportation Engineering Abstracts Technology Research Database Engineering Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional |
| DatabaseTitle | CrossRef Technology Research Database Computer and Information Systems Abstracts – Academic Mechanical & Transportation Engineering Abstracts Electronics & Communications Abstracts ProQuest Computer Science Collection Computer and Information Systems Abstracts Engineering Research Database Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Professional |
| DatabaseTitleList | Technology Research Database |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE/IET Electronic Library url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering |
| EISSN | 1558-2523 |
| EndPage | 6268 |
| ExternalDocumentID | 10_1109_TAC_2024_3376422 10470426 |
| Genre | orig-research |
| GrantInformation_xml | – fundername: Natural Science Foundation of Shandong Province grantid: ZR2021ZD14; ZR2021JQ24 funderid: 10.13039/501100007129 – fundername: National Natural Science Foundation of China grantid: 61821004; 62250056; 62350710214; U23A20325; 62350055 funderid: 10.13039/501100001809 – fundername: High-level Talent Team Project of Qingdao West Coast New Area grantid: RCTD-JC-2019-05 |
| GroupedDBID | -~X .DC 0R~ 29I 3EH 4.4 5GY 5VS 6IK 97E AAJGR AARMG AASAJ AAWTH ABAZT ABQJQ ABVLG ACGFO ACGFS ACIWK ACNCT AENEX AETIX AGQYO AGSQL AHBIQ AI. AIBXA AKJIK AKQYR ALLEH ALMA_UNASSIGNED_HOLDINGS ASUFR ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ CS3 DU5 EBS EJD F5P HZ~ H~9 IAAWW IBMZZ ICLAB IDIHD IFIPE IFJZH IPLJI JAVBF LAI M43 MS~ O9- OCL P2P RIA RIE RNS TAE TN5 VH1 VJK ~02 AAYOK AAYXX CITATION RIG 7SC 7SP 7TB 8FD FR3 JQ2 L7M L~C L~D |
| ID | FETCH-LOGICAL-c292t-d340339e2b06ac71026900eac6162fe7342ad470e68f2b1cc887b5af8cb5bca93 |
| IEDL.DBID | RIE |
| ISSN | 0018-9286 |
| IngestDate | Mon Jun 30 10:16:10 EDT 2025 Tue Jul 01 03:36:49 EDT 2025 Thu Apr 24 23:01:42 EDT 2025 Wed Aug 27 02:03:43 EDT 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 9 |
| Language | English |
| License | https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html https://doi.org/10.15223/policy-029 https://doi.org/10.15223/policy-037 |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c292t-d340339e2b06ac71026900eac6162fe7342ad470e68f2b1cc887b5af8cb5bca93 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
| ORCID | 0000-0003-1938-7930 0000-0002-8611-7327 0000-0002-4659-601X 0000-0003-0331-9976 |
| PQID | 3097922342 |
| PQPubID | 85475 |
| PageCount | 8 |
| ParticipantIDs | ieee_primary_10470426 crossref_primary_10_1109_TAC_2024_3376422 proquest_journals_3097922342 crossref_citationtrail_10_1109_TAC_2024_3376422 |
| ProviderPackageCode | CITATION AAYXX |
| PublicationCentury | 2000 |
| PublicationDate | 2024-09-01 |
| PublicationDateYYYYMMDD | 2024-09-01 |
| PublicationDate_xml | – month: 09 year: 2024 text: 2024-09-01 day: 01 |
| PublicationDecade | 2020 |
| PublicationPlace | New York |
| PublicationPlace_xml | – name: New York |
| PublicationTitle | IEEE transactions on automatic control |
| PublicationTitleAbbrev | TAC |
| PublicationYear | 2024 |
| Publisher | IEEE The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Publisher_xml | – name: IEEE – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| References | ref13 ref12 ref15 ref14 ref30 ref11 ref10 ref2 ref1 ref17 ref16 ref19 ref18 Letov (ref5) 1961; 22 Bellman (ref4) 1958 ref24 ref23 ref26 ref25 Kalman (ref6) 1960; 5 ref20 ref22 ref21 ref28 ref27 ref29 ref8 ref7 ref9 ref3 |
| References_xml | – ident: ref17 doi: 10.1016/S0005-1098(02)00041-9 – ident: ref28 doi: 10.1111/1467-9965.00022 – ident: ref7 doi: 10.1137/0306044 – ident: ref14 doi: 10.1109/TAC.2014.2385253 – ident: ref23 doi: 10.1137/16M1104597 – ident: ref1 doi: 10.1016/j.ast.2005.07.010 – ident: ref22 doi: 10.4310/CIS.2006.v6.n4.a4 – ident: ref9 doi: 10.1007/s002450010016 – ident: ref13 doi: 10.1016/j.automatica.2013.08.017 – ident: ref26 doi: 10.1016/j.amc.2013.09.036 – ident: ref15 doi: 10.1051/cocv/2014030 – ident: ref19 doi: 10.1007/s00245-019-09576-z – ident: ref29 doi: 10.1109/TITS.2020.2972770 – ident: ref12 doi: 10.1109/TAC.2015.2411911 – ident: ref21 doi: 10.1016/j.automatica.2020.108809 – ident: ref30 doi: 10.1137/S036301299834973X – ident: ref16 doi: 10.1137/15M103532X – ident: ref18 doi: 10.1137/s0363012900378504 – ident: ref24 doi: 10.1051/cocv/2020027 – ident: ref25 doi: 10.1109/CDC.2016.7798422 – ident: ref2 doi: 10.1109/TIE.2013.2253073 – ident: ref8 doi: 10.1023/A:1016578629272 – ident: ref20 doi: 10.1137/S0363012904441969 – ident: ref27 doi: 10.1137/0314028 – ident: ref10 doi: 10.2514/2.4735 – ident: ref3 doi: 10.1109/TAC.2019.2931463 – volume-title: Some Aspects of the Mathematical Theory of Control Processes year: 1958 ident: ref4 – volume: 22 start-page: 363 issue: 4 year: 1961 ident: ref5 article-title: The analytical design of control systems publication-title: Automat Remote Control – volume: 5 start-page: 102 issue: 63 year: 1960 ident: ref6 article-title: Contributions to the theory of optimal control publication-title: Bol Soc Mat Mexicana – ident: ref11 doi: 10.1109/9.911419 |
| SSID | ssj0016441 |
| Score | 2.4730895 |
| Snippet | In this article, we consider the discrete-time stochastic linear quadratic (LQ) optimal control with both initial and terminal constraints. The main... |
| SourceID | proquest crossref ieee |
| SourceType | Aggregation Database Enrichment Source Index Database Publisher |
| StartPage | 6261 |
| SubjectTerms | Backward stochastic difference equation Control systems Cost function Difference equations initial and terminal constraints Maximum principle Optimal control Riccati equation Riccati equations stochastic linear quadratic (LQ) optimal control Stochastic systems Terminal constraints Transforms White noise |
| Title | Stochastic LQ Optimal Control With Initial and Terminal Constraints |
| URI | https://ieeexplore.ieee.org/document/10470426 https://www.proquest.com/docview/3097922342 |
| Volume | 69 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV3NT8IwFH8RTnrwEyOKZgcvHgaj7cZ6JIsEjWKMELkta9cGo4KRcfGv97UdBDUab8vSLi99fV977_0ewLkUuSLKAN1SgQFKlGmfc6X9WCqZG7yx0M4hux1E_RG7Hofjslnd9sIopWzxmWqaR5vLz2dyYX6VtQysgPH5K1DBe-aatVYpA2PYndpFCSbxKicZ8Nawm2AkSFiTojgxQr7YIDtU5YcmtualtwODJWGuquS5uShEU358w2z8N-W7sF06ml7X3Yw92FDTfdhagx88gOShmMlJZpCavZt77w61xytuSVz1uvf4VEy8K1NchC-zae4NXeGMXTG3syWKeQ1Gvcth0vfLoQq-JJwUfk5ZQClXRARRJo1_gfFxgOo3akdEqw5lJMuRWBXFmoi2lKiFRJjpWIpQyIzTQ6hOZ1N1BB7TIhZMM2Q2YzLQpms355pi0CXRLWnXobU85lSWiOOGuJfURh4BT5ExqWFMWjKmDherHW8ObeOPtTVzzmvr3BHXobFkZVrK4zylAe9w9IQYOf5l2wlsmq-78rEGVIv3hTpFf6MQZ_aefQKGW899 |
| linkProvider | IEEE |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV07T8MwED7xGICBZxHlmYGFIW1qO2k8ooqqhbYI0YpuUezYKgJaRNOFX8_ZTiseArFFka2c7nyv-O47gHMpMkWUAbqlAhOUKNU-50r7sVQyM3hjoZ1D1u1FrQG7HobDolnd9sIopWzxmaqYR3uXn03kzPwqqxpYARPzL8MqOn4WunatxaWBce3O8KIOk3hxKxnwav-ygbkgYRWKCsUI-eKF7FiVH7bYOpjmFvTmpLm6kqfKLBcV-f4NtfHftG_DZhFqepfubOzAkhrvwsYnAMI9aNznEzlKDVaz17nzbtF-vOCWhqtf9x4e85HXNuVF-DIdZ17flc7YFVM7XSKflmDQvOo3Wn4xVsGXhJPczygLKOWKiCBKpYkwMEMO0ABHtYhoVaeMpBkSq6JYE1GTEu2QCFMdSxEKmXK6DyvjyVgdgMe0iAXTDMXNmAy06dvNuKaYdkkMTGplqM7ZnMgCc9wQ95zY3CPgCQomMYJJCsGU4WKx49XhbfyxtmT4_GmdY3EZjueiTAqNnCY04HWOsRAjh79sO4O1Vr_bSTrt3s0RrJsvuWKyY1jJ32bqBKOPXJzaM_cBkaXSyg |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Stochastic+LQ+Optimal+Control+With+Initial+and+Terminal+Constraints&rft.jtitle=IEEE+transactions+on+automatic+control&rft.au=Liu%2C+Jingmei&rft.au=Xu%2C+Juanjuan&rft.au=Zhang%2C+Huanshui&rft.au=Fu%2C+Minyue&rft.date=2024-09-01&rft.pub=The+Institute+of+Electrical+and+Electronics+Engineers%2C+Inc.+%28IEEE%29&rft.issn=0018-9286&rft.eissn=1558-2523&rft.volume=69&rft.issue=9&rft.spage=6261&rft_id=info:doi/10.1109%2FTAC.2024.3376422&rft.externalDBID=NO_FULL_TEXT |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0018-9286&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0018-9286&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0018-9286&client=summon |