The Mixed-Observable Constrained Linear Quadratic Regulator Problem: the Exact Solution and Practical Algorithms

This paper studies the problem of steering a linear time-invariant system subject to state and input constraints towards a goal location that may be inferred only through partial observations. We assume mixed-observable settings, where the system's state is fully observable and the environment&...

Full description

Saved in:
Bibliographic Details
Main Authors Rosolia, Ugo, Chen, Yuxiao, Daftry, Shreyansh, Ono, Masahiro, Yue, Yisong, Ames, Aaron D
Format Journal Article
LanguageEnglish
Published 26.08.2021
Subjects
Online AccessGet full text
DOI10.48550/arxiv.2108.12030

Cover

Abstract This paper studies the problem of steering a linear time-invariant system subject to state and input constraints towards a goal location that may be inferred only through partial observations. We assume mixed-observable settings, where the system's state is fully observable and the environment's state defining the goal location is only partially observed. In these settings, the planning problem is an infinite-dimensional optimization problem where the objective is to minimize the expected cost. We show how to reformulate the control problem as a finite-dimensional deterministic problem by optimizing over a trajectory tree. Leveraging this result, we demonstrate that when the environment is static, the observation model piecewise, and cost function convex, the original control problem can be reformulated as a Mixed-Integer Convex Program (MICP) that can be solved to global optimality using a branch-and-bound algorithm. The effectiveness of the proposed approach is demonstrated on navigation tasks, where the system has to reach a goal location identified from partial observations.
AbstractList This paper studies the problem of steering a linear time-invariant system subject to state and input constraints towards a goal location that may be inferred only through partial observations. We assume mixed-observable settings, where the system's state is fully observable and the environment's state defining the goal location is only partially observed. In these settings, the planning problem is an infinite-dimensional optimization problem where the objective is to minimize the expected cost. We show how to reformulate the control problem as a finite-dimensional deterministic problem by optimizing over a trajectory tree. Leveraging this result, we demonstrate that when the environment is static, the observation model piecewise, and cost function convex, the original control problem can be reformulated as a Mixed-Integer Convex Program (MICP) that can be solved to global optimality using a branch-and-bound algorithm. The effectiveness of the proposed approach is demonstrated on navigation tasks, where the system has to reach a goal location identified from partial observations.
Author Daftry, Shreyansh
Ono, Masahiro
Chen, Yuxiao
Rosolia, Ugo
Yue, Yisong
Ames, Aaron D
Author_xml – sequence: 1
  givenname: Ugo
  surname: Rosolia
  fullname: Rosolia, Ugo
– sequence: 2
  givenname: Yuxiao
  surname: Chen
  fullname: Chen, Yuxiao
– sequence: 3
  givenname: Shreyansh
  surname: Daftry
  fullname: Daftry, Shreyansh
– sequence: 4
  givenname: Masahiro
  surname: Ono
  fullname: Ono, Masahiro
– sequence: 5
  givenname: Yisong
  surname: Yue
  fullname: Yue, Yisong
– sequence: 6
  givenname: Aaron D
  surname: Ames
  fullname: Ames, Aaron D
BackLink https://doi.org/10.48550/arXiv.2108.12030$$DView paper in arXiv
BookMark eNqFjssKwjAURLPQha8PcOX9gda0Kog7KRUXiq_uy7WJGkiTcptK_XujuHczAzPDcPqsY6yRjI0jHs6XiwWfIrXqGcYRX4ZRzGe8x6rsIWGvWimCw7WW9MSrlpBYUztCZaSAnVckODUoCJ0q4CzvjUZnCY5k_bpcgfMnaYuFg4vVjVPWABrhex-pAjWs9d2Sco-yHrLuDXUtRz8fsMkmzZJt8GXLK1Il0iv_MOZfxtn_xRul-0oF
ContentType Journal Article
Copyright http://creativecommons.org/licenses/by/4.0
Copyright_xml – notice: http://creativecommons.org/licenses/by/4.0
DBID AKZ
GOX
DOI 10.48550/arxiv.2108.12030
DatabaseName arXiv Mathematics
arXiv.org
DatabaseTitleList
Database_xml – sequence: 1
  dbid: GOX
  name: arXiv.org
  url: http://arxiv.org/find
  sourceTypes: Open Access Repository
DeliveryMethod fulltext_linktorsrc
ExternalDocumentID 2108_12030
GroupedDBID AKZ
GOX
ID FETCH-arxiv_primary_2108_120303
IEDL.DBID GOX
IngestDate Wed Jul 23 01:57:43 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-arxiv_primary_2108_120303
OpenAccessLink https://arxiv.org/abs/2108.12030
ParticipantIDs arxiv_primary_2108_12030
PublicationCentury 2000
PublicationDate 2021-08-26
PublicationDateYYYYMMDD 2021-08-26
PublicationDate_xml – month: 08
  year: 2021
  text: 2021-08-26
  day: 26
PublicationDecade 2020
PublicationYear 2021
Score 3.5399404
SecondaryResourceType preprint
Snippet This paper studies the problem of steering a linear time-invariant system subject to state and input constraints towards a goal location that may be inferred...
SourceID arxiv
SourceType Open Access Repository
SubjectTerms Mathematics - Optimization and Control
Title The Mixed-Observable Constrained Linear Quadratic Regulator Problem: the Exact Solution and Practical Algorithms
URI https://arxiv.org/abs/2108.12030
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwdV1LSwMxEB7anryIolLfc_C66u5mH_Um0lqEWhWFvS15aqG2ZbuV_flOkha99JqEZJhJyPdNMjMAVyw1sSHUFvCYs4DFQgSE42wkV86MsVF7mQ1wHj2nww_2VCRFC3ATC8OrZvLj8wOL5Q3xkfw6jGgjtqEdRZZcPY4L_zjpUnGtx_-NI4zpmv5dEoM92F2jO7z35tiHlp4dwIJMgaNJo1UwFs4JKqYabaVMV59BKyRCSBsOX1dcWYNIfPMV4ucVvviCL3dIQA37DZc1bjxZyGcKfb4haRedfs6J6X99Lw_hctB_fxgGTsZy4RNKlFb80okfH0GHaL_uAkrDYh6yLFNGsISbnspIfUneS0PDJOfH0N02y8n2rlPYieyvjFs6H-kZdOpqpc_pWq3FhdPtL4qKfaw
linkProvider Cornell University
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+Mixed-Observable+Constrained+Linear+Quadratic+Regulator+Problem%3A+the+Exact+Solution+and+Practical+Algorithms&rft.au=Rosolia%2C+Ugo&rft.au=Chen%2C+Yuxiao&rft.au=Daftry%2C+Shreyansh&rft.au=Ono%2C+Masahiro&rft.date=2021-08-26&rft_id=info:doi/10.48550%2Farxiv.2108.12030&rft.externalDocID=2108_12030