A Finite Convergence Criterion for the Discounted Optimal Control of Stochastic Logical Networks

Stochastic logical networks (SLNs) are discrete-time stochastic dynamical systems with Boolean (or multivalued) logical state variables. The discounted infinite horizon optimal control problem for SLN is addressed in this paper. By resorting to the equivalent Markov decision process description, the...

Full description

Saved in:
Bibliographic Details
Published inIEEE transactions on automatic control Vol. 63; no. 1; pp. 262 - 268
Main Authors Wu, Yuhu, Shen, Tielong
Format Journal Article
LanguageEnglish
Published IEEE 01.01.2018
Subjects
Aerospace electronics
Boolean networks
Controllability
Convergence
Cost function
logical networks (LN)
Markov processes
Optimal control
semi-tensor product
stochastic logical networks (SLNs)
Online AccessGet full text

Cover

More Information
Summary:Stochastic logical networks (SLNs) are discrete-time stochastic dynamical systems with Boolean (or multivalued) logical state variables. The discounted infinite horizon optimal control problem for SLN is addressed in this paper. By resorting to the equivalent Markov decision process description, the infinite horizon optimization problem is presented in algebraic form. Then using the increasing-dimension technique, an improved finite convergence criterion, which can find the optimal stationary policy, is derived for value iteration approach. To demonstrate the theoretical value of this approach, it is applied to the optimization problems of the human-machine game and the p53-Mdm2 gene network.
ISSN:0018-9286
1558-2523
DOI:10.1109/TAC.2017.2720730