Analysis and computation of an optimality equation arising in an impulse control problem with discrete and costly observations

• Published in: Journal of computational and applied mathematics Vol. 366; p. 112399
• Main Authors: Yoshioka, Hidekazu, Tsujimura, Motoh
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.03.2020
• Subjects: Discrete and costly observations; Ecological management; Finite difference scheme; Fixed point problem; Model ambiguity; Optimality equation; Finite difference scheme; Ecological management; Model ambiguity; Fixed point problem; Optimality equation; Discrete and costly observations
• ISSN: 0377-0427; 1879-1778
• DOI: 10.1016/j.cam.2019.112399

The framework of discrete and costly observations provides an attractive mathematical tool for stochastic control of biological and ecological systems in natural environment. However, this framework is still germinating, and its applications in these research areas are still rare. In this framework, the system dynamics to be controlled is continuous-time, while the observations by the decision-maker are discrete-time. The control problem of the system dynamics has a time-hybridized type nature, by which the optimality equation has a different form from the conventional ones. The objectives as well as contributions of this paper are formulation of the optimality equation focusing on population management problems, its detailed mathematical analysis, numerical discretization, and a demonstrative application. We show that the optimality equation is solvable uniquely and its solution can be approximated recursively. A numerical method to discretize the optimality equation is established with a simple finite difference scheme and the recursive formula. Mathematical analysis results such as monotonicity, stability, and convergence of the numerical method are discussed as well. The present model is then applied to a population management problem. Finally, an advanced problem subject to model ambiguity is also analyzed. •We approach discrete and costly observations of stochastic population dynamics.•The optimality equation has a different form from the conventional ones.•Its existence, solvability, and numerical approximation are extensively analyzed.•Theoretical and computational results agree for a population management problem.•A problem with model ambiguity is further analyzed with a finite difference scheme.