Optimal Control for Stochastic Delay Evolution Equations
Abstract
In this paper, we investigate a class of infinitedimensional optimal control problems, where the state equation is given by a stochastic delay evolution equation with random coefficients, and the corresponding adjoint equation is given by an anticipated backward stochastic evolution equation. We first prove the continuous dependence theorems for stochastic delay evolution equations and anticipated backward stochastic evolution equations, and show the existence and uniqueness of solutions to anticipated backward stochastic evolution equations. Then we establish necessary and sufficient conditions for optimality of the control problem in the form of Pontryagin’s maximum principles. To illustrate the theoretical results, we apply stochastic maximum principles to study two examples, an infinitedimensional linearquadratic control problem with delay and an optimal control of a Dirichlet problem for a stochastic partial differential equation with delay. Further applications of the two examples to a Cauchy problem for a controlled linear stochastic partial differential equation and an optimal harvesting problem are also considered.
 Authors:
 Huzhou University, Department of Mathematical Sciences (China)
 York University, Department of Mathematics and Statistics (Canada)
 Publication Date:
 OSTI Identifier:
 22617267
 Resource Type:
 Journal Article
 Resource Relation:
 Journal Name: Applied Mathematics and Optimization; Journal Volume: 74; Journal Issue: 1; Other Information: Copyright (c) 2016 Springer Science+Business Media New York; http://www.springerny.com; Country of input: International Atomic Energy Agency (IAEA)
 Country of Publication:
 United States
 Language:
 English
 Subject:
 97 MATHEMATICAL METHODS AND COMPUTING; CAUCHY PROBLEM; DIRICHLET PROBLEM; EVOLUTION; MATHEMATICAL SOLUTIONS; OPTIMAL CONTROL; PARTIAL DIFFERENTIAL EQUATIONS; RANDOMNESS; STOCHASTIC PROCESSES
Citation Formats
Meng, Qingxin, Email: mqx@hutc.zj.cn, and Shen, Yang, Email: skyshen87@gmail.com. Optimal Control for Stochastic Delay Evolution Equations. United States: N. p., 2016.
Web. doi:10.1007/S0024501593082.
Meng, Qingxin, Email: mqx@hutc.zj.cn, & Shen, Yang, Email: skyshen87@gmail.com. Optimal Control for Stochastic Delay Evolution Equations. United States. doi:10.1007/S0024501593082.
Meng, Qingxin, Email: mqx@hutc.zj.cn, and Shen, Yang, Email: skyshen87@gmail.com. 2016.
"Optimal Control for Stochastic Delay Evolution Equations". United States.
doi:10.1007/S0024501593082.
@article{osti_22617267,
title = {Optimal Control for Stochastic Delay Evolution Equations},
author = {Meng, Qingxin, Email: mqx@hutc.zj.cn and Shen, Yang, Email: skyshen87@gmail.com},
abstractNote = {In this paper, we investigate a class of infinitedimensional optimal control problems, where the state equation is given by a stochastic delay evolution equation with random coefficients, and the corresponding adjoint equation is given by an anticipated backward stochastic evolution equation. We first prove the continuous dependence theorems for stochastic delay evolution equations and anticipated backward stochastic evolution equations, and show the existence and uniqueness of solutions to anticipated backward stochastic evolution equations. Then we establish necessary and sufficient conditions for optimality of the control problem in the form of Pontryagin’s maximum principles. To illustrate the theoretical results, we apply stochastic maximum principles to study two examples, an infinitedimensional linearquadratic control problem with delay and an optimal control of a Dirichlet problem for a stochastic partial differential equation with delay. Further applications of the two examples to a Cauchy problem for a controlled linear stochastic partial differential equation and an optimal harvesting problem are also considered.},
doi = {10.1007/S0024501593082},
journal = {Applied Mathematics and Optimization},
number = 1,
volume = 74,
place = {United States},
year = 2016,
month = 8
}

We consider a nonlinear stochastic optimal control problem associated with a stochastic evolution equation. This equation is driven by a continuous martingale in a separable Hilbert space and an unbounded timedependent linear operator.We derive a stochastic maximum principle for this optimal control problem. Our results are achieved by using the adjoint backward stochastic partial differential equation.

Time Discretisation and Rate of Convergence for the Optimal Control of ContinuousTime Stochastic Systems with Delay
We study a semidiscretisation scheme for stochastic optimal control problems whose dynamics are given by controlled stochastic delay (or functional) differential equations with bounded memory. Performance is measured in terms of expected costs. By discretising time in two steps, we construct a sequence of approximating finitedimensional Markovian optimal control problems in discrete time. The corresponding value functions converge to the value function of the original problem, and we derive an upper bound on the discretisation error or, equivalently, a worstcase estimate for the rate of convergence. 
Modeling delay in genetic networks: From delay birthdeath processes to delay stochastic differential equations
Delay is an important and ubiquitous aspect of many biochemical processes. For example, delay plays a central role in the dynamics of genetic regulatory networks as it stems from the sequential assembly of first mRNA and then protein. Genetic regulatory networks are therefore frequently modeled as stochastic birthdeath processes with delay. Here, we examine the relationship between delay birthdeath processes and their appropriate approximating delay chemical Langevin equations. We prove a quantitative bound on the error between the pathwise realizations of these two processes. Our results hold for both fixed delay and distributed delay. Simulations demonstrate that the delay chemicalmore » 
Backward Stochastic Riccati Equations and Infinite Horizon LQ Optimal Control with Infinite Dimensional State Space and Random Coefficients
We study the Riccati equation arising in a class of quadratic optimal control problems with infinite dimensional stochastic differential state equation and infinite horizon cost functional. We allow the coefficients, both in the state equation and in the cost, to be random.In such a context backward stochastic Riccati equations are backward stochastic differential equations in the whole positive real axis that involve quadratic nonlinearities and take values in a nonHilbertian space. We prove existence of a minimal nonnegative solution and, under additional assumptions, its uniqueness. We show that such a solution allows to perform the synthesis of the optimal controlmore » 
Infinite Horizon Stochastic Optimal Control Problems with Degenerate Noise and Elliptic Equations in Hilbert Spaces
Semilinear elliptic partial differential equations are solved in a mild sense in an infinitedimensional Hilbert space. These results are applied to a stochastic optimal control problem with infinite horizon. Applications to controlled stochastic heat and wave equations are given.